-- Logs begin at Wed 2022-08-24 03:50:29 UTC, end at Wed 2022-08-24 04:50:09 UTC. -- Aug 24 04:16:34.558949 dv-cinder-854263-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 04:16:34.568017 dv-cinder-854263-1-smb devstack@keystone.service[81505]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 04:16:34.570352 dv-cinder-854263-1-smb devstack@keystone.service[81505]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 04:16:34 2022] *** Aug 24 04:16:34.570352 dv-cinder-854263-1-smb devstack@keystone.service[81505]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 04:16:34.570352 dv-cinder-854263-1-smb devstack@keystone.service[81505]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 04:16:34.570352 dv-cinder-854263-1-smb devstack@keystone.service[81505]: nodename: dv-cinder-854263-1-smb Aug 24 04:16:34.570352 dv-cinder-854263-1-smb devstack@keystone.service[81505]: machine: x86_64 Aug 24 04:16:34.570352 dv-cinder-854263-1-smb devstack@keystone.service[81505]: clock source: unix Aug 24 04:16:34.570352 dv-cinder-854263-1-smb devstack@keystone.service[81505]: pcre jit disabled Aug 24 04:16:34.570352 dv-cinder-854263-1-smb devstack@keystone.service[81505]: detected number of CPU cores: 4 Aug 24 04:16:34.570352 dv-cinder-854263-1-smb devstack@keystone.service[81505]: current working directory: / Aug 24 04:16:34.570352 dv-cinder-854263-1-smb devstack@keystone.service[81505]: detected binary path: /usr/bin/uwsgi-core Aug 24 04:16:34.570352 dv-cinder-854263-1-smb devstack@keystone.service[81505]: your processes number limit is 47680 Aug 24 04:16:34.571056 dv-cinder-854263-1-smb devstack@keystone.service[81505]: your memory page size is 4096 bytes Aug 24 04:16:34.571056 dv-cinder-854263-1-smb devstack@keystone.service[81505]: detected max file descriptor number: 2048 Aug 24 04:16:34.571056 dv-cinder-854263-1-smb devstack@keystone.service[81505]: lock engine: pthread robust mutexes Aug 24 04:16:34.571056 dv-cinder-854263-1-smb devstack@keystone.service[81505]: thunder lock: enabled Aug 24 04:16:34.571056 dv-cinder-854263-1-smb devstack@keystone.service[81505]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 04:16:34.571056 dv-cinder-854263-1-smb devstack@keystone.service[81505]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 04:16:34.610441 dv-cinder-854263-1-smb devstack@keystone.service[81505]: Python main interpreter initialized at 0x5621311e99c0 Aug 24 04:16:34.610441 dv-cinder-854263-1-smb devstack@keystone.service[81505]: python threads support enabled Aug 24 04:16:34.610441 dv-cinder-854263-1-smb devstack@keystone.service[81505]: your server socket listen backlog is limited to 100 connections Aug 24 04:16:34.610441 dv-cinder-854263-1-smb devstack@keystone.service[81505]: your mercy for graceful operations on workers is 90 seconds Aug 24 04:16:34.610802 dv-cinder-854263-1-smb devstack@keystone.service[81505]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 04:16:34.610886 dv-cinder-854263-1-smb devstack@keystone.service[81505]: *** Operational MODE: preforking *** Aug 24 04:16:34.611121 dv-cinder-854263-1-smb devstack@keystone.service[81505]: *** uWSGI is running in multiple interpreter mode *** Aug 24 04:16:34.611121 dv-cinder-854263-1-smb devstack@keystone.service[81505]: spawned uWSGI master process (pid: 81505) Aug 24 04:16:34.611314 dv-cinder-854263-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 04:16:34.611967 dv-cinder-854263-1-smb devstack@keystone.service[81505]: spawned uWSGI worker 1 (pid: 81516, cores: 1) Aug 24 04:16:34.616708 dv-cinder-854263-1-smb devstack@keystone.service[81505]: spawned uWSGI worker 2 (pid: 81517, cores: 1) Aug 24 04:16:34.616708 dv-cinder-854263-1-smb devstack@keystone.service[81505]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 04:16:38.931830 dv-cinder-854263-1-smb devstack@keystone.service[81516]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:16:38.931830 dv-cinder-854263-1-smb devstack@keystone.service[81516]: from cryptography.utils import int_from_bytes Aug 24 04:16:38.932599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:16:38.932599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: from cryptography.utils import int_from_bytes Aug 24 04:16:38.933645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:16:38.933645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: from cryptography.utils import int_from_bytes Aug 24 04:16:38.934136 dv-cinder-854263-1-smb devstack@keystone.service[81517]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:16:38.934136 dv-cinder-854263-1-smb devstack@keystone.service[81517]: from cryptography.utils import int_from_bytes Aug 24 04:16:38.983676 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 04:16:38.983870 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 04:16:38.984064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] command line args: [] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 04:16:38.984334 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 04:16:38.984428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 04:16:38.984515 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ================================================================================ {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 04:16:38.984589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 04:16:38.984764 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] command line args: [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 04:16:38.984856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] admin_token = **** {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.985019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] config_dir = [] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.985104 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 04:16:38.985211 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ================================================================================ {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 04:16:38.985290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.985418 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] config_source = [] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.985511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] admin_token = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.985593 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] debug = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.985708 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] config_dir = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.985793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.986055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.986055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] config_source = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.986256 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.986359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] debug = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.986456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.986567 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.986693 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.986798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.986895 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.987003 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.987365 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] list_limit = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.987474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.987577 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] log_config_append = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.987691 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.987794 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.987794 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] log_dir = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.987985 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] list_limit = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.988065 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] log_file = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.988745 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] log_config_append = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.988745 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.988945 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.989020 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] log_dir = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.989127 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.989206 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] log_file = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.989303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.989428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.989428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.989563 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.989563 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.989703 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.989775 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.989903 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.989981 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.990104 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.990104 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.990284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.990373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.990457 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.990535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.990659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.990734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.990857 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.990941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.991015 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.991180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.991300 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.991422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.991513 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.991677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.991757 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.991928 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.992167 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.96/identity {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.992288 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.992416 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] publish_errors = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.992571 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.992707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.96/identity {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.992838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.992952 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] publish_errors = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.993074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.993188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.993326 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.993442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.993568 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.993702 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.993876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] standard_threads = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.994022 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.994147 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.994269 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.994390 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.994505 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] standard_threads = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.994619 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.994740 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.994928 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] use_journal = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.994928 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] use_json = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.995150 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.995264 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] use_stderr = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.995384 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.995543 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] use_syslog = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.995670 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] use_journal = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.995793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.995908 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] use_json = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.995908 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] use_stderr = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.996131 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.996248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] use_syslog = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.996374 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.996495 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:16:38.996610 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.996738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.996866 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.996983 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.997106 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.997222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.997336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.997456 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.997571 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.997691 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.997818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.997935 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.998057 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.998172 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.998286 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.998400 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.998528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.998644 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.998759 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.998862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.998975 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.999090 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.999212 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.999327 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.999441 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.999630 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.999781 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:38.999905 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.000029 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.000152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.000266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.000381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.000494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.000609 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.000827 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.000946 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.001061 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.001175 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.001289 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.001402 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.001528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.001644 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.001757 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.001871 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.001984 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.001984 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.002209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.002329 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.002444 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.002564 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.002678 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.002801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.002916 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.003036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.003157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.003272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.003421 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.003548 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.003663 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.004425 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.004553 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.004668 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.004801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.004930 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.005057 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.005187 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.005369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.005516 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.005668 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.005793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.005909 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.006022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.006022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.006237 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.006358 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.006491 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.006614 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.006728 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.006849 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.006964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.007079 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.007272 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.007390 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.007513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.007627 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.007742 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.007862 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.007984 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.008100 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.008221 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.008335 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.008450 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.008565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.008565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.008842 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.008957 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.009070 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.009183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.009286 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.009402 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.009520 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.009635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.009755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.009870 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.009984 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.010106 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.010221 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.010336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.010455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.010570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.010704 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.010811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.010909 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.011011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.011114 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.011212 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.011319 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.011426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.011523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.011628 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.011748 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.011866 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.011981 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.012106 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.012230 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.012348 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.012474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.012591 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.012716 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.012850 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.012976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.013092 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.013214 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.013336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.013441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.013555 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.013681 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.013799 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.013920 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.014036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.014150 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.014271 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.014384 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.014500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.014615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.014719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.014833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.014947 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.015070 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.015186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.015301 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.015424 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.015540 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.015692 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.015820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.015943 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.016059 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.016174 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.016289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.016404 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.016528 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.016644 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.016784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.016901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.017016 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.017131 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.017258 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.017376 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.017491 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.017614 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.017730 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.017846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.017974 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.018091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.018206 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.018321 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.018435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.018550 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.018739 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.018857 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.018857 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.019073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.019188 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.019303 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.019506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.019641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.019758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.019873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.019995 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.020113 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.020229 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.020353 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.020469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.020589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.020589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.020843 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.020968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.021094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.021210 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.021326 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.021326 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] auth.external = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.021542 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.021656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.021780 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.021902 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.022020 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.022135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.022258 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.022374 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] auth.password = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.022496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.022613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] auth.token = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.022754 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.022881 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.022998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] auth.external = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.023114 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.023238 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.023354 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.023354 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.023583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.023707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.023823 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.023945 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.024061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] auth.password = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.024193 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.024313 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] auth.token = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.024429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] credential.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.024545 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.024667 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.024805 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.024934 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.025057 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.025179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.025297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.025420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.025537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.025662 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.025820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.025939 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.026054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.026169 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.026283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] credential.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.026410 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.026534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.026650 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.026765 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.026765 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.026996 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.027121 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.027238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.027353 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.027469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.027590 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.027706 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.027830 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.027955 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.028071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.028186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.028305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.028421 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] federation.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.028544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.028667 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.028838 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.028954 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.029070 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.029185 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.029185 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.029418 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.029535 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.029651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.029766 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.029882 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.030006 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.030123 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.030239 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.030354 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.030469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.030594 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.030711 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.030827 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.030942 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.031057 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.031172 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.031296 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.031420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.031537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.031653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.031769 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.031892 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.032018 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.032135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.032252 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.032367 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.032483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.032607 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.032828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.032958 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.033076 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.033192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.033309 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.033424 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.033548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.033666 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.033783 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.033899 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.034014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.034131 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.034256 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.034374 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.034539 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.034658 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.034775 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.034890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.035075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.035198 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.035315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.035431 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.035547 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.035662 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.035788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.035946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.036062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.036186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.036309 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.036426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.036549 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.036665 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.036800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.036918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.037034 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.037150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.037278 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.037397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.037513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.037629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.037745 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.037868 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.037994 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.038112 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.038112 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.038331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.038447 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.038562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.038687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.038804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.038921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.039037 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.039152 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.039268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.039393 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.039510 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.039627 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.039743 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.039859 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.039976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.040107 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.040224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.040340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.040456 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.040572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.040762 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.040895 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.041016 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.041132 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.041248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.041363 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.041488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.041605 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.041722 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.041838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.041953 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.042070 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.042195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.042313 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.042429 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.042429 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.042647 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.042647 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.042873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.042991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.043108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.043232 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.043350 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.043466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.043590 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.043707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.043824 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.043939 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.044056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.044173 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.044297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.044414 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.044531 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.044646 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.044778 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.044895 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.045023 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.045141 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.045258 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.045374 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.045490 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.045605 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.045731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.045848 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.045997 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.046116 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.046233 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.046349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.046473 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.046592 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.046708 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.046823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.046823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.047041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.047041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.047269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.047386 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.047501 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.047617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.047733 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.047858 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.047975 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.048092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.048207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.048323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.048439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.048439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.048675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.048813 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.048930 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.049045 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.049161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.049289 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.049408 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.049524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.049640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.049756 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.049871 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.049999 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.050118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.050234 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.050350 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.050466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.051073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.051225 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.051343 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.051460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.051734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.051866 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.051985 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.052112 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.052231 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.052347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.052464 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.052580 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.052750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.052884 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] resource.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.053004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.053120 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.053237 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.053353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.053469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.053596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.053714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.053830 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.053947 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.054063 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.054179 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.054304 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.054422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.054538 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.054656 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.054773 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.054896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.055023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.055141 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.055257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] role.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.055373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.055489 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] role.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.055605 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.055735 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.055853 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.055970 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.056123 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.056240 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.056428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.056549 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.056666 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.056880 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.056999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.057115 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.057245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.057364 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.057480 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.057595 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.057711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] role.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.057828 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.057952 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] role.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.058069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.058185 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.058301 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.058417 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.058532 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.058657 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.058776 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.058776 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.059002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.059002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.059222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.059346 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.059464 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.059579 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.059695 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.059811 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.059928 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.060052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.060175 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.060291 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.060407 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.060522 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.060638 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.060898 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.061026 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.061143 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.061259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.061375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.061491 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.061491 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.061720 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.061837 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.061953 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.062069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.062194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.062312 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.062428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.062543 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.062659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.062774 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.062898 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.063016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.063132 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.063248 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.063363 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.063479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.063604 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.063721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] token.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.063837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.063953 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.064069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.064223 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.064351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.064468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.064584 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.064753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.064872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.064988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.065117 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.065236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.065352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.065467 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.065583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.065698 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.065823 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.065939 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.066055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.066261 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.066885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] token.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.067152 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.067283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.067402 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.067518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.067635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.067751 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.067867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.067992 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.068110 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.068110 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.068330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.068330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.068548 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.068674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.068813 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] database.connection = **** {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.068943 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.069071 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.069189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.069306 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.069671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.069800 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.069918 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.070034 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.070150 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.070270 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.070389 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.070513 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.070631 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.070747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.070864 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.070980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.071096 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.071220 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.071338 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.071455 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.071571 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.connection = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.071695 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.071821 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.071939 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.072055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.072180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.072298 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.072414 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.072531 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.072648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.072782 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.072911 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.073030 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.073146 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.073262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.073377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.073494 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.073619 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81516) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 04:16:39.073738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.073738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.073738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.073738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.073738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.073738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.073738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.073738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.073738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.074686 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:16:39.074686 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 04:16:39.099630 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.099797 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.100025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.102917 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.103158 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.103391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.110973 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.115012 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.141766 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.141995 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.144071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.144308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.195973 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.196286 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.246437 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.246628 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.246715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.246849 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.404326 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.404495 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.404712 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.404838 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.404928 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.405076 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.405160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.405303 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.405401 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.405529 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.405752 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.405972 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.428810 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.429047 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.429202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.429284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.429359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.429495 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.429589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.429721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.429805 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.429939 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.430023 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.430155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.430247 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.430418 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.441765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.442580 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.454989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.455226 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.455318 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.455459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.455542 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.455686 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.455779 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.455912 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.455997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.456122 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.456204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.456334 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81516) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.456419 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.456549 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81517) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:16:39.476399 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.476610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 04:16:39.476744 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.476874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 04:16:39.476998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.477224 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.477308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 04:16:39.477439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 04:16:39.477530 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.477696 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.477809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.477963 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.478354 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.478496 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.478628 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.478761 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.490802 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.491172 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.491259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.491463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.491691 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.491776 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.492024 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.492372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.499005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.499113 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.501900 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.501996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.502188 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.502271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.502473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.502558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.502755 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.502839 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.503041 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.503133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.503305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.503388 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.503578 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.503660 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.504453 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.504588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.504899 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.505032 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.505185 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.505313 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.505465 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.505587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.528426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.528822 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.529901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.530189 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.530273 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.530566 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.534789 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.535184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.535287 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.535479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.535720 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.536023 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.541750 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.542041 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.542397 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.542692 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.546081 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.546378 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.546665 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.546802 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.546948 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.547102 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.547225 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.547395 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.547503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.547686 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.547820 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.547970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.548053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.548254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.548534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.548839 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.565048 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.565333 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.566032 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.566889 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.570116 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.571029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.573333 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.573634 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.574268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.574572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.577807 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.578783 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.580936 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.582490 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.584958 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.585265 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.585555 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.585773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.585857 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.586082 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.586166 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.586378 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.586461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.586677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.586971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.587266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.602126 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.602430 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.602701 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.602975 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.603059 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.603357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.603636 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.603908 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.609783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.610802 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.611283 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.611573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.612327 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.612624 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.614550 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.614841 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.615136 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.615325 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.615432 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.615619 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.615703 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.615921 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.616222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.616510 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.627283 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.627573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.627790 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.627874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.628081 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.628165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.628373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.628458 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.628664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.629306 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.629495 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.629581 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.629916 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.630208 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.645185 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.646222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.648185 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.649275 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.651067 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.652158 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.652501 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.653625 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.654001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.654286 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.654625 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.655100 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.655393 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.655698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.661258 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.662317 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.662705 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.663774 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.665680 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.665980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.666268 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.666556 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.666752 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.667053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.667351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.667638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.674383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.674677 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.674959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.675537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.675860 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.676160 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.681797 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81516) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.682085 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.682367 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.682646 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.682924 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.683045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81517) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:16:39.683206 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.683337 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.683490 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.683623 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.683763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.683904 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.684043 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.684182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.684321 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.684460 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.684602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.684774 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.684894 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.685065 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.685176 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.685352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.685481 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81516) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.685636 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.685915 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.686206 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.686488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.686752 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81517) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:16:39.720465 dv-cinder-854263-1-smb devstack@keystone.service[81516]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5621311e99c0 pid: 81516 (default app) Aug 24 04:16:39.722347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5621311e99c0 pid: 81517 (default app) Aug 24 04:16:39.724126 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2374105-9043-406f-bd78-500f418c99b0 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:39.724415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2374105-9043-406f-bd78-500f418c99b0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:39.724713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2374105-9043-406f-bd78-500f418c99b0 None None] PATH_INFO: `/v3` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:39.728860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1/1] 10.222.0.96 () {50 vars in 791 bytes} [Wed Aug 24 04:16:39 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:16:46.480990 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a7045-eb4b-4fe4-974b-67ffaff714d2 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:46.481497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a7045-eb4b-4fe4-974b-67ffaff714d2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:46.481581 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a7045-eb4b-4fe4-974b-67ffaff714d2 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:46.485864 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1/2] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:16:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:16:46.493250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71248d87-88e4-4732-ac39-48698f5de180 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:46.493929 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71248d87-88e4-4732-ac39-48698f5de180 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:46.494205 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71248d87-88e4-4732-ac39-48698f5de180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:46.568337 dv-cinder-854263-1-smb devstack@keystone.service[81516]: INFO dbcounter [None req-71248d87-88e4-4732-ac39-48698f5de180 None None] Registered counter for database keystone Aug 24 04:16:46.589919 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG oslo_db.sqlalchemy.engines [None req-71248d87-88e4-4732-ac39-48698f5de180 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81516) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:16:46.597397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writer thread running {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:16:46.780745 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG passlib.handlers.bcrypt [None req-71248d87-88e4-4732-ac39-48698f5de180 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81516) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 04:16:46.781093 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG passlib.handlers.bcrypt [None req-71248d87-88e4-4732-ac39-48698f5de180 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81516) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 04:16:46.837503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-71248d87-88e4-4732-ac39-48698f5de180 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:16:46.839176 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-71248d87-88e4-4732-ac39-48698f5de180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:16:46.969890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 2/3] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:16:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 04:16:47.435178 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a7045-eb4b-4fe4-974b-67ffaff714d2 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:47.503957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: INFO dbcounter [None req-a58a7045-eb4b-4fe4-974b-67ffaff714d2 None None] Registered counter for database keystone Aug 24 04:16:47.525774 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG oslo_db.sqlalchemy.engines [None req-a58a7045-eb4b-4fe4-974b-67ffaff714d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:16:47.531907 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writer thread running {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:16:47.654414 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a7045-eb4b-4fe4-974b-67ffaff714d2 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:47.658705 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbb866-e273-42ca-a2bb-98109bb47bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:47.659336 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbb866-e273-42ca-a2bb-98109bb47bcc admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:47.659623 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbb866-e273-42ca-a2bb-98109bb47bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:47.659903 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbb866-e273-42ca-a2bb-98109bb47bcc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:47.668527 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbb866-e273-42ca-a2bb-98109bb47bcc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:47.719753 dv-cinder-854263-1-smb devstack@keystone.service[81517]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0cfbb866-e273-42ca-a2bb-98109bb47bcc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 04:16:47.720040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbb866-e273-42ca-a2bb-98109bb47bcc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:47.729772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 2/4] 10.222.0.96 () {58 vars in 1324 bytes} [Wed Aug 24 04:16:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:16:47.735768 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71248d87-88e4-4732-ac39-48698f5de180 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:47.750431 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71248d87-88e4-4732-ac39-48698f5de180 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:47.754900 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e07ee-7c9f-4808-99e2-0cd954882f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:47.756649 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e07ee-7c9f-4808-99e2-0cd954882f4b admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:47.756976 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e07ee-7c9f-4808-99e2-0cd954882f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:47.757256 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e07ee-7c9f-4808-99e2-0cd954882f4b admin admin] PATH_INFO: `/v3/projects/cc9d6801b4c048408ddddff5c9f8e743` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:47.758853 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e07ee-7c9f-4808-99e2-0cd954882f4b admin admin] RBAC: Authorizing `identity:get_project(project_id=cc9d6801b4c048408ddddff5c9f8e743)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:47.811790 dv-cinder-854263-1-smb devstack@keystone.service[81516]: WARNING keystone.common.rbac_enforcer.enforcer [None req-956e07ee-7c9f-4808-99e2-0cd954882f4b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 04:16:47.812135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e07ee-7c9f-4808-99e2-0cd954882f4b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:47.816814 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 3/5] 10.222.0.96 () {56 vars in 1207 bytes} [Wed Aug 24 04:16:47 2022] GET /identity/v3/projects/cc9d6801b4c048408ddddff5c9f8e743 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:16:49.692593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9807e1-c549-4cc4-ae10-4ff319d72ca0 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:49.693784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9807e1-c549-4cc4-ae10-4ff319d72ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:49.693784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9807e1-c549-4cc4-ae10-4ff319d72ca0 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:49.698161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 3/6] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:16:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:16:49.703779 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83abddd-3518-4a26-b3d9-bd09107b2a0c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:49.704196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83abddd-3518-4a26-b3d9-bd09107b2a0c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:49.704374 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83abddd-3518-4a26-b3d9-bd09107b2a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:49.724487 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-c83abddd-3518-4a26-b3d9-bd09107b2a0c None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:16:49.726048 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c83abddd-3518-4a26-b3d9-bd09107b2a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:16:49.733712 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 4/7] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:16:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 04:16:50.012133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9807e1-c549-4cc4-ae10-4ff319d72ca0 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:50.024451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9807e1-c549-4cc4-ae10-4ff319d72ca0 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:50.028706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4682b-11cf-4427-84c7-e83e988fe21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:50.029324 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4682b-11cf-4427-84c7-e83e988fe21b admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:50.029611 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4682b-11cf-4427-84c7-e83e988fe21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:50.029889 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4682b-11cf-4427-84c7-e83e988fe21b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:50.037748 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4682b-11cf-4427-84c7-e83e988fe21b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:50.039551 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4682b-11cf-4427-84c7-e83e988fe21b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:50.048356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 4/8] 10.222.0.96 () {58 vars in 1324 bytes} [Wed Aug 24 04:16:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:16:50.054206 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83abddd-3518-4a26-b3d9-bd09107b2a0c None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:50.063248 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83abddd-3518-4a26-b3d9-bd09107b2a0c None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:50.067617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acedf2a-448d-4a1a-b7e1-3111908b7d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:50.068992 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acedf2a-448d-4a1a-b7e1-3111908b7d25 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:50.069281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acedf2a-448d-4a1a-b7e1-3111908b7d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:50.069559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acedf2a-448d-4a1a-b7e1-3111908b7d25 admin admin] PATH_INFO: `/v3/users/8e583097bf7c4097a82fd7d436d1c78d` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:50.071144 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acedf2a-448d-4a1a-b7e1-3111908b7d25 admin admin] RBAC: Authorizing `identity:get_user(user_id=8e583097bf7c4097a82fd7d436d1c78d)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:50.073011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acedf2a-448d-4a1a-b7e1-3111908b7d25 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:50.074555 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 5/9] 10.222.0.96 () {56 vars in 1198 bytes} [Wed Aug 24 04:16:50 2022] GET /identity/v3/users/8e583097bf7c4097a82fd7d436d1c78d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:16:52.065948 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1dee2-3fc7-4993-9790-8201eaf5cce3 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:52.066486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1dee2-3fc7-4993-9790-8201eaf5cce3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:52.066486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1dee2-3fc7-4993-9790-8201eaf5cce3 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:52.067939 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 5/10] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:16:52.072234 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d895291-28df-43b0-b973-1b9fb08cbe52 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:52.072649 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d895291-28df-43b0-b973-1b9fb08cbe52 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:52.072845 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d895291-28df-43b0-b973-1b9fb08cbe52 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:52.073170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cc0d3-b42c-4cce-9c09-6aa8f88753c4 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:52.073463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cc0d3-b42c-4cce-9c09-6aa8f88753c4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:52.073749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991cc0d3-b42c-4cce-9c09-6aa8f88753c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:52.074177 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 6/11] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:16:52.079070 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987afcd-f6fe-43cf-bc66-a3c89082d625 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:52.079361 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987afcd-f6fe-43cf-bc66-a3c89082d625 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:52.079647 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987afcd-f6fe-43cf-bc66-a3c89082d625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:52.097724 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-2987afcd-f6fe-43cf-bc66-a3c89082d625 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:16:52.098840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2987afcd-f6fe-43cf-bc66-a3c89082d625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:16:52.117076 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG passlib.handlers.bcrypt [None req-991cc0d3-b42c-4cce-9c09-6aa8f88753c4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81517) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 04:16:52.117774 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG passlib.handlers.bcrypt [None req-991cc0d3-b42c-4cce-9c09-6aa8f88753c4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81517) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 04:16:52.163687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-991cc0d3-b42c-4cce-9c09-6aa8f88753c4 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:16:52.165360 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-991cc0d3-b42c-4cce-9c09-6aa8f88753c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:16:52.180278 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 7/12] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:16:52.265566 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 6/13] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:16:52.448883 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987afcd-f6fe-43cf-bc66-a3c89082d625 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:52.473048 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:52.535823 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cc0d3-b42c-4cce-9c09-6aa8f88753c4 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:52.556507 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987afcd-f6fe-43cf-bc66-a3c89082d625 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:52.592302 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6207a8f-b302-4016-93fc-86af4400671e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:52.592980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6207a8f-b302-4016-93fc-86af4400671e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:52.593275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6207a8f-b302-4016-93fc-86af4400671e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:52.593547 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6207a8f-b302-4016-93fc-86af4400671e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:52.605676 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6207a8f-b302-4016-93fc-86af4400671e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:16:52.614179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-b6207a8f-b302-4016-93fc-86af4400671e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:16:52.614179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:16:52.614179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:16:52.614179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:16:52.614179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:16:52.614179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:16:52.614179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:16:52.614179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:16:52.614179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:16:52.614179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:16:52.614179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:16:52.614179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:16:52.614179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:16:52.614179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:16:52.614179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:16:52.614179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:16:52.615463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:16:52.615463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:16:52.615463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:16:52.615463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:16:52.615463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:16:52.615463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:16:52.615463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:16:52.615463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:16:52.615463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:16:52.615463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:16:52.615463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:16:52.615463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:16:52.615463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:16:52.615463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:16:52.615463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:16:52.615463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:16:52.616322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:16:52.616322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:16:52.616322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:16:52.616322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:16:52.616322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:16:52.616322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:16:52.616322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:16:52.616322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:16:52.616322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:16:52.616322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:16:52.616322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:16:52.616322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:16:52.616322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 8/14] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:16:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:16:52.621207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6207a8f-b302-4016-93fc-86af4400671e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:52.648786 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991cc0d3-b42c-4cce-9c09-6aa8f88753c4 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:52.651394 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:52.686996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaecd4c-2bff-43c4-8fc8-746eae080c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:52.687869 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaecd4c-2bff-43c4-8fc8-746eae080c13 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:52.688155 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaecd4c-2bff-43c4-8fc8-746eae080c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:52.688431 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaecd4c-2bff-43c4-8fc8-746eae080c13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:52.705791 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:52.724317 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6207a8f-b302-4016-93fc-86af4400671e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:52.757470 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0797f3-1bda-4f25-a769-ee631723c44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:52.758078 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0797f3-1bda-4f25-a769-ee631723c44e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:52.758362 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0797f3-1bda-4f25-a769-ee631723c44e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:52.758475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaecd4c-2bff-43c4-8fc8-746eae080c13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:52.758637 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0797f3-1bda-4f25-a769-ee631723c44e None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:52.759305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0797f3-1bda-4f25-a769-ee631723c44e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:16:52.759613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0797f3-1bda-4f25-a769-ee631723c44e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:52.760010 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaecd4c-2bff-43c4-8fc8-746eae080c13 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:52.761025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0797f3-1bda-4f25-a769-ee631723c44e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:52.773301 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 9/15] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:16:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:16:52.778807 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0797f3-1bda-4f25-a769-ee631723c44e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:52.858939 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 7/16] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:16:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:16:52.864500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaecd4c-2bff-43c4-8fc8-746eae080c13 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:52.868185 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:52.880306 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0797f3-1bda-4f25-a769-ee631723c44e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:52.914728 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e24e74-6b27-4e4d-9c79-0f4553bb192e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:52.915372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e24e74-6b27-4e4d-9c79-0f4553bb192e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:52.915656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e24e74-6b27-4e4d-9c79-0f4553bb192e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:52.915936 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e24e74-6b27-4e4d-9c79-0f4553bb192e None admin] PATH_INFO: `/v3/users/8e583097bf7c4097a82fd7d436d1c78d` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:52.917122 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e24e74-6b27-4e4d-9c79-0f4553bb192e None admin] RBAC: Authorizing `identity:get_user(user_id=8e583097bf7c4097a82fd7d436d1c78d)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:52.918584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e24e74-6b27-4e4d-9c79-0f4553bb192e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:52.920325 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 10/17] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:16:52 2022] GET /identity/v3/users/8e583097bf7c4097a82fd7d436d1c78d => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:16:52.925620 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e24e74-6b27-4e4d-9c79-0f4553bb192e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:52.940383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:52.967952 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaecd4c-2bff-43c4-8fc8-746eae080c13 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:53.001452 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e616a-cbc4-42bc-9aa2-42999acb8413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:53.002301 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e616a-cbc4-42bc-9aa2-42999acb8413 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:53.002587 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e616a-cbc4-42bc-9aa2-42999acb8413 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:53.002866 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e616a-cbc4-42bc-9aa2-42999acb8413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:53.022127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e616a-cbc4-42bc-9aa2-42999acb8413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:53.023608 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e616a-cbc4-42bc-9aa2-42999acb8413 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:53.029925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e24e74-6b27-4e4d-9c79-0f4553bb192e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:53.042229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-199e616a-cbc4-42bc-9aa2-42999acb8413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:16:53.042229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:16:53.042229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:16:53.042229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:16:53.042229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:16:53.042229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:16:53.042229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:16:53.042229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:16:53.042229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:16:53.042229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:16:53.042229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:16:53.042229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:16:53.042229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:16:53.042229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:16:53.042229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:16:53.042229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:16:53.043101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:16:53.043101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:16:53.043101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:16:53.043101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:16:53.043101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:16:53.043101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:16:53.043101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:16:53.043101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:16:53.043101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:16:53.043101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:16:53.043101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:16:53.043101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:16:53.043101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:16:53.043101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:16:53.043101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:16:53.043101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:16:53.043101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:16:53.043923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:16:53.043923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:16:53.043923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:16:53.043923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 8/18] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:16:53.049068 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e616a-cbc4-42bc-9aa2-42999acb8413 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:53.064250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc102f3-a5b7-40bd-b89c-00ad91cda2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:53.064922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc102f3-a5b7-40bd-b89c-00ad91cda2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:53.065211 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc102f3-a5b7-40bd-b89c-00ad91cda2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:53.065488 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc102f3-a5b7-40bd-b89c-00ad91cda2f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:53.066631 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc102f3-a5b7-40bd-b89c-00ad91cda2f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:53.068785 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc102f3-a5b7-40bd-b89c-00ad91cda2f5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:53.070599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 11/19] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:16:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:16:53.076318 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc102f3-a5b7-40bd-b89c-00ad91cda2f5 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:53.107870 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:53.152499 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e616a-cbc4-42bc-9aa2-42999acb8413 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:53.157039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:53.176785 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc102f3-a5b7-40bd-b89c-00ad91cda2f5 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:53.186037 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394998a8-eb4f-4941-8c3d-021947c4bb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:53.186657 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394998a8-eb4f-4941-8c3d-021947c4bb8f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:53.186941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394998a8-eb4f-4941-8c3d-021947c4bb8f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:53.187217 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394998a8-eb4f-4941-8c3d-021947c4bb8f None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:53.187866 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394998a8-eb4f-4941-8c3d-021947c4bb8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:16:53.188174 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394998a8-eb4f-4941-8c3d-021947c4bb8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:53.189605 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394998a8-eb4f-4941-8c3d-021947c4bb8f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:53.207716 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 9/20] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:16:53.213179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b0f69-dc74-4947-a9c3-e893a50e1c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:53.213821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b0f69-dc74-4947-a9c3-e893a50e1c02 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:53.214109 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b0f69-dc74-4947-a9c3-e893a50e1c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:53.214389 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b0f69-dc74-4947-a9c3-e893a50e1c02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:53.215147 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b0f69-dc74-4947-a9c3-e893a50e1c02 None admin] RBAC: Adding query filter params (role.id=059d2bf5bb8e42939f5f826bfdad6a21, scope.domain.id=default, user.id=8e583097bf7c4097a82fd7d436d1c78d) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:16:53.215463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b0f69-dc74-4947-a9c3-e893a50e1c02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:53.217005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b0f69-dc74-4947-a9c3-e893a50e1c02 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:53.225679 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 12/21] 10.222.0.96 () {56 vars in 1322 bytes} [Wed Aug 24 04:16:53 2022] GET /identity/v3/role_assignments?user.id=8e583097bf7c4097a82fd7d436d1c78d&scope.domain.id=default&role.id=059d2bf5bb8e42939f5f826bfdad6a21 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:16:55.275069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4d5cd-82ae-4eab-9175-ba626325226b None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:55.275557 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4d5cd-82ae-4eab-9175-ba626325226b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:55.275557 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4d5cd-82ae-4eab-9175-ba626325226b None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:55.277059 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 10/22] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:16:55.282463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573689d-06b9-4328-a52f-f1cc55447415 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:55.282851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573689d-06b9-4328-a52f-f1cc55447415 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:55.283015 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573689d-06b9-4328-a52f-f1cc55447415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:55.314078 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e573689d-06b9-4328-a52f-f1cc55447415 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:16:55.315289 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e573689d-06b9-4328-a52f-f1cc55447415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:16:55.400400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 13/23] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:16:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:16:55.664002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866f898-71ed-4fbb-8f96-2dea4bc830d5 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:55.664323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866f898-71ed-4fbb-8f96-2dea4bc830d5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:55.664560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866f898-71ed-4fbb-8f96-2dea4bc830d5 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:55.665934 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 11/24] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:16:55.671166 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd70460-0a62-44e7-bb8a-c0c5f6f275cb None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:55.671459 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd70460-0a62-44e7-bb8a-c0c5f6f275cb None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:55.671735 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd70460-0a62-44e7-bb8a-c0c5f6f275cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:55.697739 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4cd70460-0a62-44e7-bb8a-c0c5f6f275cb None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:16:55.699038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4cd70460-0a62-44e7-bb8a-c0c5f6f275cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:16:55.712130 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e10a5-73d3-413e-9d74-67d7a6f99873 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:55.712411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e10a5-73d3-413e-9d74-67d7a6f99873 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:55.712718 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e10a5-73d3-413e-9d74-67d7a6f99873 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:55.714328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 12/25] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:16:55.720560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb464e-5257-4d32-92df-d70c533105b5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:55.720883 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb464e-5257-4d32-92df-d70c533105b5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:55.721165 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb464e-5257-4d32-92df-d70c533105b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:55.743811 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-26eb464e-5257-4d32-92df-d70c533105b5 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:16:55.745057 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-26eb464e-5257-4d32-92df-d70c533105b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:16:55.826894 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 13/26] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:16:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:16:55.827073 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 14/27] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:16:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:16:55.955310 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb464e-5257-4d32-92df-d70c533105b5 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:56.016740 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:56.074388 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb464e-5257-4d32-92df-d70c533105b5 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:56.109452 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5c8da-a8ea-4d76-8b20-0482ab5f22ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:56.110105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5c8da-a8ea-4d76-8b20-0482ab5f22ef None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:56.110389 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5c8da-a8ea-4d76-8b20-0482ab5f22ef None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:56.110669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5c8da-a8ea-4d76-8b20-0482ab5f22ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:56.122973 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5c8da-a8ea-4d76-8b20-0482ab5f22ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:16:56.129412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-b7f5c8da-a8ea-4d76-8b20-0482ab5f22ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:16:56.129412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:16:56.129412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:16:56.129412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:16:56.129412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:16:56.129412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:16:56.129412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:16:56.129412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:16:56.129412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:16:56.129412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:16:56.129412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:16:56.129412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:16:56.129412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:16:56.129412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:16:56.129412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:16:56.129412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:16:56.130819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:16:56.130819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:16:56.130819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:16:56.130819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:16:56.130819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:16:56.130819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:16:56.130819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:16:56.130819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:16:56.130819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:16:56.130819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:16:56.130819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:16:56.130819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:16:56.130819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:16:56.130819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:16:56.130819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:16:56.130819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:16:56.131791 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:16:56.131791 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:16:56.131791 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:16:56.131791 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:16:56.131791 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:16:56.131791 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:16:56.131791 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:16:56.131791 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:16:56.131791 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:16:56.131791 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:16:56.131791 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:16:56.131791 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:16:56.131791 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 14/28] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:16:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:16:56.137187 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd70460-0a62-44e7-bb8a-c0c5f6f275cb None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:56.144071 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:56.257822 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66223ae-49f1-4c76-9112-9a67900f72ec None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:56.258061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66223ae-49f1-4c76-9112-9a67900f72ec None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:56.258300 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66223ae-49f1-4c76-9112-9a67900f72ec None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:56.259783 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 15/29] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:16:56.271795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e3212-ae2c-44eb-b625-026f64820f37 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:56.272085 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e3212-ae2c-44eb-b625-026f64820f37 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:56.272365 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e3212-ae2c-44eb-b625-026f64820f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:56.306841 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd70460-0a62-44e7-bb8a-c0c5f6f275cb None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:56.311214 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6d5e3212-ae2c-44eb-b625-026f64820f37 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:16:56.312884 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6d5e3212-ae2c-44eb-b625-026f64820f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:16:56.346870 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d5c7f-9726-4b75-ab20-39bfc97a7594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:56.347809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d5c7f-9726-4b75-ab20-39bfc97a7594 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:56.348365 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d5c7f-9726-4b75-ab20-39bfc97a7594 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:56.348653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d5c7f-9726-4b75-ab20-39bfc97a7594 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:56.350239 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d5c7f-9726-4b75-ab20-39bfc97a7594 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:16:56.350554 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d5c7f-9726-4b75-ab20-39bfc97a7594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:56.352509 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d5c7f-9726-4b75-ab20-39bfc97a7594 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:56.364362 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 15/30] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:16:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:16:56.366026 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d5c7f-9726-4b75-ab20-39bfc97a7594 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:56.399125 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 16/31] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:16:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 24 04:16:56.400258 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e3212-ae2c-44eb-b625-026f64820f37 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:56.447601 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:56.460090 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:56.510415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d5c7f-9726-4b75-ab20-39bfc97a7594 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:56.533910 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e3212-ae2c-44eb-b625-026f64820f37 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:56.571082 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0499de-8430-4df9-96f5-2f6bce2e1cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:56.571719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0499de-8430-4df9-96f5-2f6bce2e1cbd None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:56.572005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0499de-8430-4df9-96f5-2f6bce2e1cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:56.572285 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0499de-8430-4df9-96f5-2f6bce2e1cbd None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:56.572998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0499de-8430-4df9-96f5-2f6bce2e1cbd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:56.574410 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0499de-8430-4df9-96f5-2f6bce2e1cbd None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:56.595340 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464d509-ab95-48a6-a8e4-3aaecf333e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:56.595978 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464d509-ab95-48a6-a8e4-3aaecf333e3c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:56.596269 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464d509-ab95-48a6-a8e4-3aaecf333e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:56.596548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464d509-ab95-48a6-a8e4-3aaecf333e3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:56.624874 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464d509-ab95-48a6-a8e4-3aaecf333e3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:56.626360 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464d509-ab95-48a6-a8e4-3aaecf333e3c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:56.658228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-5464d509-ab95-48a6-a8e4-3aaecf333e3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:16:56.658228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:16:56.658228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:16:56.658228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:16:56.658228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:16:56.658228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:16:56.658228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:16:56.658228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:16:56.658228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:16:56.658228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:16:56.658228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:16:56.658228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:16:56.658228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:16:56.658228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:16:56.658228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:16:56.658228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:16:56.659161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:16:56.659161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:16:56.659161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:16:56.659161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:16:56.659161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:16:56.659161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:16:56.659161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:16:56.659161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:16:56.659161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:16:56.659161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:16:56.659161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:16:56.659161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:16:56.659161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:16:56.659161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:16:56.659161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:16:56.659161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:16:56.659161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:16:56.659955 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:16:56.659955 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:16:56.659955 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:16:56.659955 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 17/32] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:16:56.660651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464d509-ab95-48a6-a8e4-3aaecf333e3c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:56.727419 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 16/33] 10.222.0.96 () {60 vars in 1131 bytes} [Wed Aug 24 04:16:56 2022] POST /identity/v3/roles => generated 219 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:16:56.728237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0499de-8430-4df9-96f5-2f6bce2e1cbd None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:56.882325 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:56.900111 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0499de-8430-4df9-96f5-2f6bce2e1cbd None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:56.926971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464d509-ab95-48a6-a8e4-3aaecf333e3c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:56.933344 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:56.943567 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf73d1-3675-4831-91f1-98d6aa150bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:56.944427 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf73d1-3675-4831-91f1-98d6aa150bcd None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:56.945105 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf73d1-3675-4831-91f1-98d6aa150bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:56.945493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf73d1-3675-4831-91f1-98d6aa150bcd None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:56.946272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf73d1-3675-4831-91f1-98d6aa150bcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:16:56.946690 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf73d1-3675-4831-91f1-98d6aa150bcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:56.949020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf73d1-3675-4831-91f1-98d6aa150bcd None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:56.972597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 17/34] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:16:56.973508 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf73d1-3675-4831-91f1-98d6aa150bcd None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:56.992071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2832c11-474b-4531-b9a6-1cee07b868aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:56.992791 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2832c11-474b-4531-b9a6-1cee07b868aa None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:56.993087 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2832c11-474b-4531-b9a6-1cee07b868aa None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:56.993357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2832c11-474b-4531-b9a6-1cee07b868aa None admin] PATH_INFO: `/v3/users/8e583097bf7c4097a82fd7d436d1c78d` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:56.994899 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2832c11-474b-4531-b9a6-1cee07b868aa None admin] RBAC: Authorizing `identity:get_user(user_id=8e583097bf7c4097a82fd7d436d1c78d)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:56.996382 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2832c11-474b-4531-b9a6-1cee07b868aa None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:56.998832 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 18/35] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:16:56 2022] GET /identity/v3/users/8e583097bf7c4097a82fd7d436d1c78d => generated 247 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:16:56.999610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2832c11-474b-4531-b9a6-1cee07b868aa None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:57.103097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf73d1-3675-4831-91f1-98d6aa150bcd None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:57.134704 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2832c11-474b-4531-b9a6-1cee07b868aa None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:57.140922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630d81c-2fe4-4ab3-898d-43dbc7929866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:57.141550 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630d81c-2fe4-4ab3-898d-43dbc7929866 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:57.141882 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630d81c-2fe4-4ab3-898d-43dbc7929866 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:57.142112 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630d81c-2fe4-4ab3-898d-43dbc7929866 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:57.142793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630d81c-2fe4-4ab3-898d-43dbc7929866 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:57.144217 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630d81c-2fe4-4ab3-898d-43dbc7929866 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:57.160828 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 18/36] 10.222.0.96 () {60 vars in 1131 bytes} [Wed Aug 24 04:16:56 2022] POST /identity/v3/roles => generated 225 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:16:57.162255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630d81c-2fe4-4ab3-898d-43dbc7929866 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:57.187074 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c3291-47e0-44a6-81d2-2b11010da124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:57.188274 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c3291-47e0-44a6-81d2-2b11010da124 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:57.188833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c3291-47e0-44a6-81d2-2b11010da124 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:57.190084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c3291-47e0-44a6-81d2-2b11010da124 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:57.191343 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c3291-47e0-44a6-81d2-2b11010da124 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:57.193787 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c3291-47e0-44a6-81d2-2b11010da124 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:57.220836 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:57.294488 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630d81c-2fe4-4ab3-898d-43dbc7929866 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:57.336301 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2d1a0-96de-4d2c-86a3-85bf0f5318bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:57.337002 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2d1a0-96de-4d2c-86a3-85bf0f5318bf None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:57.337263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2d1a0-96de-4d2c-86a3-85bf0f5318bf None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:57.337544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2d1a0-96de-4d2c-86a3-85bf0f5318bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:57.338863 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2d1a0-96de-4d2c-86a3-85bf0f5318bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:57.340417 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2d1a0-96de-4d2c-86a3-85bf0f5318bf None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:57.342427 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 19/37] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:16:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:16:57.343350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0dcef-b68b-45bd-9d32-95d43137aa11 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:57.343645 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0dcef-b68b-45bd-9d32-95d43137aa11 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:57.343927 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0dcef-b68b-45bd-9d32-95d43137aa11 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:57.347114 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 20/38] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:16:57.347114 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4aba9a-69e2-45aa-a4ab-7d3a096546d0 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:57.347114 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4aba9a-69e2-45aa-a4ab-7d3a096546d0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:57.347443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4aba9a-69e2-45aa-a4ab-7d3a096546d0 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:57.350332 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 21/39] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:16:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:16:57.350332 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4aba9a-69e2-45aa-a4ab-7d3a096546d0 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:57.354096 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 19/40] 10.222.0.96 () {60 vars in 1141 bytes} [Wed Aug 24 04:16:56 2022] POST /identity/v3/projects => generated 301 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:16:57.355512 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1fabc-b4f7-4aed-aed0-bb58b3e0dee2 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:57.355808 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1fabc-b4f7-4aed-aed0-bb58b3e0dee2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:57.356089 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1fabc-b4f7-4aed-aed0-bb58b3e0dee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:57.382083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6ba1fabc-b4f7-4aed-aed0-bb58b3e0dee2 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:16:57.383932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6ba1fabc-b4f7-4aed-aed0-bb58b3e0dee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:16:57.386581 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:57.471518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 20/41] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:16:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:16:57.473277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc56f33-c503-49a7-95dd-1bd4a5b198ce None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:57.473758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc56f33-c503-49a7-95dd-1bd4a5b198ce None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:57.475011 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc56f33-c503-49a7-95dd-1bd4a5b198ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:57.496161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3bc56f33-c503-49a7-95dd-1bd4a5b198ce None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:16:57.497873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3bc56f33-c503-49a7-95dd-1bd4a5b198ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:16:57.502610 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4aba9a-69e2-45aa-a4ab-7d3a096546d0 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:57.520101 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:57.555785 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a913fe8-577a-4666-9e63-e5c78f270e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:57.557029 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a913fe8-577a-4666-9e63-e5c78f270e7c None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:57.557565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a913fe8-577a-4666-9e63-e5c78f270e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:57.557984 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a913fe8-577a-4666-9e63-e5c78f270e7c None admin] PATH_INFO: `/v3/domains/default/users/8e583097bf7c4097a82fd7d436d1c78d/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:57.562375 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a913fe8-577a-4666-9e63-e5c78f270e7c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8e583097bf7c4097a82fd7d436d1c78d, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:57.563884 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a913fe8-577a-4666-9e63-e5c78f270e7c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:57.586324 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 21/42] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:16:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:16:57.586498 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 22/43] 10.222.0.96 () {58 vars in 1361 bytes} [Wed Aug 24 04:16:57 2022] PUT /identity/v3/domains/default/users/8e583097bf7c4097a82fd7d436d1c78d/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:16:57.750735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc56f33-c503-49a7-95dd-1bd4a5b198ce None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:57.840196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:57.865299 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a913fe8-577a-4666-9e63-e5c78f270e7c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:57.867658 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc56f33-c503-49a7-95dd-1bd4a5b198ce None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:57.907341 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7742b88-f86f-4eae-b7d0-de4fcbb3d34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:57.907976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7742b88-f86f-4eae-b7d0-de4fcbb3d34c None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:57.908257 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7742b88-f86f-4eae-b7d0-de4fcbb3d34c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:57.908540 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7742b88-f86f-4eae-b7d0-de4fcbb3d34c None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:57.909251 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7742b88-f86f-4eae-b7d0-de4fcbb3d34c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:57.910796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7742b88-f86f-4eae-b7d0-de4fcbb3d34c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:57.932872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 22/44] 10.222.0.96 () {60 vars in 1131 bytes} [Wed Aug 24 04:16:57 2022] POST /identity/v3/roles => generated 223 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:16:58.000044 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a913fe8-577a-4666-9e63-e5c78f270e7c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:58.044636 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17480f-7cc0-47c4-9f9b-d623a893bf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:58.045256 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17480f-7cc0-47c4-9f9b-d623a893bf8b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:58.045608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17480f-7cc0-47c4-9f9b-d623a893bf8b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:58.045935 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17480f-7cc0-47c4-9f9b-d623a893bf8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:58.047219 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17480f-7cc0-47c4-9f9b-d623a893bf8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:58.048925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17480f-7cc0-47c4-9f9b-d623a893bf8b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:58.050794 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 23/45] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:16:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:16:58.056802 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7742b88-f86f-4eae-b7d0-de4fcbb3d34c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:58.166365 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7742b88-f86f-4eae-b7d0-de4fcbb3d34c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:58.194018 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:58.203178 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cbe63-e4d8-42fd-ad2f-0adf7e2eb358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:58.203802 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cbe63-e4d8-42fd-ad2f-0adf7e2eb358 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:58.204092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cbe63-e4d8-42fd-ad2f-0adf7e2eb358 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:58.204377 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cbe63-e4d8-42fd-ad2f-0adf7e2eb358 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:58.205085 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cbe63-e4d8-42fd-ad2f-0adf7e2eb358 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:58.206550 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cbe63-e4d8-42fd-ad2f-0adf7e2eb358 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:58.233530 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 23/46] 10.222.0.96 () {60 vars in 1141 bytes} [Wed Aug 24 04:16:58 2022] POST /identity/v3/projects => generated 312 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:16:59.508438 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b34b5-afce-4df9-b68d-915c609a580e None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:59.509008 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b34b5-afce-4df9-b68d-915c609a580e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:59.509091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b34b5-afce-4df9-b68d-915c609a580e None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:59.510378 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 24/47] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:16:59.515522 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c211045-33c5-4a13-9ed5-c0431399a08b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:59.515946 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c211045-33c5-4a13-9ed5-c0431399a08b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:59.516089 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c211045-33c5-4a13-9ed5-c0431399a08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:59.534386 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2c211045-33c5-4a13-9ed5-c0431399a08b None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:16:59.535592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2c211045-33c5-4a13-9ed5-c0431399a08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:16:59.604095 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 24/48] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:16:59.875195 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b34b5-afce-4df9-b68d-915c609a580e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:59.926695 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:00.105138 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b34b5-afce-4df9-b68d-915c609a580e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:00.139286 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7567402-7396-415c-911e-7d0087bba97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:00.139928 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7567402-7396-415c-911e-7d0087bba97f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:00.140219 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7567402-7396-415c-911e-7d0087bba97f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:00.140502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7567402-7396-415c-911e-7d0087bba97f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:00.142982 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c67212-a27f-421e-92c7-fb7bc90c07e8 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:00.143275 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c67212-a27f-421e-92c7-fb7bc90c07e8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:00.143555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c67212-a27f-421e-92c7-fb7bc90c07e8 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:00.144960 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 25/49] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:17:00.150041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e70a7-f26c-45d8-986a-9db8ebc9f189 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:00.150325 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e70a7-f26c-45d8-986a-9db8ebc9f189 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:00.150605 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e70a7-f26c-45d8-986a-9db8ebc9f189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:00.151319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7567402-7396-415c-911e-7d0087bba97f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:00.156207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-c7567402-7396-415c-911e-7d0087bba97f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:17:00.156207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:00.156207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:00.156207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:00.156207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:00.156207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:00.156207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:00.156207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:00.156207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:00.156207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:00.156207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:00.156207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:00.156207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:00.156207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:00.156207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:00.156207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:00.157272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:00.157272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:00.157272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:00.157272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:00.157272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:00.157272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:00.157272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:00.157272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:00.157272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:00.157272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:00.157272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:00.157272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:00.157272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:00.157272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:00.157272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:00.157272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:00.158011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:00.158011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:00.158011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:00.158011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:00.158011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:00.158011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:00.158011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:00.158011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:00.158011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:00.158011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:00.158011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:17:00.158011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:00.158011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 25/50] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:16:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:00.164112 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7567402-7396-415c-911e-7d0087bba97f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:00.169652 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-dd9e70a7-f26c-45d8-986a-9db8ebc9f189 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:00.170865 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-dd9e70a7-f26c-45d8-986a-9db8ebc9f189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:00.241945 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 26/51] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:17:00.268816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7567402-7396-415c-911e-7d0087bba97f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:00.270338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:00.303995 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5df877-9fed-44e6-a0ff-81a9b80a7d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:00.304595 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5df877-9fed-44e6-a0ff-81a9b80a7d69 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:00.304974 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5df877-9fed-44e6-a0ff-81a9b80a7d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:00.305253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5df877-9fed-44e6-a0ff-81a9b80a7d69 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:00.305921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5df877-9fed-44e6-a0ff-81a9b80a7d69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:00.306239 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5df877-9fed-44e6-a0ff-81a9b80a7d69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:00.307609 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5df877-9fed-44e6-a0ff-81a9b80a7d69 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:00.315502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 26/52] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:00.321364 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e70a7-f26c-45d8-986a-9db8ebc9f189 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:00.361814 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:00.418267 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e70a7-f26c-45d8-986a-9db8ebc9f189 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:00.450755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b8e58-f5b8-447a-b3f4-190f19db4e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:00.451386 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b8e58-f5b8-447a-b3f4-190f19db4e1f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:00.451667 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b8e58-f5b8-447a-b3f4-190f19db4e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:00.451944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b8e58-f5b8-447a-b3f4-190f19db4e1f None admin] PATH_INFO: `/v3/users/8e583097bf7c4097a82fd7d436d1c78d` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:00.453078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b8e58-f5b8-447a-b3f4-190f19db4e1f None admin] RBAC: Authorizing `identity:get_user(user_id=8e583097bf7c4097a82fd7d436d1c78d)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:00.454512 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b8e58-f5b8-447a-b3f4-190f19db4e1f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:00.456066 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 27/53] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:00 2022] GET /identity/v3/users/8e583097bf7c4097a82fd7d436d1c78d => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:00.462240 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5df877-9fed-44e6-a0ff-81a9b80a7d69 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:00.515434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b8e58-f5b8-447a-b3f4-190f19db4e1f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:00.570185 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5df877-9fed-44e6-a0ff-81a9b80a7d69 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:00.609485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84f5f4-5a79-45cb-a7d9-d102ab282fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:00.610389 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84f5f4-5a79-45cb-a7d9-d102ab282fed None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:00.610692 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84f5f4-5a79-45cb-a7d9-d102ab282fed None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:00.610971 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84f5f4-5a79-45cb-a7d9-d102ab282fed None admin] PATH_INFO: `/v3/domains/default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:00.612277 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84f5f4-5a79-45cb-a7d9-d102ab282fed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:00.613973 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84f5f4-5a79-45cb-a7d9-d102ab282fed None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:00.616091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 27/54] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:17:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:00.621929 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84f5f4-5a79-45cb-a7d9-d102ab282fed None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:00.623736 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b8e58-f5b8-447a-b3f4-190f19db4e1f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:00.633611 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:00.655136 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:00.661238 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f87fc-eae3-43d6-bfaa-aa7c97760a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:00.662455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f87fc-eae3-43d6-bfaa-aa7c97760a80 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:00.662747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f87fc-eae3-43d6-bfaa-aa7c97760a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:00.663031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f87fc-eae3-43d6-bfaa-aa7c97760a80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:00.664169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f87fc-eae3-43d6-bfaa-aa7c97760a80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:00.665652 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f87fc-eae3-43d6-bfaa-aa7c97760a80 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:00.667413 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 28/55] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:17:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:00.672823 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f87fc-eae3-43d6-bfaa-aa7c97760a80 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:00.727454 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84f5f4-5a79-45cb-a7d9-d102ab282fed None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:00.762904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791894c-8758-4060-b402-e3c9a7c63b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:00.763514 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791894c-8758-4060-b402-e3c9a7c63b99 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:00.763805 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791894c-8758-4060-b402-e3c9a7c63b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:00.764086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791894c-8758-4060-b402-e3c9a7c63b99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:00.764857 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791894c-8758-4060-b402-e3c9a7c63b99 None admin] RBAC: Adding query filter params (role.id=059d2bf5bb8e42939f5f826bfdad6a21, scope.domain.id=default, user.id=8e583097bf7c4097a82fd7d436d1c78d) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:00.765181 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791894c-8758-4060-b402-e3c9a7c63b99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:00.766647 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791894c-8758-4060-b402-e3c9a7c63b99 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:00.772988 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f87fc-eae3-43d6-bfaa-aa7c97760a80 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:00.773177 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 28/56] 10.222.0.96 () {56 vars in 1322 bytes} [Wed Aug 24 04:17:00 2022] GET /identity/v3/role_assignments?user.id=8e583097bf7c4097a82fd7d436d1c78d&scope.domain.id=default&role.id=059d2bf5bb8e42939f5f826bfdad6a21 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:00.818688 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099680a-be52-4ac4-85fe-b22d3de95c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:00.819561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099680a-be52-4ac4-85fe-b22d3de95c77 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:00.820110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099680a-be52-4ac4-85fe-b22d3de95c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:00.820388 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099680a-be52-4ac4-85fe-b22d3de95c77 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:00.821101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099680a-be52-4ac4-85fe-b22d3de95c77 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:00.822627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099680a-be52-4ac4-85fe-b22d3de95c77 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:00.856391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 29/57] 10.222.0.96 () {60 vars in 1140 bytes} [Wed Aug 24 04:17:00 2022] POST /identity/v3/projects => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:17:02.813471 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0a452-d35c-4ff2-8853-a0b498f7b514 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:02.813985 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0a452-d35c-4ff2-8853-a0b498f7b514 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:02.814072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0a452-d35c-4ff2-8853-a0b498f7b514 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:02.815385 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 29/58] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:02.821377 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db508b76-afe8-4718-a4ce-e8173a73f279 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:02.821747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db508b76-afe8-4718-a4ce-e8173a73f279 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:02.821939 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db508b76-afe8-4718-a4ce-e8173a73f279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:02.839817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-db508b76-afe8-4718-a4ce-e8173a73f279 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:02.841037 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-db508b76-afe8-4718-a4ce-e8173a73f279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:02.862930 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:02.907938 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 30/59] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:03.176323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0a452-d35c-4ff2-8853-a0b498f7b514 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:03.275751 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:03.282551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0a452-d35c-4ff2-8853-a0b498f7b514 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:03.315758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abababb-6e8e-4718-b8ae-b54f5e3cfc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:03.316387 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abababb-6e8e-4718-b8ae-b54f5e3cfc11 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:03.316676 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abababb-6e8e-4718-b8ae-b54f5e3cfc11 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:03.316988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abababb-6e8e-4718-b8ae-b54f5e3cfc11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:03.318133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abababb-6e8e-4718-b8ae-b54f5e3cfc11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:03.319608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abababb-6e8e-4718-b8ae-b54f5e3cfc11 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:03.321465 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 30/60] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:17:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:03.327105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db508b76-afe8-4718-a4ce-e8173a73f279 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:03.423521 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db508b76-afe8-4718-a4ce-e8173a73f279 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:03.561714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c97ebf-7405-4fc0-bb39-32872c8c4d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:03.562240 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c97ebf-7405-4fc0-bb39-32872c8c4d54 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:03.562523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c97ebf-7405-4fc0-bb39-32872c8c4d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:03.562799 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c97ebf-7405-4fc0-bb39-32872c8c4d54 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:03.563447 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c97ebf-7405-4fc0-bb39-32872c8c4d54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:03.564914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c97ebf-7405-4fc0-bb39-32872c8c4d54 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:03.591818 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 31/61] 10.222.0.96 () {60 vars in 1132 bytes} [Wed Aug 24 04:17:03 2022] POST /identity/v3/users => generated 275 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:17:06.683942 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be758bb9-a42b-4e05-aebe-463d2f6357b8 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:06.685045 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be758bb9-a42b-4e05-aebe-463d2f6357b8 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:06.685539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be758bb9-a42b-4e05-aebe-463d2f6357b8 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:06.687126 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 31/62] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:06.693241 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360ca2d-d779-4066-8fa9-463c127212c8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:06.694118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360ca2d-d779-4066-8fa9-463c127212c8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:06.694616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360ca2d-d779-4066-8fa9-463c127212c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:06.714204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-7360ca2d-d779-4066-8fa9-463c127212c8 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:06.715731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7360ca2d-d779-4066-8fa9-463c127212c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:06.726114 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:06.790872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 32/63] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:06.939072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8bb02-4524-4a6f-9cdf-51d4a8441f8c None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:06.939363 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8bb02-4524-4a6f-9cdf-51d4a8441f8c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:06.939567 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8bb02-4524-4a6f-9cdf-51d4a8441f8c None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:06.940972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 32/64] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:06.945493 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db623a2-9596-4c5a-8652-ee196335ec76 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:06.945790 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db623a2-9596-4c5a-8652-ee196335ec76 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:06.946969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68283d30-4b5f-43b1-b9f3-fe637a4d2ed7 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:06.947489 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68283d30-4b5f-43b1-b9f3-fe637a4d2ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:06.948005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68283d30-4b5f-43b1-b9f3-fe637a4d2ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:06.954914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db623a2-9596-4c5a-8652-ee196335ec76 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:06.958682 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 33/65] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:06 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:06.965746 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc735558-7146-4c79-b274-7069c4b1b747 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:06.966270 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc735558-7146-4c79-b274-7069c4b1b747 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:06.966749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc735558-7146-4c79-b274-7069c4b1b747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:06.977780 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-68283d30-4b5f-43b1-b9f3-fe637a4d2ed7 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:06.988357 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-68283d30-4b5f-43b1-b9f3-fe637a4d2ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:07.003273 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-cc735558-7146-4c79-b274-7069c4b1b747 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:07.004870 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cc735558-7146-4c79-b274-7069c4b1b747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:07.110169 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 33/66] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:17:07.111074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68283d30-4b5f-43b1-b9f3-fe637a4d2ed7 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:07.112738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 34/67] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:07.114160 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44cd09-4b6f-48ac-8f39-0923aa7d6637 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:07.114752 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44cd09-4b6f-48ac-8f39-0923aa7d6637 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:07.114856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44cd09-4b6f-48ac-8f39-0923aa7d6637 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:07.116141 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 35/68] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:07.124735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c9be2-9f9e-44d2-ab17-91feff1d65c5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:07.124735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c9be2-9f9e-44d2-ab17-91feff1d65c5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:07.124735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c9be2-9f9e-44d2-ab17-91feff1d65c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:07.143790 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-153c9be2-9f9e-44d2-ab17-91feff1d65c5 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:07.145027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-153c9be2-9f9e-44d2-ab17-91feff1d65c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:07.226576 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 36/69] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:07.269092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff728b8-e8e0-4bd6-87db-eaf7f31f27fb None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:07.270094 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff728b8-e8e0-4bd6-87db-eaf7f31f27fb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:07.270578 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff728b8-e8e0-4bd6-87db-eaf7f31f27fb None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:07.273682 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 37/70] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:17:07.280750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d5fd0-ca07-409e-ac7a-642e1b081f2d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:07.281399 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d5fd0-ca07-409e-ac7a-642e1b081f2d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:07.281894 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d5fd0-ca07-409e-ac7a-642e1b081f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:07.290545 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:07.302799 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:07.304748 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bc8d5fd0-ca07-409e-ac7a-642e1b081f2d None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:07.306310 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bc8d5fd0-ca07-409e-ac7a-642e1b081f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:07.309394 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68283d30-4b5f-43b1-b9f3-fe637a4d2ed7 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:07.345797 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f84c82-e7d8-4dde-9232-98fe97142126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:07.346452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f84c82-e7d8-4dde-9232-98fe97142126 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:07.346743 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f84c82-e7d8-4dde-9232-98fe97142126 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:07.347029 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f84c82-e7d8-4dde-9232-98fe97142126 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:07.358303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f84c82-e7d8-4dde-9232-98fe97142126 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:07.363178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-e4f84c82-e7d8-4dde-9232-98fe97142126 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:07.363178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:07.363178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:07.363178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:07.363178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:07.363178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:07.363178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:07.363178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:07.363178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:07.363178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:07.363178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:07.363178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:07.363178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:07.363178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:07.363178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:07.363178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:07.364201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:07.364201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:07.364201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:07.364201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:07.364201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:07.364201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:07.364201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:07.364201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:07.364201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:07.364201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:07.364201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:07.364201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:07.364201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:07.364201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:07.364201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:07.364201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:07.365250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:07.365250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:07.365250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:07.365250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:07.365250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:07.365250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:07.365250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:07.365250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:07.365250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:07.365250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:07.365250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:07.365250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:07.367205 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 34/71] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:07.375329 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f84c82-e7d8-4dde-9232-98fe97142126 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:07.403198 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 38/72] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:17:07.440857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d5fd0-ca07-409e-ac7a-642e1b081f2d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:07.515363 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f84c82-e7d8-4dde-9232-98fe97142126 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:07.553214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40d34c-e459-496c-8ddf-6c0b175725d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:07.554066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40d34c-e459-496c-8ddf-6c0b175725d1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:07.554495 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40d34c-e459-496c-8ddf-6c0b175725d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:07.554994 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40d34c-e459-496c-8ddf-6c0b175725d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:07.555910 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40d34c-e459-496c-8ddf-6c0b175725d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:07.556362 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40d34c-e459-496c-8ddf-6c0b175725d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:07.558030 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a40d34c-e459-496c-8ddf-6c0b175725d1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:07.564753 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d5fd0-ca07-409e-ac7a-642e1b081f2d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:07.567011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 35/73] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:07.568698 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40d34c-e459-496c-8ddf-6c0b175725d1 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:07.589701 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:07.606563 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3763005-b526-4c69-9ad0-539be7e4411b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:07.607469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3763005-b526-4c69-9ad0-539be7e4411b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:07.607903 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3763005-b526-4c69-9ad0-539be7e4411b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:07.608383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3763005-b526-4c69-9ad0-539be7e4411b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:07.611616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:07.621254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3763005-b526-4c69-9ad0-539be7e4411b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:07.626532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-b3763005-b526-4c69-9ad0-539be7e4411b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:07.626532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:07.626532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:07.626532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:07.626532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:07.626532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:07.626532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:07.626532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:07.626532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:07.626532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:07.626532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:07.626532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:07.626532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:07.626532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:07.626532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:07.626532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:07.627575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:07.627575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:07.627575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:07.627575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:07.627575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:07.627575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:07.627575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:07.627575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:07.627575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:07.627575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:07.627575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:07.627575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:07.627575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:07.627575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:07.627575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:07.627575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:07.628518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:07.628518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:07.628518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:07.628518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:07.628518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:07.628518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:07.628518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:07.628518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:07.628518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:07.628518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:07.628518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:07.628518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:07.633296 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 39/74] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:17:07.633946 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3763005-b526-4c69-9ad0-539be7e4411b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:07.696795 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40d34c-e459-496c-8ddf-6c0b175725d1 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:07.733757 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ac81f-1c21-4e66-afc8-23f4bc75bcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:07.734401 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ac81f-1c21-4e66-afc8-23f4bc75bcfd None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:07.734692 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ac81f-1c21-4e66-afc8-23f4bc75bcfd None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:07.734976 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ac81f-1c21-4e66-afc8-23f4bc75bcfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:07.739342 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3763005-b526-4c69-9ad0-539be7e4411b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:07.745644 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ac81f-1c21-4e66-afc8-23f4bc75bcfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:07.750983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-e25ac81f-1c21-4e66-afc8-23f4bc75bcfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:17:07.750983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:07.750983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:07.750983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:07.750983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:07.750983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:07.750983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:07.750983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:07.750983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:07.750983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:07.750983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:07.750983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:07.750983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:07.750983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:07.750983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:07.750983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:07.751946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:07.751946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:07.751946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:07.751946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:07.751946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:07.751946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:07.751946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:07.751946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:07.751946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:07.751946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:07.751946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:07.751946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:07.751946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:07.751946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:07.751946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:07.751946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:07.752720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:07.752720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:07.752720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:07.752720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:07.752720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:07.752720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:07.752720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:07.752720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:07.752720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:07.752720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:07.752720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:17:07.752720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:07.752720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 36/75] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:17:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:07.753675 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ac81f-1c21-4e66-afc8-23f4bc75bcfd None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:07.776259 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204683f-9724-44c9-85b7-7030aba166aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:07.776867 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204683f-9724-44c9-85b7-7030aba166aa None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:07.777158 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204683f-9724-44c9-85b7-7030aba166aa None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:07.777444 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204683f-9724-44c9-85b7-7030aba166aa None admin] PATH_INFO: `/v3/users/58534463aeb44a27b394cd1dc1a1454a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:07.792941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204683f-9724-44c9-85b7-7030aba166aa None admin] RBAC: Authorizing `identity:get_user(user_id=58534463aeb44a27b394cd1dc1a1454a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:07.794448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204683f-9724-44c9-85b7-7030aba166aa None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:07.796083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 40/76] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:07 2022] GET /identity/v3/users/58534463aeb44a27b394cd1dc1a1454a => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:07.796886 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204683f-9724-44c9-85b7-7030aba166aa None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:07.837789 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:07.852202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:07.862279 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ac81f-1c21-4e66-afc8-23f4bc75bcfd None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:07.898439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f85989-a2ad-4f3e-a500-4e2bfda6cbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:07.899084 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f85989-a2ad-4f3e-a500-4e2bfda6cbf1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:07.899371 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f85989-a2ad-4f3e-a500-4e2bfda6cbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:07.899656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f85989-a2ad-4f3e-a500-4e2bfda6cbf1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:07.902331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204683f-9724-44c9-85b7-7030aba166aa None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:07.909746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f85989-a2ad-4f3e-a500-4e2bfda6cbf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:07.915294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-02f85989-a2ad-4f3e-a500-4e2bfda6cbf1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:07.915294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:07.915294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:07.915294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:07.915294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:07.915294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:07.915294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:07.915294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:07.915294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:07.915294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:07.915294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:07.915294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:07.915294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:07.915294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:07.915294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:07.915294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:07.916183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:07.916183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:07.916183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:07.916183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:07.916183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:07.916183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:07.916183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:07.916183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:07.916183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:07.916183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:07.916183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:07.916183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:07.916183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:07.916183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:07.916183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:07.916183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:07.916949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:07.916949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:07.916949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:07.916949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:07.916949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:07.916949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:07.916949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:07.916949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:07.916949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:07.916949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:07.916949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:07.916949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:07.916949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 37/77] 10.222.0.96 () {56 vars in 1114 bytes} [Wed Aug 24 04:17:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:07.917582 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f85989-a2ad-4f3e-a500-4e2bfda6cbf1 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:07.941294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03989e51-d74b-4933-9c1e-60bf78bb3ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:07.941909 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03989e51-d74b-4933-9c1e-60bf78bb3ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:07.942193 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03989e51-d74b-4933-9c1e-60bf78bb3ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:07.942470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03989e51-d74b-4933-9c1e-60bf78bb3ff0 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:07.943970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03989e51-d74b-4933-9c1e-60bf78bb3ff0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:07.944280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03989e51-d74b-4933-9c1e-60bf78bb3ff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:07.945982 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03989e51-d74b-4933-9c1e-60bf78bb3ff0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:07.957502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 41/78] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:07.958341 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03989e51-d74b-4933-9c1e-60bf78bb3ff0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:08.020526 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f85989-a2ad-4f3e-a500-4e2bfda6cbf1 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:08.056105 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5807a7-9127-4801-87a8-e446d5f53bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:08.056637 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5807a7-9127-4801-87a8-e446d5f53bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:08.056960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5807a7-9127-4801-87a8-e446d5f53bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:08.057244 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5807a7-9127-4801-87a8-e446d5f53bd9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:08.058480 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5807a7-9127-4801-87a8-e446d5f53bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:08.059957 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5807a7-9127-4801-87a8-e446d5f53bd9 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:08.061604 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 38/79] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:17:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:08.062373 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5807a7-9127-4801-87a8-e446d5f53bd9 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:08.065809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:08.068258 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03989e51-d74b-4933-9c1e-60bf78bb3ff0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:08.085000 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:08.106205 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fbda9-942b-4c90-99f9-ec0bc33eddb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:08.106830 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fbda9-942b-4c90-99f9-ec0bc33eddb1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:08.107119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fbda9-942b-4c90-99f9-ec0bc33eddb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:08.107401 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fbda9-942b-4c90-99f9-ec0bc33eddb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:08.108075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fbda9-942b-4c90-99f9-ec0bc33eddb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:08.108388 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fbda9-942b-4c90-99f9-ec0bc33eddb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:08.109832 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fbda9-942b-4c90-99f9-ec0bc33eddb1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:08.118793 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 42/80] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:08.119607 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fbda9-942b-4c90-99f9-ec0bc33eddb1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:08.172326 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5807a7-9127-4801-87a8-e446d5f53bd9 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:08.207832 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d4ab0-9e46-4638-93f1-e92ed348c614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:08.208497 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d4ab0-9e46-4638-93f1-e92ed348c614 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:08.208906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d4ab0-9e46-4638-93f1-e92ed348c614 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:08.209194 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892d4ab0-9e46-4638-93f1-e92ed348c614 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:08.227767 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fbda9-942b-4c90-99f9-ec0bc33eddb1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:08.262551 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636af146-ed43-48f6-8e6f-ab329252d4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:08.263168 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636af146-ed43-48f6-8e6f-ab329252d4af None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:08.263459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636af146-ed43-48f6-8e6f-ab329252d4af None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:08.263752 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636af146-ed43-48f6-8e6f-ab329252d4af None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:08.264426 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636af146-ed43-48f6-8e6f-ab329252d4af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:08.264784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636af146-ed43-48f6-8e6f-ab329252d4af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:08.266175 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636af146-ed43-48f6-8e6f-ab329252d4af None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:08.274331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 43/81] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:17:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:08.274331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636af146-ed43-48f6-8e6f-ab329252d4af None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:08.279032 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d4ab0-9e46-4638-93f1-e92ed348c614 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:08.279032 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892d4ab0-9e46-4638-93f1-e92ed348c614 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:08.281512 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:08.316909 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:08.377342 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636af146-ed43-48f6-8e6f-ab329252d4af None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:08.382613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 39/82] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:08.383452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d4ab0-9e46-4638-93f1-e92ed348c614 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:08.411105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6b933-a357-46ce-baa5-b1ef3728f468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:08.412410 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6b933-a357-46ce-baa5-b1ef3728f468 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:08.412711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6b933-a357-46ce-baa5-b1ef3728f468 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:08.413013 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6b933-a357-46ce-baa5-b1ef3728f468 None admin] PATH_INFO: `/v3/users/58534463aeb44a27b394cd1dc1a1454a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:08.414183 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6b933-a357-46ce-baa5-b1ef3728f468 None admin] RBAC: Authorizing `identity:get_user(user_id=58534463aeb44a27b394cd1dc1a1454a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:08.415646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6b933-a357-46ce-baa5-b1ef3728f468 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:08.417262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 44/83] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:08 2022] GET /identity/v3/users/58534463aeb44a27b394cd1dc1a1454a => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:08.418037 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6b933-a357-46ce-baa5-b1ef3728f468 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:08.490674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892d4ab0-9e46-4638-93f1-e92ed348c614 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:08.493504 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:08.518814 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6b933-a357-46ce-baa5-b1ef3728f468 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:08.526674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:08.526792 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0afe6-24ff-444e-a518-07986bc690cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:08.527323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0afe6-24ff-444e-a518-07986bc690cf None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:08.527618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0afe6-24ff-444e-a518-07986bc690cf None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:08.527896 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0afe6-24ff-444e-a518-07986bc690cf None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:08.528552 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e0afe6-24ff-444e-a518-07986bc690cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:08.530082 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e0afe6-24ff-444e-a518-07986bc690cf None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:08.554271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aeb4c2-c446-4aa8-a181-b8990ed7caa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:08.554911 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aeb4c2-c446-4aa8-a181-b8990ed7caa6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:08.555200 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aeb4c2-c446-4aa8-a181-b8990ed7caa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:08.555481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aeb4c2-c446-4aa8-a181-b8990ed7caa6 None admin] PATH_INFO: `/v3/users/8e583097bf7c4097a82fd7d436d1c78d` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:08.556619 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aeb4c2-c446-4aa8-a181-b8990ed7caa6 None admin] RBAC: Authorizing `identity:get_user(user_id=8e583097bf7c4097a82fd7d436d1c78d)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:08.557072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 40/84] 10.222.0.96 () {60 vars in 1132 bytes} [Wed Aug 24 04:17:08 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:17:08.557904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0afe6-24ff-444e-a518-07986bc690cf None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:08.558111 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aeb4c2-c446-4aa8-a181-b8990ed7caa6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:08.564621 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 45/85] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:08 2022] GET /identity/v3/users/8e583097bf7c4097a82fd7d436d1c78d => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:08.564621 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aeb4c2-c446-4aa8-a181-b8990ed7caa6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:08.689259 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aeb4c2-c446-4aa8-a181-b8990ed7caa6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:08.705971 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0afe6-24ff-444e-a518-07986bc690cf None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:08.733442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef883f-3d0b-478c-8fbb-8ff10be5c315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:08.734391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef883f-3d0b-478c-8fbb-8ff10be5c315 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:08.734391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef883f-3d0b-478c-8fbb-8ff10be5c315 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:08.734663 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef883f-3d0b-478c-8fbb-8ff10be5c315 None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:08.737036 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef883f-3d0b-478c-8fbb-8ff10be5c315 None admin] RBAC: Authorizing `identity:get_project(project_id=96630a4e703341619588eb5481011618)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:08.737361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef883f-3d0b-478c-8fbb-8ff10be5c315 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:08.741063 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 46/86] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:08 2022] GET /identity/v3/projects/96630a4e703341619588eb5481011618 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:08.741063 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef883f-3d0b-478c-8fbb-8ff10be5c315 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:08.750006 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff15fe-b68e-438d-9e92-90c51e16f3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:08.750667 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff15fe-b68e-438d-9e92-90c51e16f3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:08.750960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff15fe-b68e-438d-9e92-90c51e16f3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:08.751248 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff15fe-b68e-438d-9e92-90c51e16f3b9 None admin] PATH_INFO: `/v3/users/58534463aeb44a27b394cd1dc1a1454a` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:08.752440 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff15fe-b68e-438d-9e92-90c51e16f3b9 None admin] RBAC: Authorizing `identity:get_user(user_id=58534463aeb44a27b394cd1dc1a1454a)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:08.753969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff15fe-b68e-438d-9e92-90c51e16f3b9 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:08.756378 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 41/87] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:08 2022] GET /identity/v3/users/58534463aeb44a27b394cd1dc1a1454a => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:08.756993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff15fe-b68e-438d-9e92-90c51e16f3b9 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:08.787943 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:08.795692 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:08.875275 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef883f-3d0b-478c-8fbb-8ff10be5c315 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:08.898785 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff15fe-b68e-438d-9e92-90c51e16f3b9 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:08.925260 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e61ede-6754-4ea1-b221-18f568a111dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:08.925577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e61ede-6754-4ea1-b221-18f568a111dd None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:08.925760 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e61ede-6754-4ea1-b221-18f568a111dd None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:08.926044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e61ede-6754-4ea1-b221-18f568a111dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:08.956586 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea321f70-fd00-49b4-8f15-86721ce92747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:08.957799 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea321f70-fd00-49b4-8f15-86721ce92747 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:08.958776 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea321f70-fd00-49b4-8f15-86721ce92747 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:08.959544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea321f70-fd00-49b4-8f15-86721ce92747 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:09.006261 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e61ede-6754-4ea1-b221-18f568a111dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:09.007802 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e61ede-6754-4ea1-b221-18f568a111dd None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:09.058881 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:09.066014 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea321f70-fd00-49b4-8f15-86721ce92747 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:09.068814 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea321f70-fd00-49b4-8f15-86721ce92747 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:09.110393 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:09.137035 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 47/88] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:09.138211 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e61ede-6754-4ea1-b221-18f568a111dd None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:09.213398 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 42/89] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:09.214205 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea321f70-fd00-49b4-8f15-86721ce92747 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:09.257352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e61ede-6754-4ea1-b221-18f568a111dd None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:09.295620 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5c5da-6578-4873-ae70-b687592dd344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:09.296614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5c5da-6578-4873-ae70-b687592dd344 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:09.297252 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5c5da-6578-4873-ae70-b687592dd344 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:09.298059 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5c5da-6578-4873-ae70-b687592dd344 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:09.299375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5c5da-6578-4873-ae70-b687592dd344 None admin] RBAC: Adding query filter params (role.id=dbb1f67486534e8dbbc250bfe0978e6c, scope.project.id=96630a4e703341619588eb5481011618, user.id=58534463aeb44a27b394cd1dc1a1454a) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:09.300046 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5c5da-6578-4873-ae70-b687592dd344 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:09.303659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5c5da-6578-4873-ae70-b687592dd344 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:09.315059 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 48/90] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:17:09 2022] GET /identity/v3/role_assignments?user.id=58534463aeb44a27b394cd1dc1a1454a&scope.project.id=96630a4e703341619588eb5481011618&role.id=dbb1f67486534e8dbbc250bfe0978e6c => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:09.316207 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5c5da-6578-4873-ae70-b687592dd344 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:09.329761 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:09.355465 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea321f70-fd00-49b4-8f15-86721ce92747 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:09.386856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:09.397166 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23138e4e-aeb4-4de4-a58c-e38f27720e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:09.398201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23138e4e-aeb4-4de4-a58c-e38f27720e22 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:09.398713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23138e4e-aeb4-4de4-a58c-e38f27720e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:09.399189 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23138e4e-aeb4-4de4-a58c-e38f27720e22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:09.456714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5c5da-6578-4873-ae70-b687592dd344 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:09.476498 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23138e4e-aeb4-4de4-a58c-e38f27720e22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:09.478332 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23138e4e-aeb4-4de4-a58c-e38f27720e22 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:09.505086 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad15f8-eabd-4dd1-b56d-dc02e0f8caf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:09.506276 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad15f8-eabd-4dd1-b56d-dc02e0f8caf8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:09.506569 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad15f8-eabd-4dd1-b56d-dc02e0f8caf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:09.506850 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad15f8-eabd-4dd1-b56d-dc02e0f8caf8 None admin] PATH_INFO: `/v3/projects/230fc1d603fd4af1ae972b35b3793dbc` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:09.512938 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad15f8-eabd-4dd1-b56d-dc02e0f8caf8 None admin] RBAC: Authorizing `identity:get_project(project_id=230fc1d603fd4af1ae972b35b3793dbc)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:09.514568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad15f8-eabd-4dd1-b56d-dc02e0f8caf8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:09.516930 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 49/91] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:09 2022] GET /identity/v3/projects/230fc1d603fd4af1ae972b35b3793dbc => generated 312 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:09.517774 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad15f8-eabd-4dd1-b56d-dc02e0f8caf8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:09.593923 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 43/92] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:09.595103 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23138e4e-aeb4-4de4-a58c-e38f27720e22 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:09.628513 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:09.669193 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:09.714148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad15f8-eabd-4dd1-b56d-dc02e0f8caf8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:09.737890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23138e4e-aeb4-4de4-a58c-e38f27720e22 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:09.785319 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ee517-fb19-4d43-864b-931c918b3cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:09.787198 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ee517-fb19-4d43-864b-931c918b3cbb None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:09.787708 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ee517-fb19-4d43-864b-931c918b3cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:09.788179 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ee517-fb19-4d43-864b-931c918b3cbb None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:09.790386 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ee517-fb19-4d43-864b-931c918b3cbb None admin] RBAC: Authorizing `identity:get_project(project_id=96630a4e703341619588eb5481011618)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:09.794163 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ee517-fb19-4d43-864b-931c918b3cbb None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:09.796872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 50/93] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:09 2022] GET /identity/v3/projects/96630a4e703341619588eb5481011618 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:09.798336 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ee517-fb19-4d43-864b-931c918b3cbb None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:09.813490 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac03c2-8f5a-4b45-ac6b-18b2b9d9e4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:09.814447 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac03c2-8f5a-4b45-ac6b-18b2b9d9e4fa None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:09.814932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac03c2-8f5a-4b45-ac6b-18b2b9d9e4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:09.816141 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac03c2-8f5a-4b45-ac6b-18b2b9d9e4fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:09.817312 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac03c2-8f5a-4b45-ac6b-18b2b9d9e4fa None admin] RBAC: Adding query filter params (role.id=dbb1f67486534e8dbbc250bfe0978e6c, scope.project.id=230fc1d603fd4af1ae972b35b3793dbc, user.id=58534463aeb44a27b394cd1dc1a1454a) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:09.819449 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac03c2-8f5a-4b45-ac6b-18b2b9d9e4fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:09.821472 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac03c2-8f5a-4b45-ac6b-18b2b9d9e4fa None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:09.836426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 44/94] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:17:09 2022] GET /identity/v3/role_assignments?user.id=58534463aeb44a27b394cd1dc1a1454a&scope.project.id=230fc1d603fd4af1ae972b35b3793dbc&role.id=dbb1f67486534e8dbbc250bfe0978e6c => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:09.836426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac03c2-8f5a-4b45-ac6b-18b2b9d9e4fa None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:09.998502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ee517-fb19-4d43-864b-931c918b3cbb None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:10.058193 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:10.071829 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db331c-419f-4a22-be4b-b95af3c266fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:10.072481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db331c-419f-4a22-be4b-b95af3c266fc None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:10.072799 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db331c-419f-4a22-be4b-b95af3c266fc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:10.073083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db331c-419f-4a22-be4b-b95af3c266fc None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:10.075398 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac03c2-8f5a-4b45-ac6b-18b2b9d9e4fa None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:10.077384 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db331c-419f-4a22-be4b-b95af3c266fc None admin] RBAC: Authorizing `identity:get_project(project_id=96630a4e703341619588eb5481011618)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:10.078856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db331c-419f-4a22-be4b-b95af3c266fc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:10.080728 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 51/95] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:09 2022] GET /identity/v3/projects/96630a4e703341619588eb5481011618 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:10.092535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db331c-419f-4a22-be4b-b95af3c266fc None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:10.112313 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:10.152495 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae40ac9-d516-43f2-b50e-deeabee18010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:10.153155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae40ac9-d516-43f2-b50e-deeabee18010 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:10.153446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae40ac9-d516-43f2-b50e-deeabee18010 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:10.153729 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae40ac9-d516-43f2-b50e-deeabee18010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:10.154483 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae40ac9-d516-43f2-b50e-deeabee18010 None admin] RBAC: Adding query filter params (role.id=059d2bf5bb8e42939f5f826bfdad6a21, scope.project.id=96630a4e703341619588eb5481011618, user.id=8e583097bf7c4097a82fd7d436d1c78d) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:10.154802 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae40ac9-d516-43f2-b50e-deeabee18010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:10.156283 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae40ac9-d516-43f2-b50e-deeabee18010 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:10.168620 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 45/96] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:17:09 2022] GET /identity/v3/role_assignments?user.id=8e583097bf7c4097a82fd7d436d1c78d&scope.project.id=96630a4e703341619588eb5481011618&role.id=059d2bf5bb8e42939f5f826bfdad6a21 => generated 259 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:10.239060 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db331c-419f-4a22-be4b-b95af3c266fc None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:10.294695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72e47b-d6b7-4f26-9509-a70f9be1f9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:10.295252 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72e47b-d6b7-4f26-9509-a70f9be1f9be None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:10.295539 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72e47b-d6b7-4f26-9509-a70f9be1f9be None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:10.295820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72e47b-d6b7-4f26-9509-a70f9be1f9be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:10.296578 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72e47b-d6b7-4f26-9509-a70f9be1f9be None admin] RBAC: Adding query filter params (role.id=b78ed83a66fe4531900cc02bb745f80f, scope.project.id=96630a4e703341619588eb5481011618, user.id=58534463aeb44a27b394cd1dc1a1454a) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:10.296920 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72e47b-d6b7-4f26-9509-a70f9be1f9be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:10.298413 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72e47b-d6b7-4f26-9509-a70f9be1f9be None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:10.309701 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 52/97] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:17:10 2022] GET /identity/v3/role_assignments?user.id=58534463aeb44a27b394cd1dc1a1454a&scope.project.id=96630a4e703341619588eb5481011618&role.id=b78ed83a66fe4531900cc02bb745f80f => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:11.040790 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fcdde-83c6-4af4-9388-cd2723d5e82d None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:11.041285 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fcdde-83c6-4af4-9388-cd2723d5e82d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:11.041359 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fcdde-83c6-4af4-9388-cd2723d5e82d None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:11.042708 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 46/98] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:11.048011 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc269ff2-8946-4ddc-af51-378ba953efd8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:11.048468 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc269ff2-8946-4ddc-af51-378ba953efd8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:11.048616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc269ff2-8946-4ddc-af51-378ba953efd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:11.078541 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-fc269ff2-8946-4ddc-af51-378ba953efd8 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:11.079760 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fc269ff2-8946-4ddc-af51-378ba953efd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:11.096094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32498a-865f-4632-8fb5-44026ab39594 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:11.096366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32498a-865f-4632-8fb5-44026ab39594 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:11.096598 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32498a-865f-4632-8fb5-44026ab39594 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:11.097994 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 47/99] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:17:11.103988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f7ca3-31aa-4554-86fe-b201860009c5 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:11.104265 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f7ca3-31aa-4554-86fe-b201860009c5 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:11.104532 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f7ca3-31aa-4554-86fe-b201860009c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:11.123407 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-647f7ca3-31aa-4554-86fe-b201860009c5 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:11.124618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-647f7ca3-31aa-4554-86fe-b201860009c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:11.179921 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 53/100] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:17:11.210597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 48/101] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:17:11.486623 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc269ff2-8946-4ddc-af51-378ba953efd8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:11.490088 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:11.619213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc269ff2-8946-4ddc-af51-378ba953efd8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:11.656734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadd6e1-508f-4157-995f-f7ba821e805f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:11.657398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadd6e1-508f-4157-995f-f7ba821e805f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:11.657686 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadd6e1-508f-4157-995f-f7ba821e805f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:11.657974 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadd6e1-508f-4157-995f-f7ba821e805f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:11.659112 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadd6e1-508f-4157-995f-f7ba821e805f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:11.660591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadd6e1-508f-4157-995f-f7ba821e805f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:11.662239 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 54/102] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:17:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:11.669762 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f7ca3-31aa-4554-86fe-b201860009c5 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:11.712479 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadd6e1-508f-4157-995f-f7ba821e805f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:11.832435 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:11.869098 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:11.871695 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f7ca3-31aa-4554-86fe-b201860009c5 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:11.882303 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadd6e1-508f-4157-995f-f7ba821e805f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:11.923278 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c778f2-2795-4a3e-b9bd-9d4d3a0c57de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:11.924347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c778f2-2795-4a3e-b9bd-9d4d3a0c57de None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:11.924767 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c778f2-2795-4a3e-b9bd-9d4d3a0c57de None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:11.925151 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c778f2-2795-4a3e-b9bd-9d4d3a0c57de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:11.945531 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c778f2-2795-4a3e-b9bd-9d4d3a0c57de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:11.951213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-44c778f2-2795-4a3e-b9bd-9d4d3a0c57de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:17:11.951213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:11.951213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:11.951213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:11.951213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:11.951213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:11.951213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:11.951213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:11.951213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:11.951213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:11.951213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:11.951213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:11.951213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:11.951213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:11.951213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:11.951213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:11.952159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:11.952159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:11.952159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:11.952159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:11.952159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:11.952159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:11.952159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:11.952159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:11.952159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:11.952159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:11.952159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:11.952159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:11.952159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:11.952159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:11.952159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:11.952159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:11.953330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:11.953330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:11.953330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:11.953330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:11.953330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:11.953330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:11.953330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:11.953330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:11.953330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:11.953330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:11.953330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:17:11.953330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:11.953330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 55/103] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:17:11.963298 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ca3fa-5cab-4a32-ba51-897a9e93044f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:11.964170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ca3fa-5cab-4a32-ba51-897a9e93044f None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:11.964636 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ca3fa-5cab-4a32-ba51-897a9e93044f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:11.965116 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ca3fa-5cab-4a32-ba51-897a9e93044f None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:11.965943 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ca3fa-5cab-4a32-ba51-897a9e93044f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:11.967604 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ca3fa-5cab-4a32-ba51-897a9e93044f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:11.971944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c778f2-2795-4a3e-b9bd-9d4d3a0c57de None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:12.000267 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 49/104] 10.222.0.96 () {60 vars in 1141 bytes} [Wed Aug 24 04:17:11 2022] POST /identity/v3/projects => generated 302 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:17:12.143251 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c778f2-2795-4a3e-b9bd-9d4d3a0c57de None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:12.193173 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:12.198773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1c8f9-9e23-4143-8840-627ae8a15549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:12.199404 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1c8f9-9e23-4143-8840-627ae8a15549 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:12.199696 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1c8f9-9e23-4143-8840-627ae8a15549 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:12.199986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1c8f9-9e23-4143-8840-627ae8a15549 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:12.200847 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1c8f9-9e23-4143-8840-627ae8a15549 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:12.201220 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1c8f9-9e23-4143-8840-627ae8a15549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:12.202643 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1c8f9-9e23-4143-8840-627ae8a15549 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:12.216212 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 56/105] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:12.222353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ca3fa-5cab-4a32-ba51-897a9e93044f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:12.266178 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8ec75-dee8-456e-8f49-63af157366b2 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:12.266665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8ec75-dee8-456e-8f49-63af157366b2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:12.267148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8ec75-dee8-456e-8f49-63af157366b2 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:12.268782 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 57/106] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:12.274601 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03658f6f-7b7e-462d-ad49-078cf29f199d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:12.274987 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03658f6f-7b7e-462d-ad49-078cf29f199d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:12.275228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03658f6f-7b7e-462d-ad49-078cf29f199d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:12.306087 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-03658f6f-7b7e-462d-ad49-078cf29f199d None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:12.308995 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-03658f6f-7b7e-462d-ad49-078cf29f199d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:12.377853 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ca3fa-5cab-4a32-ba51-897a9e93044f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:12.408727 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 58/107] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:17:12.419024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d12d7-caee-48ef-a356-91ce599a3fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:12.419677 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d12d7-caee-48ef-a356-91ce599a3fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:12.419967 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d12d7-caee-48ef-a356-91ce599a3fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:12.420250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d12d7-caee-48ef-a356-91ce599a3fe6 None admin] PATH_INFO: `/v3/users/2606599901134439bc33d4b07596c2c9` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:12.432068 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:12.439715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d12d7-caee-48ef-a356-91ce599a3fe6 None admin] RBAC: Authorizing `identity:get_user(user_id=2606599901134439bc33d4b07596c2c9)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:12.442220 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d12d7-caee-48ef-a356-91ce599a3fe6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:12.445382 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 50/108] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:12 2022] GET /identity/v3/users/2606599901134439bc33d4b07596c2c9 => generated 289 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:12.450757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03658f6f-7b7e-462d-ad49-078cf29f199d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:12.596510 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03658f6f-7b7e-462d-ad49-078cf29f199d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:12.628212 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:12.641077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf0007-eb29-4787-911e-29dd2b3164ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:12.641715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf0007-eb29-4787-911e-29dd2b3164ad None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:12.642006 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf0007-eb29-4787-911e-29dd2b3164ad None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:12.642284 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf0007-eb29-4787-911e-29dd2b3164ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:12.733313 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf0007-eb29-4787-911e-29dd2b3164ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:12.734877 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf0007-eb29-4787-911e-29dd2b3164ad None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:12.743953 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d12d7-caee-48ef-a356-91ce599a3fe6 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:12.938403 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d12d7-caee-48ef-a356-91ce599a3fe6 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:12.952126 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 59/109] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:12.953360 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd7b71-0f3d-4136-83a9-801b1d189830 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:12.953614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd7b71-0f3d-4136-83a9-801b1d189830 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:12.953901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd7b71-0f3d-4136-83a9-801b1d189830 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:12.955319 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 60/110] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:12.959315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd7b71-0f3d-4136-83a9-801b1d189830 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:13.002529 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:13.005313 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a130bd9-89b9-4302-bf15-7ff34b78ae9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:13.006064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a130bd9-89b9-4302-bf15-7ff34b78ae9e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:13.006421 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a130bd9-89b9-4302-bf15-7ff34b78ae9e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:13.006709 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a130bd9-89b9-4302-bf15-7ff34b78ae9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:13.032717 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a130bd9-89b9-4302-bf15-7ff34b78ae9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:13.038572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-2a130bd9-89b9-4302-bf15-7ff34b78ae9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:13.038572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:13.038572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:13.038572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:13.038572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:13.038572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:13.038572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:13.038572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:13.038572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:13.038572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:13.038572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:13.038572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:13.038572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:13.038572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:13.038572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:13.038572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:13.039429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:13.039429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:13.039429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:13.039429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:13.039429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:13.039429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:13.039429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:13.039429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:13.039429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:13.039429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:13.039429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:13.039429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:13.039429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:13.039429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:13.039429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:13.039429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:13.040184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:13.040184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:13.040184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:13.040184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:13.040184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:13.040184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:13.040184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:13.040184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:13.040184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:13.040184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:13.040184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:13.040184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:13.040184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 51/111] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:17:13.041849 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dceaa2-5d94-4668-b20e-2620a7482715 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:13.041849 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dceaa2-5d94-4668-b20e-2620a7482715 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:13.042106 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dceaa2-5d94-4668-b20e-2620a7482715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:13.079187 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-b8dceaa2-5d94-4668-b20e-2620a7482715 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:13.081187 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b8dceaa2-5d94-4668-b20e-2620a7482715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:13.155503 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd7b71-0f3d-4136-83a9-801b1d189830 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:13.193121 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:13.221912 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 52/112] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:13.222552 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dceaa2-5d94-4668-b20e-2620a7482715 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:13.233701 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f27ee-8672-482f-b322-16fb1deb5756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:13.234357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f27ee-8672-482f-b322-16fb1deb5756 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:13.234643 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f27ee-8672-482f-b322-16fb1deb5756 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:13.234977 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f27ee-8672-482f-b322-16fb1deb5756 None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:13.236270 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f27ee-8672-482f-b322-16fb1deb5756 None admin] RBAC: Authorizing `identity:get_project(project_id=96630a4e703341619588eb5481011618)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:13.237805 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f27ee-8672-482f-b322-16fb1deb5756 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:13.239713 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 61/113] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:12 2022] GET /identity/v3/projects/96630a4e703341619588eb5481011618 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:13.245805 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f27ee-8672-482f-b322-16fb1deb5756 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:13.415512 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:13.418613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dceaa2-5d94-4668-b20e-2620a7482715 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:13.435783 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f27ee-8672-482f-b322-16fb1deb5756 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:13.482906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93239b2-0d78-4836-aca6-bce035d0d676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:13.483530 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93239b2-0d78-4836-aca6-bce035d0d676 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:13.483818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93239b2-0d78-4836-aca6-bce035d0d676 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:13.484095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93239b2-0d78-4836-aca6-bce035d0d676 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:13.484796 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93239b2-0d78-4836-aca6-bce035d0d676 None admin] RBAC: Adding query filter params (name=member) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:13.485113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93239b2-0d78-4836-aca6-bce035d0d676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:13.487738 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93239b2-0d78-4836-aca6-bce035d0d676 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:13.501022 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ef435-bda3-4e28-a8ff-05ca4ecbfac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:13.501718 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ef435-bda3-4e28-a8ff-05ca4ecbfac7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:13.502012 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ef435-bda3-4e28-a8ff-05ca4ecbfac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:13.502348 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ef435-bda3-4e28-a8ff-05ca4ecbfac7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:13.503094 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ef435-bda3-4e28-a8ff-05ca4ecbfac7 None admin] RBAC: Adding query filter params (role.id=19ca99e30fa74961a6203a02a8317128, scope.project.id=96630a4e703341619588eb5481011618, user.id=2606599901134439bc33d4b07596c2c9) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:13.503411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ef435-bda3-4e28-a8ff-05ca4ecbfac7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:13.504897 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ef435-bda3-4e28-a8ff-05ca4ecbfac7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:13.507029 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 53/114] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:13.508374 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a393fd4-f369-47d1-8391-c1844ae3b78e None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:13.508670 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a393fd4-f369-47d1-8391-c1844ae3b78e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:13.509024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a393fd4-f369-47d1-8391-c1844ae3b78e None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:13.510449 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 54/115] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:13.514974 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a393fd4-f369-47d1-8391-c1844ae3b78e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:13.518300 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 62/116] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:17:13 2022] GET /identity/v3/role_assignments?user.id=2606599901134439bc33d4b07596c2c9&scope.project.id=96630a4e703341619588eb5481011618&role.id=19ca99e30fa74961a6203a02a8317128 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:13.519783 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f36d6-2532-4b76-820f-eac0c0c57d53 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:13.528729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f36d6-2532-4b76-820f-eac0c0c57d53 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:13.528729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f36d6-2532-4b76-820f-eac0c0c57d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:13.560778 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0b1f36d6-2532-4b76-820f-eac0c0c57d53 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:13.562037 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0b1f36d6-2532-4b76-820f-eac0c0c57d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:13.626818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:13.709627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 63/117] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:13.710522 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f36d6-2532-4b76-820f-eac0c0c57d53 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:13.728337 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a393fd4-f369-47d1-8391-c1844ae3b78e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:13.785502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06230d-5824-4464-b8dd-ea9b416bf3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:13.786525 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06230d-5824-4464-b8dd-ea9b416bf3b0 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:13.787029 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06230d-5824-4464-b8dd-ea9b416bf3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:13.787514 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06230d-5824-4464-b8dd-ea9b416bf3b0 None admin] PATH_INFO: `/v3/users/58534463aeb44a27b394cd1dc1a1454a` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:13.789349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06230d-5824-4464-b8dd-ea9b416bf3b0 None admin] RBAC: Authorizing `identity:get_user(user_id=58534463aeb44a27b394cd1dc1a1454a)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:13.791008 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06230d-5824-4464-b8dd-ea9b416bf3b0 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:13.793259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 55/118] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:13 2022] GET /identity/v3/users/58534463aeb44a27b394cd1dc1a1454a => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:13.800412 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b52f5-d9f4-4e0c-82d3-ab5934bfd096 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:13.802014 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b52f5-d9f4-4e0c-82d3-ab5934bfd096 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:13.804488 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b52f5-d9f4-4e0c-82d3-ab5934bfd096 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:13.807061 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 56/119] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:13 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:13.809008 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b52f5-d9f4-4e0c-82d3-ab5934bfd096 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:13.874549 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:13.904610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f36d6-2532-4b76-820f-eac0c0c57d53 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:13.970543 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3a316-6bf8-45fa-9a0d-986094fb2410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:13.971175 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3a316-6bf8-45fa-9a0d-986094fb2410 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:13.971616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3a316-6bf8-45fa-9a0d-986094fb2410 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:13.972055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3a316-6bf8-45fa-9a0d-986094fb2410 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:13.983269 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3a316-6bf8-45fa-9a0d-986094fb2410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:13.988459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-09a3a316-6bf8-45fa-9a0d-986094fb2410 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:13.988459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:13.988459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:13.988459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:13.988459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:13.988459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:13.988459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:13.988459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:13.988459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:13.988459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:13.988459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:13.988459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:13.988459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:13.988459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:13.988459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:13.988459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:13.990451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:13.990451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:13.990451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:13.990451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:13.990451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:13.990451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:13.990451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:13.990451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:13.990451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:13.990451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:13.990451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:13.990451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:13.990451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:13.990451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:13.990451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:13.990451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:13.991369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:13.991369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:13.991369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:13.991369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:13.991369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:13.991369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:13.991369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:13.991369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:13.991369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:13.991369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:13.991369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:13.991369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:13.993322 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 64/120] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:13.994632 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda03b0-18e2-4f6a-9783-f9d5330dc7b3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:13.995054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda03b0-18e2-4f6a-9783-f9d5330dc7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:13.995488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda03b0-18e2-4f6a-9783-f9d5330dc7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:14.014621 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0eda03b0-18e2-4f6a-9783-f9d5330dc7b3 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:14.016041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0eda03b0-18e2-4f6a-9783-f9d5330dc7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:14.049148 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b52f5-d9f4-4e0c-82d3-ab5934bfd096 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:14.071481 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:14.095570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22456510-7f81-4322-9243-dd804b49f042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:14.096237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22456510-7f81-4322-9243-dd804b49f042 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:14.096524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22456510-7f81-4322-9243-dd804b49f042 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:14.096839 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22456510-7f81-4322-9243-dd804b49f042 None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:14.098017 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22456510-7f81-4322-9243-dd804b49f042 None admin] RBAC: Authorizing `identity:get_project(project_id=96630a4e703341619588eb5481011618)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:14.099995 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22456510-7f81-4322-9243-dd804b49f042 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:14.104734 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 57/121] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:13 2022] GET /identity/v3/projects/96630a4e703341619588eb5481011618 => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:14.104734 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22456510-7f81-4322-9243-dd804b49f042 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:14.116449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 65/122] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:14.117737 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda03b0-18e2-4f6a-9783-f9d5330dc7b3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:14.205125 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:14.232256 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda03b0-18e2-4f6a-9783-f9d5330dc7b3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:14.245185 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22456510-7f81-4322-9243-dd804b49f042 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:14.271099 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd695f-6272-42fb-a66b-d95ed480bd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:14.272479 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd695f-6272-42fb-a66b-d95ed480bd9c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:14.272863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd695f-6272-42fb-a66b-d95ed480bd9c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:14.273219 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd695f-6272-42fb-a66b-d95ed480bd9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:14.288042 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e78055-8a1a-442a-98e7-b23769619cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:14.288217 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd695f-6272-42fb-a66b-d95ed480bd9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:14.289047 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e78055-8a1a-442a-98e7-b23769619cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:14.289530 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e78055-8a1a-442a-98e7-b23769619cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:14.289978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e78055-8a1a-442a-98e7-b23769619cc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:14.290895 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e78055-8a1a-442a-98e7-b23769619cc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:14.291426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e78055-8a1a-442a-98e7-b23769619cc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:14.293035 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e78055-8a1a-442a-98e7-b23769619cc1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:14.294199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-a5cd695f-6272-42fb-a66b-d95ed480bd9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:17:14.294199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:14.294199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:14.294199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:14.294199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:14.294199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:14.294199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:14.294199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:14.294199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:14.294199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:14.294199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:14.294199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:14.294199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:14.294199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:14.294199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:14.294199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:14.295015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:14.295015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:14.295015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:14.295015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:14.295015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:14.295015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:14.295015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:14.295015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:14.295015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:14.295015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:14.295015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:14.295015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:14.295015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:14.295015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:14.295015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:14.295015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:14.295801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:14.295801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:14.295801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:14.295801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:14.295801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:14.295801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:14.295801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:14.295801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:14.295801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:14.295801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:14.295801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:17:14.295801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:14.295801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 66/123] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:17:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:14.296423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd695f-6272-42fb-a66b-d95ed480bd9c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:14.312220 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 58/124] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:14.313667 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e78055-8a1a-442a-98e7-b23769619cc1 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:14.429015 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:14.452070 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd695f-6272-42fb-a66b-d95ed480bd9c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:14.494565 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c1b3d-80c2-42f2-b113-762d8ee31df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:14.495173 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c1b3d-80c2-42f2-b113-762d8ee31df1 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:14.495460 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c1b3d-80c2-42f2-b113-762d8ee31df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:14.496001 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c1b3d-80c2-42f2-b113-762d8ee31df1 None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618/users/58534463aeb44a27b394cd1dc1a1454a/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:14.502733 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c1b3d-80c2-42f2-b113-762d8ee31df1 None admin] RBAC: Authorizing `identity:create_grant(project_id=96630a4e703341619588eb5481011618, user_id=58534463aeb44a27b394cd1dc1a1454a, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:14.504211 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c1b3d-80c2-42f2-b113-762d8ee31df1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:14.511949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:14.531406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 67/125] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:17:14 2022] PUT /identity/v3/projects/96630a4e703341619588eb5481011618/users/58534463aeb44a27b394cd1dc1a1454a/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:17:14.532681 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c1b3d-80c2-42f2-b113-762d8ee31df1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:14.555356 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e78055-8a1a-442a-98e7-b23769619cc1 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:14.634318 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9630bd3-de4d-42b8-ba68-e72468065b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:14.635730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9630bd3-de4d-42b8-ba68-e72468065b3d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:14.636021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9630bd3-de4d-42b8-ba68-e72468065b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:14.636299 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9630bd3-de4d-42b8-ba68-e72468065b3d None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:14.637038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9630bd3-de4d-42b8-ba68-e72468065b3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:14.639781 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9630bd3-de4d-42b8-ba68-e72468065b3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:14.642870 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9630bd3-de4d-42b8-ba68-e72468065b3d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:14.668582 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 59/126] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:14.677360 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9630bd3-de4d-42b8-ba68-e72468065b3d None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:14.714954 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c1b3d-80c2-42f2-b113-762d8ee31df1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:14.755879 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163b122-2600-4d0f-a783-ba5cf4d1d235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:14.756603 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163b122-2600-4d0f-a783-ba5cf4d1d235 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:14.756937 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163b122-2600-4d0f-a783-ba5cf4d1d235 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:14.757532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163b122-2600-4d0f-a783-ba5cf4d1d235 None admin] PATH_INFO: `/v3/users/58534463aeb44a27b394cd1dc1a1454a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:14.758986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163b122-2600-4d0f-a783-ba5cf4d1d235 None admin] RBAC: Authorizing `identity:get_user(user_id=58534463aeb44a27b394cd1dc1a1454a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:14.760460 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163b122-2600-4d0f-a783-ba5cf4d1d235 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:14.763083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 68/127] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:14 2022] GET /identity/v3/users/58534463aeb44a27b394cd1dc1a1454a => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:14.764222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163b122-2600-4d0f-a783-ba5cf4d1d235 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:14.812988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9630bd3-de4d-42b8-ba68-e72468065b3d None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:14.824275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:14.861505 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:14.887759 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3415b-15ef-4bc1-996d-4b954ccd5896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:14.888436 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3415b-15ef-4bc1-996d-4b954ccd5896 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:14.888741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3415b-15ef-4bc1-996d-4b954ccd5896 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:14.889028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3415b-15ef-4bc1-996d-4b954ccd5896 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:14.902390 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3415b-15ef-4bc1-996d-4b954ccd5896 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:14.909157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-63a3415b-15ef-4bc1-996d-4b954ccd5896 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:14.909157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:14.909157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:14.909157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:14.909157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:14.909157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:14.909157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:14.909157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:14.909157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:14.909157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:14.909157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:14.909157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:14.909157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:14.909157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:14.909157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:14.909157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:14.910022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:14.910022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:14.910022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:14.910022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:14.910022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:14.910022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:14.910022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:14.910022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:14.910022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:14.910022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:14.910022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:14.910022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:14.910022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:14.910022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:14.910022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:14.910022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:14.910793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:14.910793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:14.910793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:14.910793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:14.910793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:14.910793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:14.910793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:14.910793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:14.910793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:14.910793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:14.910793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:14.910793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:14.910793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 60/128] 10.222.0.96 () {56 vars in 1114 bytes} [Wed Aug 24 04:17:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:14.912587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3415b-15ef-4bc1-996d-4b954ccd5896 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:14.918713 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163b122-2600-4d0f-a783-ba5cf4d1d235 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:14.963977 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833cbcf-46a7-4f2d-8d93-b4690d212f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:14.965201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833cbcf-46a7-4f2d-8d93-b4690d212f3c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:14.965494 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833cbcf-46a7-4f2d-8d93-b4690d212f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:14.965778 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833cbcf-46a7-4f2d-8d93-b4690d212f3c None admin] PATH_INFO: `/v3/users/8e583097bf7c4097a82fd7d436d1c78d` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:14.966942 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833cbcf-46a7-4f2d-8d93-b4690d212f3c None admin] RBAC: Authorizing `identity:get_user(user_id=8e583097bf7c4097a82fd7d436d1c78d)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:14.969351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833cbcf-46a7-4f2d-8d93-b4690d212f3c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:14.971447 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 69/129] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:14 2022] GET /identity/v3/users/8e583097bf7c4097a82fd7d436d1c78d => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:14.973204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efee3b-cf00-4526-9427-394d157e4269 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:14.973492 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efee3b-cf00-4526-9427-394d157e4269 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:14.974472 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efee3b-cf00-4526-9427-394d157e4269 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:14.975739 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 70/130] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:14.976463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efee3b-cf00-4526-9427-394d157e4269 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:15.051206 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3415b-15ef-4bc1-996d-4b954ccd5896 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:15.105905 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fe154-173a-4b32-bb23-b6d67a0fb273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:15.106824 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fe154-173a-4b32-bb23-b6d67a0fb273 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:15.107160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fe154-173a-4b32-bb23-b6d67a0fb273 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:15.107444 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fe154-173a-4b32-bb23-b6d67a0fb273 None admin] PATH_INFO: `/v3/projects/230fc1d603fd4af1ae972b35b3793dbc` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:15.109095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fe154-173a-4b32-bb23-b6d67a0fb273 None admin] RBAC: Authorizing `identity:get_project(project_id=230fc1d603fd4af1ae972b35b3793dbc)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:15.112212 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fe154-173a-4b32-bb23-b6d67a0fb273 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:15.113985 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 61/131] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:14 2022] GET /identity/v3/projects/230fc1d603fd4af1ae972b35b3793dbc => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:15.120276 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fe154-173a-4b32-bb23-b6d67a0fb273 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:15.121298 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efee3b-cf00-4526-9427-394d157e4269 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:15.162337 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:15.164132 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:15.170654 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd1da4-e690-406b-8140-d8765e3a7a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:15.171496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd1da4-e690-406b-8140-d8765e3a7a9f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:15.171949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd1da4-e690-406b-8140-d8765e3a7a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:15.172882 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd1da4-e690-406b-8140-d8765e3a7a9f None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:15.173818 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd1da4-e690-406b-8140-d8765e3a7a9f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:15.174337 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd1da4-e690-406b-8140-d8765e3a7a9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:15.176595 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd1da4-e690-406b-8140-d8765e3a7a9f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:15.188020 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 71/132] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:17:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:15.189767 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870ad27-15ac-43db-97c8-9434d104597a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:15.190548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870ad27-15ac-43db-97c8-9434d104597a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:15.191165 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870ad27-15ac-43db-97c8-9434d104597a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:15.214594 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e870ad27-15ac-43db-97c8-9434d104597a None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:15.216978 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e870ad27-15ac-43db-97c8-9434d104597a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:15.243119 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fe154-173a-4b32-bb23-b6d67a0fb273 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:15.287686 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdba68c-29b6-42f5-a8c1-a97b9bb79338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:15.288347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdba68c-29b6-42f5-a8c1-a97b9bb79338 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:15.288603 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdba68c-29b6-42f5-a8c1-a97b9bb79338 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:15.288920 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdba68c-29b6-42f5-a8c1-a97b9bb79338 None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:15.290066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdba68c-29b6-42f5-a8c1-a97b9bb79338 None admin] RBAC: Authorizing `identity:get_project(project_id=96630a4e703341619588eb5481011618)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:15.291592 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdba68c-29b6-42f5-a8c1-a97b9bb79338 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:15.293678 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 62/133] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:15 2022] GET /identity/v3/projects/96630a4e703341619588eb5481011618 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:15.294352 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdba68c-29b6-42f5-a8c1-a97b9bb79338 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:15.310063 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 72/134] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:15.311201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870ad27-15ac-43db-97c8-9434d104597a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:15.437456 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870ad27-15ac-43db-97c8-9434d104597a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:15.465518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:15.482889 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a171b-66da-4263-944c-a85203fe2b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:15.483414 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a171b-66da-4263-944c-a85203fe2b3d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:15.483700 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a171b-66da-4263-944c-a85203fe2b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:15.483976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a171b-66da-4263-944c-a85203fe2b3d None admin] PATH_INFO: `/v3/users/58534463aeb44a27b394cd1dc1a1454a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:15.485970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a171b-66da-4263-944c-a85203fe2b3d None admin] RBAC: Authorizing `identity:get_user(user_id=58534463aeb44a27b394cd1dc1a1454a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:15.489502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdba68c-29b6-42f5-a8c1-a97b9bb79338 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:15.491989 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a171b-66da-4263-944c-a85203fe2b3d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:15.493433 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:15.501547 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 73/135] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:15 2022] GET /identity/v3/users/58534463aeb44a27b394cd1dc1a1454a => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:15.502679 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a171b-66da-4263-944c-a85203fe2b3d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:15.559723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494d7c5-7bf4-4a00-a820-8b3669c5f922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:15.560763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494d7c5-7bf4-4a00-a820-8b3669c5f922 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:15.561010 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494d7c5-7bf4-4a00-a820-8b3669c5f922 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:15.561295 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494d7c5-7bf4-4a00-a820-8b3669c5f922 None admin] PATH_INFO: `/v3/projects/230fc1d603fd4af1ae972b35b3793dbc/users/58534463aeb44a27b394cd1dc1a1454a/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:15.564609 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494d7c5-7bf4-4a00-a820-8b3669c5f922 None admin] RBAC: Authorizing `identity:create_grant(project_id=230fc1d603fd4af1ae972b35b3793dbc, user_id=58534463aeb44a27b394cd1dc1a1454a, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:15.566106 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494d7c5-7bf4-4a00-a820-8b3669c5f922 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:15.594367 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 63/136] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:17:15 2022] PUT /identity/v3/projects/230fc1d603fd4af1ae972b35b3793dbc/users/58534463aeb44a27b394cd1dc1a1454a/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:17:15.595076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494d7c5-7bf4-4a00-a820-8b3669c5f922 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:15.719495 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a171b-66da-4263-944c-a85203fe2b3d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:15.761390 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a7523-fc20-41a5-9bdf-37ce007aa14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:15.762080 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a7523-fc20-41a5-9bdf-37ce007aa14a None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:15.762644 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a7523-fc20-41a5-9bdf-37ce007aa14a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:15.762933 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a7523-fc20-41a5-9bdf-37ce007aa14a None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618/users/8e583097bf7c4097a82fd7d436d1c78d/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:15.769902 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a7523-fc20-41a5-9bdf-37ce007aa14a None admin] RBAC: Authorizing `identity:create_grant(project_id=96630a4e703341619588eb5481011618, user_id=8e583097bf7c4097a82fd7d436d1c78d, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:15.779348 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a7523-fc20-41a5-9bdf-37ce007aa14a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:15.796473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494d7c5-7bf4-4a00-a820-8b3669c5f922 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:15.797568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 74/137] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:17:15 2022] PUT /identity/v3/projects/96630a4e703341619588eb5481011618/users/8e583097bf7c4097a82fd7d436d1c78d/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:17:15.798629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a7523-fc20-41a5-9bdf-37ce007aa14a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:15.869764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8c9f5-5cb9-40ac-adc5-f99c44348e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:15.870453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8c9f5-5cb9-40ac-adc5-f99c44348e0c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:15.870738 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8c9f5-5cb9-40ac-adc5-f99c44348e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:15.871175 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8c9f5-5cb9-40ac-adc5-f99c44348e0c None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:15.872279 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8c9f5-5cb9-40ac-adc5-f99c44348e0c None admin] RBAC: Authorizing `identity:get_project(project_id=96630a4e703341619588eb5481011618)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:15.873848 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8c9f5-5cb9-40ac-adc5-f99c44348e0c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:15.880830 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 64/138] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:15 2022] GET /identity/v3/projects/96630a4e703341619588eb5481011618 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:15.882548 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7d948-f771-46db-83cd-c244b94750ca None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:15.882849 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7d948-f771-46db-83cd-c244b94750ca None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:15.883136 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7d948-f771-46db-83cd-c244b94750ca None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:15.884864 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 65/139] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:15.885686 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7d948-f771-46db-83cd-c244b94750ca None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:15.895773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:15.932975 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:15.957046 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a7523-fc20-41a5-9bdf-37ce007aa14a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:16.020711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15826c0b-e341-41c6-912a-cef808c86d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:16.021532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15826c0b-e341-41c6-912a-cef808c86d35 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:16.021881 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15826c0b-e341-41c6-912a-cef808c86d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:16.022183 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15826c0b-e341-41c6-912a-cef808c86d35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:16.023393 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15826c0b-e341-41c6-912a-cef808c86d35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:16.026682 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15826c0b-e341-41c6-912a-cef808c86d35 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:16.027963 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7d948-f771-46db-83cd-c244b94750ca None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:16.028976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 75/140] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:17:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:16.030277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b7cfe-b790-4359-bafe-c2974fa2ac44 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:16.030561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b7cfe-b790-4359-bafe-c2974fa2ac44 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:16.030837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b7cfe-b790-4359-bafe-c2974fa2ac44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:16.050480 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-eb7b7cfe-b790-4359-bafe-c2974fa2ac44 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:16.051669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-eb7b7cfe-b790-4359-bafe-c2974fa2ac44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:16.071444 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841e37c-09a5-4551-8a7a-f3f91dd2869f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:16.072424 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841e37c-09a5-4551-8a7a-f3f91dd2869f None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:16.072741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841e37c-09a5-4551-8a7a-f3f91dd2869f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:16.073031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841e37c-09a5-4551-8a7a-f3f91dd2869f None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618/users/58534463aeb44a27b394cd1dc1a1454a/roles/b78ed83a66fe4531900cc02bb745f80f` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:16.075684 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841e37c-09a5-4551-8a7a-f3f91dd2869f None admin] RBAC: Authorizing `identity:create_grant(project_id=96630a4e703341619588eb5481011618, user_id=58534463aeb44a27b394cd1dc1a1454a, role_id=b78ed83a66fe4531900cc02bb745f80f)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:16.077575 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841e37c-09a5-4551-8a7a-f3f91dd2869f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:16.100625 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 66/141] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:17:15 2022] PUT /identity/v3/projects/96630a4e703341619588eb5481011618/users/58534463aeb44a27b394cd1dc1a1454a/roles/b78ed83a66fe4531900cc02bb745f80f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:17:16.103124 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841e37c-09a5-4551-8a7a-f3f91dd2869f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:16.166945 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 76/142] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:16.229832 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:16.241097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841e37c-09a5-4551-8a7a-f3f91dd2869f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:16.281560 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b9f94-ca15-4972-9182-da3825465cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:16.282195 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b9f94-ca15-4972-9182-da3825465cbb None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:16.282480 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b9f94-ca15-4972-9182-da3825465cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:16.282761 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b9f94-ca15-4972-9182-da3825465cbb None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:16.283429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b9f94-ca15-4972-9182-da3825465cbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:16.284983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b9f94-ca15-4972-9182-da3825465cbb None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:16.310216 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 67/143] 10.222.0.96 () {60 vars in 1132 bytes} [Wed Aug 24 04:17:16 2022] POST /identity/v3/users => generated 283 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:17:16.548372 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b7cfe-b790-4359-bafe-c2974fa2ac44 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:16.608381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:16.671375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b7cfe-b790-4359-bafe-c2974fa2ac44 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:16.719653 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb16a6-3413-4e91-a075-f724fc97ccfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:16.720372 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb16a6-3413-4e91-a075-f724fc97ccfd None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:16.720664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb16a6-3413-4e91-a075-f724fc97ccfd None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:16.720961 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb16a6-3413-4e91-a075-f724fc97ccfd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:16.732956 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb16a6-3413-4e91-a075-f724fc97ccfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:16.737833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-3bdb16a6-3413-4e91-a075-f724fc97ccfd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:17:16.737833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:16.737833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:16.737833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:16.737833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:16.737833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:16.737833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:16.737833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:16.737833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:16.737833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:16.737833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:16.737833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:16.737833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:16.737833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:16.737833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:16.737833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:16.738927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:16.738927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:16.738927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:16.738927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:16.738927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:16.738927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:16.738927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:16.738927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:16.738927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:16.738927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:16.738927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:16.738927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:16.738927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:16.738927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:16.738927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:16.738927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:16.740058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:16.740058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:16.740058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:16.740058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:16.740058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:16.740058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:16.740058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:16.740058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:16.740058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:16.740058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:16.740058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:17:16.740058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:16.740058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 77/144] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:16.744998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b9f94-ca15-4972-9182-da3825465cbb None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:16.873953 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b9f94-ca15-4972-9182-da3825465cbb None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:16.923824 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca1636-2660-4b4c-91e2-e5af60a5f8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:16.924457 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca1636-2660-4b4c-91e2-e5af60a5f8ed None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:16.924776 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca1636-2660-4b4c-91e2-e5af60a5f8ed None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:16.925069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca1636-2660-4b4c-91e2-e5af60a5f8ed None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:16.925858 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca1636-2660-4b4c-91e2-e5af60a5f8ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:16.926193 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca1636-2660-4b4c-91e2-e5af60a5f8ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:16.928163 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca1636-2660-4b4c-91e2-e5af60a5f8ed None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:16.938723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 68/145] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:16.945479 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb16a6-3413-4e91-a075-f724fc97ccfd None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:17.012773 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12986012-abf6-4707-a0c9-f6556b8b4c2c None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:17.013101 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12986012-abf6-4707-a0c9-f6556b8b4c2c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:17.013356 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12986012-abf6-4707-a0c9-f6556b8b4c2c None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:17.014781 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 69/146] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:17.020633 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b0baa-c026-43af-b731-56bac57a943d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:17.021091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b0baa-c026-43af-b731-56bac57a943d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:17.021282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b0baa-c026-43af-b731-56bac57a943d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:17.057777 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-fe5b0baa-c026-43af-b731-56bac57a943d None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:17.059005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-fe5b0baa-c026-43af-b731-56bac57a943d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:17.063150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:17.116948 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb16a6-3413-4e91-a075-f724fc97ccfd None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:17.147476 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:17.188533 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 70/147] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 24 04:17:17.189362 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d9c7e-4cce-4434-864c-ebfa7d62dd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:17.190076 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d9c7e-4cce-4434-864c-ebfa7d62dd57 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:17.190368 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d9c7e-4cce-4434-864c-ebfa7d62dd57 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:17.190649 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d9c7e-4cce-4434-864c-ebfa7d62dd57 None admin] PATH_INFO: `/v3/users/2606599901134439bc33d4b07596c2c9` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:17.192102 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d9c7e-4cce-4434-864c-ebfa7d62dd57 None admin] RBAC: Authorizing `identity:get_user(user_id=2606599901134439bc33d4b07596c2c9)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:17.194350 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d9c7e-4cce-4434-864c-ebfa7d62dd57 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:17.196581 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 78/148] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:16 2022] GET /identity/v3/users/2606599901134439bc33d4b07596c2c9 => generated 289 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:17.202316 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b0baa-c026-43af-b731-56bac57a943d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:17.315579 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b0baa-c026-43af-b731-56bac57a943d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:17.358541 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bec04-b657-4b5e-9481-8625ca866dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:17.359196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bec04-b657-4b5e-9481-8625ca866dfb None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:17.359486 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bec04-b657-4b5e-9481-8625ca866dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:17.359771 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bec04-b657-4b5e-9481-8625ca866dfb None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:17.360976 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bec04-b657-4b5e-9481-8625ca866dfb None admin] RBAC: Authorizing `identity:get_project(project_id=96630a4e703341619588eb5481011618)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:17.362440 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bec04-b657-4b5e-9481-8625ca866dfb None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:17.364180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 71/149] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:17 2022] GET /identity/v3/projects/96630a4e703341619588eb5481011618 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:17.370795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d9c7e-4cce-4434-864c-ebfa7d62dd57 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:17.510679 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d9c7e-4cce-4434-864c-ebfa7d62dd57 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:17.550207 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43338e-db56-4db4-a142-baa0bc55f1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:17.551023 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43338e-db56-4db4-a142-baa0bc55f1ab None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:17.551205 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43338e-db56-4db4-a142-baa0bc55f1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:17.551433 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43338e-db56-4db4-a142-baa0bc55f1ab None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618/users/2606599901134439bc33d4b07596c2c9/roles/19ca99e30fa74961a6203a02a8317128` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:17.556652 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43338e-db56-4db4-a142-baa0bc55f1ab None admin] RBAC: Authorizing `identity:create_grant(project_id=96630a4e703341619588eb5481011618, user_id=2606599901134439bc33d4b07596c2c9, role_id=19ca99e30fa74961a6203a02a8317128)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:17.558160 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43338e-db56-4db4-a142-baa0bc55f1ab None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:17.576445 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 79/150] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:17:17 2022] PUT /identity/v3/projects/96630a4e703341619588eb5481011618/users/2606599901134439bc33d4b07596c2c9/roles/19ca99e30fa74961a6203a02a8317128 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:17:17.627752 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bec04-b657-4b5e-9481-8625ca866dfb None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:17.639964 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:17.745363 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bec04-b657-4b5e-9481-8625ca866dfb None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:17.786224 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5acaf-b8c4-49bd-84d3-3c375efc4dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:17.787089 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5acaf-b8c4-49bd-84d3-3c375efc4dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:17.787379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5acaf-b8c4-49bd-84d3-3c375efc4dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:17.787669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5acaf-b8c4-49bd-84d3-3c375efc4dd5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:17.800048 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5acaf-b8c4-49bd-84d3-3c375efc4dd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:17.805969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-9ca5acaf-b8c4-49bd-84d3-3c375efc4dd5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:17.805969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:17.805969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:17.805969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:17.805969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:17.805969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:17.805969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:17.805969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:17.805969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:17.805969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:17.805969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:17.805969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:17.805969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:17.805969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:17.805969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:17.805969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:17.806860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:17.806860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:17.806860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:17.806860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:17.806860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:17.806860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:17.806860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:17.806860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:17.806860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:17.806860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:17.806860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:17.806860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:17.806860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:17.806860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:17.806860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:17.806860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:17.807674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:17.807674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:17.807674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:17.807674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:17.807674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:17.807674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:17.807674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:17.807674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:17.807674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:17.807674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:17.807674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:17.807674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:17.807674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 72/151] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:17.814391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43338e-db56-4db4-a142-baa0bc55f1ab None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:17.869716 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:17.947222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43338e-db56-4db4-a142-baa0bc55f1ab None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:17.985764 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85967924-efa1-461a-8bbe-0ae2527af4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:17.986385 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85967924-efa1-461a-8bbe-0ae2527af4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:17.986671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85967924-efa1-461a-8bbe-0ae2527af4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:17.986950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85967924-efa1-461a-8bbe-0ae2527af4d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:17.987627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85967924-efa1-461a-8bbe-0ae2527af4d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:17.987979 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85967924-efa1-461a-8bbe-0ae2527af4d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:17.990090 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85967924-efa1-461a-8bbe-0ae2527af4d0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:18.000170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 80/152] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:18.006139 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5acaf-b8c4-49bd-84d3-3c375efc4dd5 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:18.083476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:18.129457 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5acaf-b8c4-49bd-84d3-3c375efc4dd5 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:18.170136 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace74c94-3f88-4b9a-a2a3-947a01744de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:18.170786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace74c94-3f88-4b9a-a2a3-947a01744de6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:18.171074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace74c94-3f88-4b9a-a2a3-947a01744de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:18.171349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace74c94-3f88-4b9a-a2a3-947a01744de6 None admin] PATH_INFO: `/v3/users/58534463aeb44a27b394cd1dc1a1454a` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:18.172590 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace74c94-3f88-4b9a-a2a3-947a01744de6 None admin] RBAC: Authorizing `identity:get_user(user_id=58534463aeb44a27b394cd1dc1a1454a)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:18.174091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace74c94-3f88-4b9a-a2a3-947a01744de6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:18.176000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 73/153] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:18 2022] GET /identity/v3/users/58534463aeb44a27b394cd1dc1a1454a => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:18.182737 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85967924-efa1-461a-8bbe-0ae2527af4d0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:18.295016 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:18.298702 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85967924-efa1-461a-8bbe-0ae2527af4d0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:18.341246 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea4783-ff03-482c-82d6-af3982aa3b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:18.341873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea4783-ff03-482c-82d6-af3982aa3b83 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:18.342225 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea4783-ff03-482c-82d6-af3982aa3b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:18.342503 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea4783-ff03-482c-82d6-af3982aa3b83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:18.422137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea4783-ff03-482c-82d6-af3982aa3b83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:18.423620 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea4783-ff03-482c-82d6-af3982aa3b83 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:18.558394 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:18.563378 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 81/154] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:18.569127 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace74c94-3f88-4b9a-a2a3-947a01744de6 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:18.679824 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace74c94-3f88-4b9a-a2a3-947a01744de6 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:18.729696 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ee27c-9cd7-474a-983b-3b57550ba7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:18.730345 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ee27c-9cd7-474a-983b-3b57550ba7db None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:18.730630 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ee27c-9cd7-474a-983b-3b57550ba7db None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:18.730907 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ee27c-9cd7-474a-983b-3b57550ba7db None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:18.732061 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ee27c-9cd7-474a-983b-3b57550ba7db None admin] RBAC: Authorizing `identity:get_project(project_id=96630a4e703341619588eb5481011618)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:18.733556 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ee27c-9cd7-474a-983b-3b57550ba7db None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:18.735203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 74/155] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:18 2022] GET /identity/v3/projects/96630a4e703341619588eb5481011618 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:18.741334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea4783-ff03-482c-82d6-af3982aa3b83 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:18.893049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea4783-ff03-482c-82d6-af3982aa3b83 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:18.938099 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658dc7a-2e9b-4cb4-ac34-855fad549a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:18.938718 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658dc7a-2e9b-4cb4-ac34-855fad549a0c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:18.939003 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658dc7a-2e9b-4cb4-ac34-855fad549a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:18.939278 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658dc7a-2e9b-4cb4-ac34-855fad549a0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:18.940018 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658dc7a-2e9b-4cb4-ac34-855fad549a0c None admin] RBAC: Adding query filter params (role.id=dbb1f67486534e8dbbc250bfe0978e6c, scope.project.id=96630a4e703341619588eb5481011618, user.id=58534463aeb44a27b394cd1dc1a1454a) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:18.940332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658dc7a-2e9b-4cb4-ac34-855fad549a0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:18.941813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658dc7a-2e9b-4cb4-ac34-855fad549a0c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:18.953862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 82/156] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:17:18 2022] GET /identity/v3/role_assignments?user.id=58534463aeb44a27b394cd1dc1a1454a&scope.project.id=96630a4e703341619588eb5481011618&role.id=dbb1f67486534e8dbbc250bfe0978e6c => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:19.247586 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca460925-8aba-49b7-8b2d-1c1ed9c72228 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:19.248252 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca460925-8aba-49b7-8b2d-1c1ed9c72228 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:19.248771 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca460925-8aba-49b7-8b2d-1c1ed9c72228 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:19.250333 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 75/157] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:19.272017 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fde8fb-50e0-48e1-a3ca-d1f9b20ddfe6 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:19.272508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fde8fb-50e0-48e1-a3ca-d1f9b20ddfe6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:19.273020 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fde8fb-50e0-48e1-a3ca-d1f9b20ddfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:19.313699 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-69fde8fb-50e0-48e1-a3ca-d1f9b20ddfe6 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:19.315734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-69fde8fb-50e0-48e1-a3ca-d1f9b20ddfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:19.338456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006cf4f6-7998-4ee8-a79b-3b821712942f None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:19.339115 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006cf4f6-7998-4ee8-a79b-3b821712942f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:19.339606 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006cf4f6-7998-4ee8-a79b-3b821712942f None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:19.341215 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 76/158] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:17:19.350526 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11725786-ccdc-4fb2-bc5c-22ad3abf4640 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:19.351140 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11725786-ccdc-4fb2-bc5c-22ad3abf4640 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:19.351617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11725786-ccdc-4fb2-bc5c-22ad3abf4640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:19.367892 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:19.389396 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-11725786-ccdc-4fb2-bc5c-22ad3abf4640 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:19.390942 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-11725786-ccdc-4fb2-bc5c-22ad3abf4640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:19.478947 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:19.506501 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 83/159] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:19.525916 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 77/160] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:20.087072 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fde8fb-50e0-48e1-a3ca-d1f9b20ddfe6 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:20.100766 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11725786-ccdc-4fb2-bc5c-22ad3abf4640 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:20.327877 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fde8fb-50e0-48e1-a3ca-d1f9b20ddfe6 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:20.372753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11725786-ccdc-4fb2-bc5c-22ad3abf4640 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:20.431502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1006c-c166-407a-97bf-71688326ae70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:20.432530 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1006c-c166-407a-97bf-71688326ae70 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:20.433071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1006c-c166-407a-97bf-71688326ae70 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:20.433545 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1006c-c166-407a-97bf-71688326ae70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:20.461756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1006c-c166-407a-97bf-71688326ae70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:20.467478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-52f1006c-c166-407a-97bf-71688326ae70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:17:20.467478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:20.467478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:20.467478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:20.467478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:20.467478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:20.467478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:20.467478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:20.467478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:20.467478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:20.467478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:20.467478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:20.467478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:20.467478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:20.467478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:20.467478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:20.468391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:20.468391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:20.468391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:20.468391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:20.468391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:20.468391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:20.468391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:20.468391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:20.468391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:20.468391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:20.468391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:20.468391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:20.468391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:20.468391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:20.468391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:20.468391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:20.469195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:20.469195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:20.469195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:20.469195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:20.469195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:20.469195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:20.469195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:20.469195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:20.469195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:20.469195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:20.469195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:17:20.469195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:20.472893 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24aedee-5a01-4076-a284-c500b3c6a1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:20.480712 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24aedee-5a01-4076-a284-c500b3c6a1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:20.481463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24aedee-5a01-4076-a284-c500b3c6a1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:20.481965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24aedee-5a01-4076-a284-c500b3c6a1c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:20.483886 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 84/161] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:17:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:20.485563 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceea45b-17a9-4dc7-bd84-c44f7c808fcf None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:20.491518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceea45b-17a9-4dc7-bd84-c44f7c808fcf None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:20.492125 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceea45b-17a9-4dc7-bd84-c44f7c808fcf None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:20.493237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:20.493784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 85/162] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:20.506796 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24aedee-5a01-4076-a284-c500b3c6a1c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:20.511901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-a24aedee-5a01-4076-a284-c500b3c6a1c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:20.511901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:20.511901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:20.511901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:20.511901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:20.511901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:20.511901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:20.511901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:20.511901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:20.511901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:20.511901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:20.511901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:20.511901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:20.511901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:20.511901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:20.511901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:20.513257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:20.513257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:20.513257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:20.513257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:20.513257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:20.513257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:20.513257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:20.513257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:20.513257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:20.513257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:20.513257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:20.513257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:20.513257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:20.513257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:20.513257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:20.513257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:20.514544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:20.514544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:20.514544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:20.514544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:20.514544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:20.514544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:20.514544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:20.514544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:20.514544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:20.514544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:20.514544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:20.514544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:20.522521 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbe489-7411-40f0-981c-0731b429b751 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:20.522800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbe489-7411-40f0-981c-0731b429b751 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:20.523071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbe489-7411-40f0-981c-0731b429b751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:20.527070 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 78/163] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:17:20.528675 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24aedee-5a01-4076-a284-c500b3c6a1c3 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:20.565066 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-82cbe489-7411-40f0-981c-0731b429b751 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:20.566588 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-82cbe489-7411-40f0-981c-0731b429b751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:20.706562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 86/164] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:20.706995 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:20.709260 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbe489-7411-40f0-981c-0731b429b751 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:20.778665 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24aedee-5a01-4076-a284-c500b3c6a1c3 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:20.815949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c22d61-3b00-4199-a8d6-bf1384715639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:20.816566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c22d61-3b00-4199-a8d6-bf1384715639 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:20.816891 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c22d61-3b00-4199-a8d6-bf1384715639 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:20.817167 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c22d61-3b00-4199-a8d6-bf1384715639 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:20.818146 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c22d61-3b00-4199-a8d6-bf1384715639 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:20.818455 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c22d61-3b00-4199-a8d6-bf1384715639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:20.819924 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c22d61-3b00-4199-a8d6-bf1384715639 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:20.829463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 79/165] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:20.830571 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52ba6e-54e1-4344-a6d1-7acaaa9502ec None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:20.830865 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52ba6e-54e1-4344-a6d1-7acaaa9502ec None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:20.831115 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52ba6e-54e1-4344-a6d1-7acaaa9502ec None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:20.832827 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 80/166] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:20.842396 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52ba6e-54e1-4344-a6d1-7acaaa9502ec None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:20.919903 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbe489-7411-40f0-981c-0731b429b751 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:20.933033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:20.996662 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119fbac-158d-4226-b8d3-b0b2be3b6fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:20.997243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119fbac-158d-4226-b8d3-b0b2be3b6fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:20.997528 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119fbac-158d-4226-b8d3-b0b2be3b6fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:20.997803 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119fbac-158d-4226-b8d3-b0b2be3b6fc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:20.998484 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119fbac-158d-4226-b8d3-b0b2be3b6fc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:20.998792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119fbac-158d-4226-b8d3-b0b2be3b6fc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:21.000203 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119fbac-158d-4226-b8d3-b0b2be3b6fc2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:21.005536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52ba6e-54e1-4344-a6d1-7acaaa9502ec None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:21.015228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 87/167] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:21.016647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae2d6b-c35c-41ae-82ae-783803187884 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:21.016966 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae2d6b-c35c-41ae-82ae-783803187884 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:21.021910 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae2d6b-c35c-41ae-82ae-783803187884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:21.061705 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f7ae2d6b-c35c-41ae-82ae-783803187884 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:21.062928 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f7ae2d6b-c35c-41ae-82ae-783803187884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:21.066743 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce44c1-c3d7-4e5c-a2a9-5faf710c1312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:21.067449 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce44c1-c3d7-4e5c-a2a9-5faf710c1312 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:21.067838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce44c1-c3d7-4e5c-a2a9-5faf710c1312 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:21.068314 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce44c1-c3d7-4e5c-a2a9-5faf710c1312 None admin] PATH_INFO: `/v3/users/8e583097bf7c4097a82fd7d436d1c78d` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:21.073409 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce44c1-c3d7-4e5c-a2a9-5faf710c1312 None admin] RBAC: Authorizing `identity:get_user(user_id=8e583097bf7c4097a82fd7d436d1c78d)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:21.074887 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce44c1-c3d7-4e5c-a2a9-5faf710c1312 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:21.076670 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 81/168] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:20 2022] GET /identity/v3/users/8e583097bf7c4097a82fd7d436d1c78d => generated 247 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:21.077301 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce44c1-c3d7-4e5c-a2a9-5faf710c1312 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:21.142863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:21.209328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 88/169] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:21.210644 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae2d6b-c35c-41ae-82ae-783803187884 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:21.231652 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce44c1-c3d7-4e5c-a2a9-5faf710c1312 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:21.275259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:21.297918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42710245-47ef-4c70-be72-580ffc88f1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:21.298627 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42710245-47ef-4c70-be72-580ffc88f1aa None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:21.298909 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42710245-47ef-4c70-be72-580ffc88f1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:21.299236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42710245-47ef-4c70-be72-580ffc88f1aa None admin] PATH_INFO: `/v3/users/58534463aeb44a27b394cd1dc1a1454a` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:21.301568 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42710245-47ef-4c70-be72-580ffc88f1aa None admin] RBAC: Authorizing `identity:get_user(user_id=58534463aeb44a27b394cd1dc1a1454a)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:21.305274 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42710245-47ef-4c70-be72-580ffc88f1aa None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:21.311003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 82/170] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:21 2022] GET /identity/v3/users/58534463aeb44a27b394cd1dc1a1454a => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:21.311656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42710245-47ef-4c70-be72-580ffc88f1aa None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:21.378228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae2d6b-c35c-41ae-82ae-783803187884 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:21.415395 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badca0f2-2186-4733-a9f7-a4ed933b02f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:21.416018 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badca0f2-2186-4733-a9f7-a4ed933b02f7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:21.416301 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badca0f2-2186-4733-a9f7-a4ed933b02f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:21.416578 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badca0f2-2186-4733-a9f7-a4ed933b02f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:21.465196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:21.499337 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badca0f2-2186-4733-a9f7-a4ed933b02f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:21.502557 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badca0f2-2186-4733-a9f7-a4ed933b02f7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:21.549273 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42710245-47ef-4c70-be72-580ffc88f1aa None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:21.587234 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c2d01-3c17-415d-8762-bde1585ca2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:21.588227 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c2d01-3c17-415d-8762-bde1585ca2ed None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:21.588732 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c2d01-3c17-415d-8762-bde1585ca2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:21.589273 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c2d01-3c17-415d-8762-bde1585ca2ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:21.602195 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c2d01-3c17-415d-8762-bde1585ca2ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:21.608763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-200c2d01-3c17-415d-8762-bde1585ca2ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:21.608763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:21.608763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:21.608763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:21.608763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:21.608763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:21.608763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:21.608763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:21.608763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:21.608763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:21.608763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:21.608763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:21.608763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:21.608763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:21.608763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:21.608763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:21.609816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:21.609816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:21.609816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:21.609816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:21.609816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:21.609816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:21.609816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:21.609816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:21.609816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:21.609816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:21.609816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:21.609816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:21.609816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:21.609816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:21.609816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:21.609816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:21.610601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:21.610601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:21.610601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:21.610601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:21.610601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:21.610601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:21.610601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:21.610601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:21.610601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:21.610601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:21.610601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:21.610601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:21.610601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 83/171] 10.222.0.96 () {56 vars in 1114 bytes} [Wed Aug 24 04:17:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:21.611246 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dec93-d099-4c81-9f89-b3248b08c31a None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:21.611390 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dec93-d099-4c81-9f89-b3248b08c31a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:21.611998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dec93-d099-4c81-9f89-b3248b08c31a None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:21.613112 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 84/172] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:21.617500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35dec93-d099-4c81-9f89-b3248b08c31a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:21.644721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 89/173] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:21.644721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badca0f2-2186-4733-a9f7-a4ed933b02f7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:21.679195 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:21.720146 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:21.730122 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35dec93-d099-4c81-9f89-b3248b08c31a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:21.744986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badca0f2-2186-4733-a9f7-a4ed933b02f7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:21.764241 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27cb62-e150-434b-9580-3f621e9d9747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:21.764908 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27cb62-e150-434b-9580-3f621e9d9747 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:21.765195 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27cb62-e150-434b-9580-3f621e9d9747 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:21.765471 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27cb62-e150-434b-9580-3f621e9d9747 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:21.777987 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b464d-0813-4fd8-852b-3073f742915f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:21.778617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b464d-0813-4fd8-852b-3073f742915f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:21.778896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b464d-0813-4fd8-852b-3073f742915f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:21.779170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b464d-0813-4fd8-852b-3073f742915f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:21.789711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b464d-0813-4fd8-852b-3073f742915f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:21.794497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-570b464d-0813-4fd8-852b-3073f742915f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:17:21.794497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:21.794497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:21.794497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:21.794497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:21.794497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:21.794497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:21.794497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:21.794497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:21.794497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:21.794497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:21.794497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:21.794497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:21.794497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:21.794497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:21.794497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:21.795560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:21.795560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:21.795560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:21.795560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:21.795560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:21.795560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:21.795560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:21.795560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:21.795560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:21.795560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:21.795560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:21.795560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:21.795560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:21.795560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:21.795560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:21.795560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:21.796364 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:21.796364 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:21.796364 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:21.796364 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:21.796364 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:21.796364 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:21.796364 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:21.796364 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:21.796364 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:21.796364 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:21.796364 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:17:21.796364 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:21.796364 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 90/174] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:17:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:21.797233 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce04fc-5105-42a2-8cf8-e78dbc22345c None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:21.797535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce04fc-5105-42a2-8cf8-e78dbc22345c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:21.797770 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce04fc-5105-42a2-8cf8-e78dbc22345c None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:21.799011 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 91/175] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:21.799761 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce04fc-5105-42a2-8cf8-e78dbc22345c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:21.843783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27cb62-e150-434b-9580-3f621e9d9747 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:21.845327 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27cb62-e150-434b-9580-3f621e9d9747 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:21.897610 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:21.905866 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce04fc-5105-42a2-8cf8-e78dbc22345c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:21.941603 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571f502-a25e-4666-8d34-2d76b136007e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:21.942214 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571f502-a25e-4666-8d34-2d76b136007e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:21.942856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571f502-a25e-4666-8d34-2d76b136007e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:21.943134 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571f502-a25e-4666-8d34-2d76b136007e None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:21.943806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571f502-a25e-4666-8d34-2d76b136007e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:21.944121 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571f502-a25e-4666-8d34-2d76b136007e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:21.945822 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571f502-a25e-4666-8d34-2d76b136007e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:21.947503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 85/176] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:21.948763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8c84d-9592-41cf-acd2-aa9478158aaf None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:21.949105 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8c84d-9592-41cf-acd2-aa9478158aaf None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:21.949381 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8c84d-9592-41cf-acd2-aa9478158aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:21.954008 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:21.955676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 92/177] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:17:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:21.956941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571f502-a25e-4666-8d34-2d76b136007e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:21.969037 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-5df8c84d-9592-41cf-acd2-aa9478158aaf None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:21.970259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5df8c84d-9592-41cf-acd2-aa9478158aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:22.038001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 86/178] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:22.056947 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf99414-e2d2-4f1c-8a91-7e24e2fd4917 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:22.056947 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf99414-e2d2-4f1c-8a91-7e24e2fd4917 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:22.056947 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf99414-e2d2-4f1c-8a91-7e24e2fd4917 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:22.056947 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 87/179] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:22.056947 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf99414-e2d2-4f1c-8a91-7e24e2fd4917 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:22.077784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571f502-a25e-4666-8d34-2d76b136007e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:22.111876 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240e224-52e3-4887-b600-2e3fd531d692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:22.112506 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240e224-52e3-4887-b600-2e3fd531d692 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:22.112817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240e224-52e3-4887-b600-2e3fd531d692 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:22.113090 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240e224-52e3-4887-b600-2e3fd531d692 None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:22.114199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240e224-52e3-4887-b600-2e3fd531d692 None admin] RBAC: Authorizing `identity:get_project(project_id=96630a4e703341619588eb5481011618)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:22.115739 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240e224-52e3-4887-b600-2e3fd531d692 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:22.117403 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 93/180] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:21 2022] GET /identity/v3/projects/96630a4e703341619588eb5481011618 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:22.124116 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed64b6-e3e3-4699-a87b-4e5610d888db None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:22.124403 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed64b6-e3e3-4699-a87b-4e5610d888db None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:22.124701 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed64b6-e3e3-4699-a87b-4e5610d888db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:22.139102 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:22.146491 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-78ed64b6-e3e3-4699-a87b-4e5610d888db None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:22.147702 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-78ed64b6-e3e3-4699-a87b-4e5610d888db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:22.162225 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf99414-e2d2-4f1c-8a91-7e24e2fd4917 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:22.199790 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cc51a-bd1c-441b-8bdc-d55f52359104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:22.200407 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cc51a-bd1c-441b-8bdc-d55f52359104 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:22.200713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cc51a-bd1c-441b-8bdc-d55f52359104 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:22.200994 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cc51a-bd1c-441b-8bdc-d55f52359104 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:22.201674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4cc51a-bd1c-441b-8bdc-d55f52359104 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:22.202005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4cc51a-bd1c-441b-8bdc-d55f52359104 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:22.203365 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4cc51a-bd1c-441b-8bdc-d55f52359104 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:22.211201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:22.214582 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 88/181] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:22.215719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cc51a-bd1c-441b-8bdc-d55f52359104 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:22.226873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 94/182] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:22.226873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed64b6-e3e3-4699-a87b-4e5610d888db None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:22.345323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cc51a-bd1c-441b-8bdc-d55f52359104 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:22.353548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed64b6-e3e3-4699-a87b-4e5610d888db None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:22.383177 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0309e-d039-4c24-8b09-5438469eb22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:22.383930 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0309e-d039-4c24-8b09-5438469eb22c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:22.384215 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0309e-d039-4c24-8b09-5438469eb22c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:22.384501 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0309e-d039-4c24-8b09-5438469eb22c None admin] PATH_INFO: `/v3/projects/230fc1d603fd4af1ae972b35b3793dbc` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:22.385799 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0309e-d039-4c24-8b09-5438469eb22c None admin] RBAC: Authorizing `identity:get_project(project_id=230fc1d603fd4af1ae972b35b3793dbc)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:22.387252 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0309e-d039-4c24-8b09-5438469eb22c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:22.388560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca53245-af40-4250-a128-3a861c80b9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:22.393886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 89/183] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:22 2022] GET /identity/v3/projects/230fc1d603fd4af1ae972b35b3793dbc => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:22.394030 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca53245-af40-4250-a128-3a861c80b9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:22.394030 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca53245-af40-4250-a128-3a861c80b9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:22.394030 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca53245-af40-4250-a128-3a861c80b9c1 None admin] PATH_INFO: `/v3/users/58534463aeb44a27b394cd1dc1a1454a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:22.394273 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd743935-9524-467e-a058-f735c6a3180c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:22.394273 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd743935-9524-467e-a058-f735c6a3180c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:22.394273 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd743935-9524-467e-a058-f735c6a3180c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:22.395294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca53245-af40-4250-a128-3a861c80b9c1 None admin] RBAC: Authorizing `identity:get_user(user_id=58534463aeb44a27b394cd1dc1a1454a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:22.397539 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca53245-af40-4250-a128-3a861c80b9c1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:22.403727 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 95/184] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:22 2022] GET /identity/v3/users/58534463aeb44a27b394cd1dc1a1454a => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:22.403727 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca53245-af40-4250-a128-3a861c80b9c1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:22.416481 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-fd743935-9524-467e-a058-f735c6a3180c None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:22.417737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-fd743935-9524-467e-a058-f735c6a3180c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:22.425977 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:22.477063 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:22.501183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 90/185] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:22.502054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd743935-9524-467e-a058-f735c6a3180c None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:22.531778 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca53245-af40-4250-a128-3a861c80b9c1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:22.576778 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a285945-4785-4fec-baae-a1caf7e838c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:22.577758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a285945-4785-4fec-baae-a1caf7e838c9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:22.578255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a285945-4785-4fec-baae-a1caf7e838c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:22.578738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a285945-4785-4fec-baae-a1caf7e838c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:22.579543 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a285945-4785-4fec-baae-a1caf7e838c9 None admin] RBAC: Adding query filter params (role.id=059d2bf5bb8e42939f5f826bfdad6a21, scope.project.id=96630a4e703341619588eb5481011618, user.id=8e583097bf7c4097a82fd7d436d1c78d) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:22.579927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a285945-4785-4fec-baae-a1caf7e838c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:22.581588 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a285945-4785-4fec-baae-a1caf7e838c9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:22.589075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 96/186] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:17:22 2022] GET /identity/v3/role_assignments?user.id=8e583097bf7c4097a82fd7d436d1c78d&scope.project.id=96630a4e703341619588eb5481011618&role.id=059d2bf5bb8e42939f5f826bfdad6a21 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:22.589616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a285945-4785-4fec-baae-a1caf7e838c9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:22.648800 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd743935-9524-467e-a058-f735c6a3180c None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:22.718478 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443f8a6-c243-4f8c-a876-b16dc55029ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:22.719154 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443f8a6-c243-4f8c-a876-b16dc55029ee None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:22.719437 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443f8a6-c243-4f8c-a876-b16dc55029ee None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:22.719713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443f8a6-c243-4f8c-a876-b16dc55029ee None admin] PATH_INFO: `/v3/users/edc251576703482fa3a883032c195c5a` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:22.745290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:22.747948 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443f8a6-c243-4f8c-a876-b16dc55029ee None admin] RBAC: Authorizing `identity:get_user(user_id=edc251576703482fa3a883032c195c5a)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:22.750545 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443f8a6-c243-4f8c-a876-b16dc55029ee None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:22.753732 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 91/187] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:22 2022] GET /identity/v3/users/edc251576703482fa3a883032c195c5a => generated 283 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:22.756108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443f8a6-c243-4f8c-a876-b16dc55029ee None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:22.805838 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a285945-4785-4fec-baae-a1caf7e838c9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:22.850281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:22.856668 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed4b5d-e7e9-4991-9362-ed40c112016b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:22.857365 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed4b5d-e7e9-4991-9362-ed40c112016b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:22.857648 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed4b5d-e7e9-4991-9362-ed40c112016b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:22.857929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed4b5d-e7e9-4991-9362-ed40c112016b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:22.859485 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed4b5d-e7e9-4991-9362-ed40c112016b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:22.860812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed4b5d-e7e9-4991-9362-ed40c112016b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:22.862559 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 97/188] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:17:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:22.863296 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed4b5d-e7e9-4991-9362-ed40c112016b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:22.903708 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443f8a6-c243-4f8c-a876-b16dc55029ee None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:22.940976 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84179f7a-0ec4-4f9b-9b82-29cbd9e14ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:22.942239 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84179f7a-0ec4-4f9b-9b82-29cbd9e14ebb None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:22.943088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84179f7a-0ec4-4f9b-9b82-29cbd9e14ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:22.943458 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84179f7a-0ec4-4f9b-9b82-29cbd9e14ebb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:22.944144 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84179f7a-0ec4-4f9b-9b82-29cbd9e14ebb None admin] RBAC: Adding query filter params (role.id=dbb1f67486534e8dbbc250bfe0978e6c, scope.project.id=230fc1d603fd4af1ae972b35b3793dbc, user.id=58534463aeb44a27b394cd1dc1a1454a) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:22.944457 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84179f7a-0ec4-4f9b-9b82-29cbd9e14ebb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:22.946217 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84179f7a-0ec4-4f9b-9b82-29cbd9e14ebb None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:22.952140 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 92/189] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:17:22 2022] GET /identity/v3/role_assignments?user.id=58534463aeb44a27b394cd1dc1a1454a&scope.project.id=230fc1d603fd4af1ae972b35b3793dbc&role.id=dbb1f67486534e8dbbc250bfe0978e6c => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:22.952967 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84179f7a-0ec4-4f9b-9b82-29cbd9e14ebb None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:22.982307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed4b5d-e7e9-4991-9362-ed40c112016b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:23.021737 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36208355-070b-4c4a-a00b-60eaaa8f9e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:23.022319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:23.022500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36208355-070b-4c4a-a00b-60eaaa8f9e9f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:23.022794 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36208355-070b-4c4a-a00b-60eaaa8f9e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:23.023075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36208355-070b-4c4a-a00b-60eaaa8f9e9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:23.070388 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84179f7a-0ec4-4f9b-9b82-29cbd9e14ebb None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:23.095831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:23.104916 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36208355-070b-4c4a-a00b-60eaaa8f9e9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:23.106422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36208355-070b-4c4a-a00b-60eaaa8f9e9f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:23.111907 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c7fac-7443-4098-bca7-374e142a865f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:23.112560 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c7fac-7443-4098-bca7-374e142a865f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:23.112884 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c7fac-7443-4098-bca7-374e142a865f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:23.113162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c7fac-7443-4098-bca7-374e142a865f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:23.125895 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c7fac-7443-4098-bca7-374e142a865f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:23.131255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-fb6c7fac-7443-4098-bca7-374e142a865f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:23.131255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:23.131255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:23.131255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:23.131255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:23.131255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:23.131255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:23.131255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:23.131255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:23.131255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:23.131255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:23.131255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:23.131255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:23.131255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:23.131255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:23.131255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:23.132135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:23.132135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:23.132135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:23.132135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:23.132135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:23.132135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:23.132135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:23.132135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:23.132135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:23.132135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:23.132135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:23.132135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:23.132135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:23.132135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:23.132135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:23.132135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:23.132987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:23.132987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:23.132987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:23.132987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:23.132987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:23.132987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:23.132987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:23.132987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:23.132987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:23.132987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:23.132987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:23.132987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:23.132987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 93/190] 10.222.0.96 () {56 vars in 1114 bytes} [Wed Aug 24 04:17:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:23.133633 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c7fac-7443-4098-bca7-374e142a865f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:23.221163 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 98/191] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:23.221163 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36208355-070b-4c4a-a00b-60eaaa8f9e9f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:23.245856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c7fac-7443-4098-bca7-374e142a865f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:23.269297 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:23.280662 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e9998-60fe-4fdf-8653-dd4df2b426eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:23.281294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e9998-60fe-4fdf-8653-dd4df2b426eb None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:23.281577 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e9998-60fe-4fdf-8653-dd4df2b426eb None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:23.281854 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e9998-60fe-4fdf-8653-dd4df2b426eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:23.312888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:23.319721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36208355-070b-4c4a-a00b-60eaaa8f9e9f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:23.351653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e9998-60fe-4fdf-8653-dd4df2b426eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:23.352851 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70773016-658b-4353-860c-fd6653fd1026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:23.353172 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e9998-60fe-4fdf-8653-dd4df2b426eb None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:23.353489 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70773016-658b-4353-860c-fd6653fd1026 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:23.353771 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70773016-658b-4353-860c-fd6653fd1026 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:23.354046 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70773016-658b-4353-860c-fd6653fd1026 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:23.364815 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70773016-658b-4353-860c-fd6653fd1026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:23.369800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-70773016-658b-4353-860c-fd6653fd1026 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:17:23.369800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:23.369800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:23.369800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:23.369800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:23.369800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:23.369800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:23.369800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:23.369800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:23.369800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:23.369800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:23.369800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:23.369800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:23.369800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:23.369800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:23.369800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:23.370698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:23.370698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:23.370698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:23.370698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:23.370698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:23.370698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:23.370698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:23.370698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:23.370698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:23.370698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:23.370698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:23.370698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:23.370698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:23.370698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:23.370698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:23.370698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:23.373332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:23.373332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:23.373332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:23.373332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:23.373332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:23.373332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:23.373332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:23.373332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:23.373332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:23.373332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:23.373332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:17:23.373332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:23.373332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 99/192] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:23.373332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70773016-658b-4353-860c-fd6653fd1026 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:23.454713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 94/193] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:23.454713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e9998-60fe-4fdf-8653-dd4df2b426eb None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:23.470955 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70773016-658b-4353-860c-fd6653fd1026 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:23.480210 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:23.507283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3da3b-e529-4c9d-bcc0-42b1d32a13f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:23.507889 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3da3b-e529-4c9d-bcc0-42b1d32a13f8 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:23.508174 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3da3b-e529-4c9d-bcc0-42b1d32a13f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:23.508445 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3da3b-e529-4c9d-bcc0-42b1d32a13f8 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:23.509121 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3da3b-e529-4c9d-bcc0-42b1d32a13f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:23.510581 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3da3b-e529-4c9d-bcc0-42b1d32a13f8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:23.531522 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 100/194] 10.222.0.96 () {60 vars in 1132 bytes} [Wed Aug 24 04:17:23 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:17:23.532350 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3da3b-e529-4c9d-bcc0-42b1d32a13f8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:23.550237 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:23.569819 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e9998-60fe-4fdf-8653-dd4df2b426eb None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:23.610643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ab699-6b17-4837-b4e1-a19b78812b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:23.611275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ab699-6b17-4837-b4e1-a19b78812b75 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:23.611554 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ab699-6b17-4837-b4e1-a19b78812b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:23.611947 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ab699-6b17-4837-b4e1-a19b78812b75 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:23.612636 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ab699-6b17-4837-b4e1-a19b78812b75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:23.613093 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ab699-6b17-4837-b4e1-a19b78812b75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:23.615177 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ab699-6b17-4837-b4e1-a19b78812b75 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:23.625995 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 95/195] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:17:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:23.632929 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ab699-6b17-4837-b4e1-a19b78812b75 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:23.658416 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3da3b-e529-4c9d-bcc0-42b1d32a13f8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:23.697326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb623eb-5643-4f41-a895-c22caa7cb10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:23.698021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb623eb-5643-4f41-a895-c22caa7cb10b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:23.698305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb623eb-5643-4f41-a895-c22caa7cb10b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:23.698605 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb623eb-5643-4f41-a895-c22caa7cb10b None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:23.699819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb623eb-5643-4f41-a895-c22caa7cb10b None admin] RBAC: Authorizing `identity:get_project(project_id=96630a4e703341619588eb5481011618)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:23.701381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb623eb-5643-4f41-a895-c22caa7cb10b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:23.703351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 101/196] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:23 2022] GET /identity/v3/projects/96630a4e703341619588eb5481011618 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:23.703963 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb623eb-5643-4f41-a895-c22caa7cb10b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:23.738061 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:23.759112 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ab699-6b17-4837-b4e1-a19b78812b75 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:23.806095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1c0e3-b383-4d79-bbb7-b58fc92b438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:23.806724 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1c0e3-b383-4d79-bbb7-b58fc92b438c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:23.807007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1c0e3-b383-4d79-bbb7-b58fc92b438c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:23.807285 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1c0e3-b383-4d79-bbb7-b58fc92b438c None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:23.808153 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1c0e3-b383-4d79-bbb7-b58fc92b438c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:23.808586 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1c0e3-b383-4d79-bbb7-b58fc92b438c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:23.810550 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1c0e3-b383-4d79-bbb7-b58fc92b438c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:23.813048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:23.822121 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 96/197] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:23.823692 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1c0e3-b383-4d79-bbb7-b58fc92b438c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:23.841263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb623eb-5643-4f41-a895-c22caa7cb10b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:23.881707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b09578-5219-4591-83a6-67a444c66b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:23.882349 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b09578-5219-4591-83a6-67a444c66b5a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:23.882630 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b09578-5219-4591-83a6-67a444c66b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:23.882900 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b09578-5219-4591-83a6-67a444c66b5a None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:23.884041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b09578-5219-4591-83a6-67a444c66b5a None admin] RBAC: Authorizing `identity:get_project(project_id=131c2da412c94e35868fe9dc21137199)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:23.885649 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b09578-5219-4591-83a6-67a444c66b5a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:23.887442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 102/198] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:23 2022] GET /identity/v3/projects/131c2da412c94e35868fe9dc21137199 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:23.888042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b09578-5219-4591-83a6-67a444c66b5a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:23.977463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1c0e3-b383-4d79-bbb7-b58fc92b438c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:24.009199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b09578-5219-4591-83a6-67a444c66b5a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:24.025907 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e600fd4-9936-4c35-a221-23aa330f8e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:24.027149 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e600fd4-9936-4c35-a221-23aa330f8e03 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:24.028056 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e600fd4-9936-4c35-a221-23aa330f8e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:24.028545 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e600fd4-9936-4c35-a221-23aa330f8e03 None admin] PATH_INFO: `/v3/users/edc251576703482fa3a883032c195c5a` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:24.029968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e600fd4-9936-4c35-a221-23aa330f8e03 None admin] RBAC: Authorizing `identity:get_user(user_id=edc251576703482fa3a883032c195c5a)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:24.032593 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e600fd4-9936-4c35-a221-23aa330f8e03 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:24.035641 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 97/199] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:23 2022] GET /identity/v3/users/edc251576703482fa3a883032c195c5a => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:24.037571 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e600fd4-9936-4c35-a221-23aa330f8e03 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:24.051612 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b2042-7a4b-44fb-b65d-0e530ea9c128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:24.052936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b2042-7a4b-44fb-b65d-0e530ea9c128 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:24.053305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b2042-7a4b-44fb-b65d-0e530ea9c128 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:24.053585 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b2042-7a4b-44fb-b65d-0e530ea9c128 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:24.054382 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b2042-7a4b-44fb-b65d-0e530ea9c128 None admin] RBAC: Adding query filter params (role.id=b78ed83a66fe4531900cc02bb745f80f, scope.project.id=96630a4e703341619588eb5481011618, user.id=58534463aeb44a27b394cd1dc1a1454a) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:24.054697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b2042-7a4b-44fb-b65d-0e530ea9c128 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:24.056267 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b2042-7a4b-44fb-b65d-0e530ea9c128 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:24.062535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 103/200] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:17:23 2022] GET /identity/v3/role_assignments?user.id=58534463aeb44a27b394cd1dc1a1454a&scope.project.id=96630a4e703341619588eb5481011618&role.id=b78ed83a66fe4531900cc02bb745f80f => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:24.063341 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b2042-7a4b-44fb-b65d-0e530ea9c128 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:24.066270 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:24.087752 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:24.211345 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b2042-7a4b-44fb-b65d-0e530ea9c128 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:24.234998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e600fd4-9936-4c35-a221-23aa330f8e03 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:24.278207 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fa668-657e-4d94-bba2-d9334ae669c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:24.278787 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fa668-657e-4d94-bba2-d9334ae669c7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:24.279026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fa668-657e-4d94-bba2-d9334ae669c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:24.279311 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fa668-657e-4d94-bba2-d9334ae669c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:24.280173 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fa668-657e-4d94-bba2-d9334ae669c7 None admin] RBAC: Adding query filter params (role.id=059d2bf5bb8e42939f5f826bfdad6a21, scope.project.id=131c2da412c94e35868fe9dc21137199, user.id=edc251576703482fa3a883032c195c5a) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:24.280368 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fa668-657e-4d94-bba2-d9334ae669c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:24.283154 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fa668-657e-4d94-bba2-d9334ae669c7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:24.292157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 104/201] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:17:24 2022] GET /identity/v3/role_assignments?user.id=edc251576703482fa3a883032c195c5a&scope.project.id=131c2da412c94e35868fe9dc21137199&role.id=059d2bf5bb8e42939f5f826bfdad6a21 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:24.295889 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc3893-f0a8-45e7-b0eb-8aeab004598a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:24.295889 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc3893-f0a8-45e7-b0eb-8aeab004598a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:24.295889 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc3893-f0a8-45e7-b0eb-8aeab004598a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:24.295889 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc3893-f0a8-45e7-b0eb-8aeab004598a None admin] PATH_INFO: `/v3/users/2606599901134439bc33d4b07596c2c9` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:24.296232 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fa668-657e-4d94-bba2-d9334ae669c7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:24.297442 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc3893-f0a8-45e7-b0eb-8aeab004598a None admin] RBAC: Authorizing `identity:get_user(user_id=2606599901134439bc33d4b07596c2c9)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:24.298942 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc3893-f0a8-45e7-b0eb-8aeab004598a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:24.300658 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 98/202] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:24 2022] GET /identity/v3/users/2606599901134439bc33d4b07596c2c9 => generated 289 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:24.318203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc3893-f0a8-45e7-b0eb-8aeab004598a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:24.465573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:24.484674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:24.497779 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc3893-f0a8-45e7-b0eb-8aeab004598a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:24.533602 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fa668-657e-4d94-bba2-d9334ae669c7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:24.571351 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752fe9e-dc07-4d19-ba9f-f4390da39552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:24.572937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752fe9e-dc07-4d19-ba9f-f4390da39552 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:24.573222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752fe9e-dc07-4d19-ba9f-f4390da39552 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:24.573493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752fe9e-dc07-4d19-ba9f-f4390da39552 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:24.595345 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6cdf4-1318-466e-a7dc-bf52aa76aa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:24.595970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6cdf4-1318-466e-a7dc-bf52aa76aa58 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:24.596250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6cdf4-1318-466e-a7dc-bf52aa76aa58 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:24.596524 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6cdf4-1318-466e-a7dc-bf52aa76aa58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:24.699106 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752fe9e-dc07-4d19-ba9f-f4390da39552 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:24.700578 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752fe9e-dc07-4d19-ba9f-f4390da39552 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:24.725099 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6cdf4-1318-466e-a7dc-bf52aa76aa58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:24.726730 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6cdf4-1318-466e-a7dc-bf52aa76aa58 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:24.865883 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:24.872908 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:24.887899 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 105/203] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:24.894009 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6cdf4-1318-466e-a7dc-bf52aa76aa58 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:24.915697 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 99/204] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:24.929286 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752fe9e-dc07-4d19-ba9f-f4390da39552 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:25.013259 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6cdf4-1318-466e-a7dc-bf52aa76aa58 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:25.088241 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67992b4d-933a-40db-a5fa-744fce3688a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:25.088828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67992b4d-933a-40db-a5fa-744fce3688a8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:25.089113 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67992b4d-933a-40db-a5fa-744fce3688a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:25.089390 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67992b4d-933a-40db-a5fa-744fce3688a8 None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:25.091827 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67992b4d-933a-40db-a5fa-744fce3688a8 None admin] RBAC: Authorizing `identity:get_project(project_id=131c2da412c94e35868fe9dc21137199)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:25.093323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67992b4d-933a-40db-a5fa-744fce3688a8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:25.098200 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 106/205] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:24 2022] GET /identity/v3/projects/131c2da412c94e35868fe9dc21137199 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:25.105850 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67992b4d-933a-40db-a5fa-744fce3688a8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:25.139491 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752fe9e-dc07-4d19-ba9f-f4390da39552 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:25.191899 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:25.213477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bd22f-fb0c-42e8-be59-0d13f979b94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:25.214129 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bd22f-fb0c-42e8-be59-0d13f979b94a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:25.214411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bd22f-fb0c-42e8-be59-0d13f979b94a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:25.214689 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bd22f-fb0c-42e8-be59-0d13f979b94a None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:25.216543 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5bd22f-fb0c-42e8-be59-0d13f979b94a None admin] RBAC: Authorizing `identity:get_project(project_id=96630a4e703341619588eb5481011618)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:25.218151 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5bd22f-fb0c-42e8-be59-0d13f979b94a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:25.228139 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 100/206] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:24 2022] GET /identity/v3/projects/96630a4e703341619588eb5481011618 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:25.229767 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bd22f-fb0c-42e8-be59-0d13f979b94a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:25.298569 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67992b4d-933a-40db-a5fa-744fce3688a8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:25.353125 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:25.362491 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6c61b-8381-4a1a-9600-3843b481a2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:25.364823 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6c61b-8381-4a1a-9600-3843b481a2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:25.364823 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6c61b-8381-4a1a-9600-3843b481a2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:25.364823 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6c61b-8381-4a1a-9600-3843b481a2d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:25.365059 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6c61b-8381-4a1a-9600-3843b481a2d7 None admin] RBAC: Adding query filter params (role.id=b78ed83a66fe4531900cc02bb745f80f, scope.project.id=131c2da412c94e35868fe9dc21137199, user.id=edc251576703482fa3a883032c195c5a) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:25.365257 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6c61b-8381-4a1a-9600-3843b481a2d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:25.367224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6c61b-8381-4a1a-9600-3843b481a2d7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:25.373313 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 107/207] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:17:25 2022] GET /identity/v3/role_assignments?user.id=edc251576703482fa3a883032c195c5a&scope.project.id=131c2da412c94e35868fe9dc21137199&role.id=b78ed83a66fe4531900cc02bb745f80f => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:25.456496 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bd22f-fb0c-42e8-be59-0d13f979b94a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:25.510538 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a639e52-5b1d-4144-837d-15c79c40e014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:25.511182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a639e52-5b1d-4144-837d-15c79c40e014 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:25.511454 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a639e52-5b1d-4144-837d-15c79c40e014 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:25.511736 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a639e52-5b1d-4144-837d-15c79c40e014 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:25.512514 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a639e52-5b1d-4144-837d-15c79c40e014 None admin] RBAC: Adding query filter params (role.id=19ca99e30fa74961a6203a02a8317128, scope.project.id=96630a4e703341619588eb5481011618, user.id=2606599901134439bc33d4b07596c2c9) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:25.512836 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a639e52-5b1d-4144-837d-15c79c40e014 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:25.514333 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a639e52-5b1d-4144-837d-15c79c40e014 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:25.521638 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 101/208] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:17:25 2022] GET /identity/v3/role_assignments?user.id=2606599901134439bc33d4b07596c2c9&scope.project.id=96630a4e703341619588eb5481011618&role.id=19ca99e30fa74961a6203a02a8317128 => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:25.784974 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d82b09-2dcc-4817-a375-ec9b701071ce None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:25.785309 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d82b09-2dcc-4817-a375-ec9b701071ce None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:25.785490 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d82b09-2dcc-4817-a375-ec9b701071ce None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:25.787506 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 108/209] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:25.792963 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d5db4-78be-48ef-8e48-c54e47482853 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:25.793255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d5db4-78be-48ef-8e48-c54e47482853 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:25.793662 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d5db4-78be-48ef-8e48-c54e47482853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:25.813538 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-753d5db4-78be-48ef-8e48-c54e47482853 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:25.814794 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-753d5db4-78be-48ef-8e48-c54e47482853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:25.894838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 102/210] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:26.006181 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f3ee3-e23d-4144-8186-e7ed34d3b61f None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:26.006497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f3ee3-e23d-4144-8186-e7ed34d3b61f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:26.006747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f3ee3-e23d-4144-8186-e7ed34d3b61f None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:26.008414 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 109/211] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:26.014314 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e2b35-8e06-4d9f-bc58-9517fc385ca7 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:26.014611 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e2b35-8e06-4d9f-bc58-9517fc385ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:26.014888 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e2b35-8e06-4d9f-bc58-9517fc385ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:26.034005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-b52e2b35-8e06-4d9f-bc58-9517fc385ca7 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:26.035244 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b52e2b35-8e06-4d9f-bc58-9517fc385ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:26.086174 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:26.113831 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 103/212] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:26.215565 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f3ee3-e23d-4144-8186-e7ed34d3b61f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:26.320973 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f3ee3-e23d-4144-8186-e7ed34d3b61f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:26.330356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:26.361033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bbd67-23ef-47f0-a738-c362aef45c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:26.361672 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bbd67-23ef-47f0-a738-c362aef45c9e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:26.361953 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bbd67-23ef-47f0-a738-c362aef45c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:26.362226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bbd67-23ef-47f0-a738-c362aef45c9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:26.363324 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777bbd67-23ef-47f0-a738-c362aef45c9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:26.365130 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777bbd67-23ef-47f0-a738-c362aef45c9e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:26.367057 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 110/213] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:17:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:26.372169 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e2b35-8e06-4d9f-bc58-9517fc385ca7 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:26.424412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bbd67-23ef-47f0-a738-c362aef45c9e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:26.484012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e2b35-8e06-4d9f-bc58-9517fc385ca7 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:26.530474 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3f3bc-dd11-4dc4-be5c-7be5a1da7e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:26.531958 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3f3bc-dd11-4dc4-be5c-7be5a1da7e1b None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:26.532812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3f3bc-dd11-4dc4-be5c-7be5a1da7e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:26.533284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3f3bc-dd11-4dc4-be5c-7be5a1da7e1b None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:26.534322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3f3bc-dd11-4dc4-be5c-7be5a1da7e1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:26.536442 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3f3bc-dd11-4dc4-be5c-7be5a1da7e1b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:26.555600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777bbd67-23ef-47f0-a738-c362aef45c9e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:26.562292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 104/214] 10.222.0.96 () {60 vars in 1132 bytes} [Wed Aug 24 04:17:26 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:17:26.564301 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e6582-829c-4669-8871-03234a048772 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:26.564790 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e6582-829c-4669-8871-03234a048772 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:26.565614 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e6582-829c-4669-8871-03234a048772 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:26.568501 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 105/215] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:26.578990 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54844b-eeff-4f08-a274-d73b07ad9768 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:26.579251 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54844b-eeff-4f08-a274-d73b07ad9768 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:26.579507 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54844b-eeff-4f08-a274-d73b07ad9768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:26.605672 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-3b54844b-eeff-4f08-a274-d73b07ad9768 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:26.607586 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3b54844b-eeff-4f08-a274-d73b07ad9768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:26.607737 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb72956-92e6-4262-8520-63ae54f3dec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:26.608274 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb72956-92e6-4262-8520-63ae54f3dec2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:26.608558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb72956-92e6-4262-8520-63ae54f3dec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:26.608871 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb72956-92e6-4262-8520-63ae54f3dec2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:26.630849 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb72956-92e6-4262-8520-63ae54f3dec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:26.637923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-ceb72956-92e6-4262-8520-63ae54f3dec2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:26.637923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:26.637923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:26.637923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:26.637923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:26.637923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:26.637923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:26.637923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:26.637923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:26.637923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:26.637923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:26.637923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:26.637923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:26.637923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:26.637923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:26.637923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:26.644560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:26.644560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:26.644560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:26.644560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:26.644560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:26.644560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:26.644560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:26.644560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:26.644560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:26.644560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:26.644560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:26.644560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:26.644560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:26.644560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:26.644560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:26.644560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:26.645423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:26.645423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:26.645423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:26.645423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:26.645423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:26.645423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:26.645423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:26.645423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:26.645423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:26.645423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:26.645423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:26.645423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:26.645423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 111/216] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:17:26.648492 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb72956-92e6-4262-8520-63ae54f3dec2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:26.652639 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:26.704266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:26.712903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 106/217] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:17:26.776107 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb72956-92e6-4262-8520-63ae54f3dec2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:26.812076 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f8917-1173-4061-a2b8-3b9d1ec7abd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:26.812721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f8917-1173-4061-a2b8-3b9d1ec7abd8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:26.813026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f8917-1173-4061-a2b8-3b9d1ec7abd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:26.813302 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f8917-1173-4061-a2b8-3b9d1ec7abd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:26.814043 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f8917-1173-4061-a2b8-3b9d1ec7abd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:26.814352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f8917-1173-4061-a2b8-3b9d1ec7abd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:26.815790 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f8917-1173-4061-a2b8-3b9d1ec7abd8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:26.827991 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 112/218] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:26.837191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54844b-eeff-4f08-a274-d73b07ad9768 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:26.950380 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54844b-eeff-4f08-a274-d73b07ad9768 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:26.987921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9278e-8a9c-4761-b995-6fb5cf25f019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:26.988566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9278e-8a9c-4761-b995-6fb5cf25f019 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:26.988884 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9278e-8a9c-4761-b995-6fb5cf25f019 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:26.989193 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9278e-8a9c-4761-b995-6fb5cf25f019 None admin] PATH_INFO: `/v3/users/4b55ed3766ad4af59e00c895b101b11c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:26.995060 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f8917-1173-4061-a2b8-3b9d1ec7abd8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:27.006145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9278e-8a9c-4761-b995-6fb5cf25f019 None admin] RBAC: Authorizing `identity:get_user(user_id=4b55ed3766ad4af59e00c895b101b11c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:27.007949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9278e-8a9c-4761-b995-6fb5cf25f019 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:27.010012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 107/219] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:26 2022] GET /identity/v3/users/4b55ed3766ad4af59e00c895b101b11c => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:27.015767 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9278e-8a9c-4761-b995-6fb5cf25f019 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:27.044656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:27.120296 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:27.124598 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f8917-1173-4061-a2b8-3b9d1ec7abd8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:27.148865 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9278e-8a9c-4761-b995-6fb5cf25f019 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:27.176615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7b09b-3dc2-493c-9e95-df7607577d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:27.178365 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7b09b-3dc2-493c-9e95-df7607577d61 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:27.178824 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7b09b-3dc2-493c-9e95-df7607577d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:27.179499 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7b09b-3dc2-493c-9e95-df7607577d61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:27.191618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c017a07-f839-4d51-91a7-e0e9461b5eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:27.192978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c017a07-f839-4d51-91a7-e0e9461b5eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:27.193411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c017a07-f839-4d51-91a7-e0e9461b5eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:27.193900 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c017a07-f839-4d51-91a7-e0e9461b5eb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:27.196192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7b09b-3dc2-493c-9e95-df7607577d61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:27.203189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-44c7b09b-3dc2-493c-9e95-df7607577d61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:17:27.203189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:27.203189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:27.203189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:27.203189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:27.203189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:27.203189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:27.203189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:27.203189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:27.203189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:27.203189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:27.203189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:27.203189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:27.203189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:27.203189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:27.203189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:27.204315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:27.204315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:27.204315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:27.204315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:27.204315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:27.204315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:27.204315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:27.204315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:27.204315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:27.204315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:27.204315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:27.204315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:27.204315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:27.204315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:27.204315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:27.204315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:27.205222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:27.205222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:27.205222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:27.205222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:27.205222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:27.205222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:27.205222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:27.205222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:27.205222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:27.205222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:27.205222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:17:27.205222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:27.206076 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 113/220] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:17:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:17:27.215541 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7b09b-3dc2-493c-9e95-df7607577d61 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:27.322737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c017a07-f839-4d51-91a7-e0e9461b5eb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:27.324207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c017a07-f839-4d51-91a7-e0e9461b5eb7 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:27.376915 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:27.386048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7b09b-3dc2-493c-9e95-df7607577d61 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:27.434077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b019c-c1b5-479c-b7d7-960e5097c982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:27.434714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b019c-c1b5-479c-b7d7-960e5097c982 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:27.435002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b019c-c1b5-479c-b7d7-960e5097c982 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:27.435283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b019c-c1b5-479c-b7d7-960e5097c982 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:27.435975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b019c-c1b5-479c-b7d7-960e5097c982 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:27.436283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b019c-c1b5-479c-b7d7-960e5097c982 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:27.437727 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b019c-c1b5-479c-b7d7-960e5097c982 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:27.457862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 114/221] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:27.465765 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b019c-c1b5-479c-b7d7-960e5097c982 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:27.517062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:27.530033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 108/222] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:17:27.535784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c017a07-f839-4d51-91a7-e0e9461b5eb7 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:27.632859 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b019c-c1b5-479c-b7d7-960e5097c982 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:27.649071 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c017a07-f839-4d51-91a7-e0e9461b5eb7 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:27.668843 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c205c-26cb-4726-a1e9-4c37da2cad34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:27.669492 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c205c-26cb-4726-a1e9-4c37da2cad34 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:27.669781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c205c-26cb-4726-a1e9-4c37da2cad34 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:27.670062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c205c-26cb-4726-a1e9-4c37da2cad34 None admin] PATH_INFO: `/v3/users/edc251576703482fa3a883032c195c5a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:27.671223 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c205c-26cb-4726-a1e9-4c37da2cad34 None admin] RBAC: Authorizing `identity:get_user(user_id=edc251576703482fa3a883032c195c5a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:27.671635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:27.672723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c205c-26cb-4726-a1e9-4c37da2cad34 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:27.674331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 115/223] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:27 2022] GET /identity/v3/users/edc251576703482fa3a883032c195c5a => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:27.675654 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238e86b-b1b7-495e-a0c7-a78d1c69bf94 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:27.675948 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238e86b-b1b7-495e-a0c7-a78d1c69bf94 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:27.676262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238e86b-b1b7-495e-a0c7-a78d1c69bf94 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:27.682490 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 116/224] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:27.683345 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238e86b-b1b7-495e-a0c7-a78d1c69bf94 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:27.689449 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f66071-1c97-4f09-910e-332b52ac3c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:27.690164 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f66071-1c97-4f09-910e-332b52ac3c98 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:27.690446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f66071-1c97-4f09-910e-332b52ac3c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:27.690726 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f66071-1c97-4f09-910e-332b52ac3c98 None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:27.691920 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f66071-1c97-4f09-910e-332b52ac3c98 None admin] RBAC: Authorizing `identity:get_project(project_id=131c2da412c94e35868fe9dc21137199)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:27.694225 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f66071-1c97-4f09-910e-332b52ac3c98 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:27.696468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 109/225] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:27 2022] GET /identity/v3/projects/131c2da412c94e35868fe9dc21137199 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:27.697733 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6c6a4-8e46-45c0-92cc-98f01641c920 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:27.698017 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6c6a4-8e46-45c0-92cc-98f01641c920 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:27.698294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6c6a4-8e46-45c0-92cc-98f01641c920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:27.716674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4ad6c6a4-8e46-45c0-92cc-98f01641c920 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:27.717910 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4ad6c6a4-8e46-45c0-92cc-98f01641c920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:27.781500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:27.800722 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 110/226] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:27.800722 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6c6a4-8e46-45c0-92cc-98f01641c920 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:27.805910 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238e86b-b1b7-495e-a0c7-a78d1c69bf94 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:27.881450 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31fc5e-a778-4c46-8aec-a6ad10d3e2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:27.882204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31fc5e-a778-4c46-8aec-a6ad10d3e2f4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:27.882556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31fc5e-a778-4c46-8aec-a6ad10d3e2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:27.882841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31fc5e-a778-4c46-8aec-a6ad10d3e2f4 None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:27.884246 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31fc5e-a778-4c46-8aec-a6ad10d3e2f4 None admin] RBAC: Authorizing `identity:get_project(project_id=131c2da412c94e35868fe9dc21137199)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:27.886170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31fc5e-a778-4c46-8aec-a6ad10d3e2f4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:27.888285 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 117/227] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:27 2022] GET /identity/v3/projects/131c2da412c94e35868fe9dc21137199 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:27.897565 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31fc5e-a778-4c46-8aec-a6ad10d3e2f4 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:27.915870 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6c6a4-8e46-45c0-92cc-98f01641c920 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:27.936508 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:27.956511 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f80fb-f437-4d6c-86f8-e97ecbbc6768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:27.957237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f80fb-f437-4d6c-86f8-e97ecbbc6768 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:27.957625 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f80fb-f437-4d6c-86f8-e97ecbbc6768 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:27.958102 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f80fb-f437-4d6c-86f8-e97ecbbc6768 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:27.959135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f80fb-f437-4d6c-86f8-e97ecbbc6768 None admin] RBAC: Adding query filter params (role.id=dbb1f67486534e8dbbc250bfe0978e6c, scope.project.id=131c2da412c94e35868fe9dc21137199, user.id=4b55ed3766ad4af59e00c895b101b11c) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:27.959458 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f80fb-f437-4d6c-86f8-e97ecbbc6768 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:27.961100 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f80fb-f437-4d6c-86f8-e97ecbbc6768 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:27.967708 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 111/228] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:17:27 2022] GET /identity/v3/role_assignments?user.id=4b55ed3766ad4af59e00c895b101b11c&scope.project.id=131c2da412c94e35868fe9dc21137199&role.id=dbb1f67486534e8dbbc250bfe0978e6c => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:28.101329 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31fc5e-a778-4c46-8aec-a6ad10d3e2f4 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:28.137090 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ccf68-c473-4d53-aae4-92dcaecfdbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:28.137676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ccf68-c473-4d53-aae4-92dcaecfdbc3 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:28.137953 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ccf68-c473-4d53-aae4-92dcaecfdbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:28.138307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ccf68-c473-4d53-aae4-92dcaecfdbc3 None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199/users/edc251576703482fa3a883032c195c5a/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:28.139568 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f80fb-f437-4d6c-86f8-e97ecbbc6768 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:28.140260 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ccf68-c473-4d53-aae4-92dcaecfdbc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=131c2da412c94e35868fe9dc21137199, user_id=edc251576703482fa3a883032c195c5a, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:28.141753 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ccf68-c473-4d53-aae4-92dcaecfdbc3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:28.158453 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 118/229] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:17:27 2022] PUT /identity/v3/projects/131c2da412c94e35868fe9dc21137199/users/edc251576703482fa3a883032c195c5a/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:17:28.294465 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f80fb-f437-4d6c-86f8-e97ecbbc6768 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:28.331653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d94b1-4e37-438b-bd01-7d6028d9c6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:28.332301 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d94b1-4e37-438b-bd01-7d6028d9c6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:28.332584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d94b1-4e37-438b-bd01-7d6028d9c6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:28.333425 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d94b1-4e37-438b-bd01-7d6028d9c6c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:28.344182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d94b1-4e37-438b-bd01-7d6028d9c6c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:28.350617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-023d94b1-4e37-438b-bd01-7d6028d9c6c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:28.350617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:28.350617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:28.350617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:28.350617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:28.350617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:28.350617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:28.350617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:28.350617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:28.350617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:28.350617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:28.350617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:28.350617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:28.350617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:28.350617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:28.350617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:28.351601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:28.351601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:28.351601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:28.351601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:28.351601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:28.351601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:28.351601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:28.351601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:28.351601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:28.351601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:28.351601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:28.351601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:28.351601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:28.351601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:28.351601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:28.351601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:28.353253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:28.353253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:28.353253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:28.353253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:28.353253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:28.353253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:28.353253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:28.353253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:28.353253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:28.353253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:28.353253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:28.353253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:28.353253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 112/230] 10.222.0.96 () {56 vars in 1114 bytes} [Wed Aug 24 04:17:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:17:28.369218 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ccf68-c473-4d53-aae4-92dcaecfdbc3 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:28.389744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:28.486391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ccf68-c473-4d53-aae4-92dcaecfdbc3 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:28.525100 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e630e-523f-4459-981c-930a6ba1f1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:28.525722 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e630e-523f-4459-981c-930a6ba1f1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:28.526007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e630e-523f-4459-981c-930a6ba1f1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:28.526288 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e630e-523f-4459-981c-930a6ba1f1a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:28.526969 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e630e-523f-4459-981c-930a6ba1f1a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:28.527279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e630e-523f-4459-981c-930a6ba1f1a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:28.528668 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e630e-523f-4459-981c-930a6ba1f1a0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:28.537416 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 119/231] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:17:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:28.542990 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d94b1-4e37-438b-bd01-7d6028d9c6c4 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:28.610301 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:28.684462 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d94b1-4e37-438b-bd01-7d6028d9c6c4 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:28.738848 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd47e48-02c6-4d0d-9727-85368fe05416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:28.739593 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd47e48-02c6-4d0d-9727-85368fe05416 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:28.739906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd47e48-02c6-4d0d-9727-85368fe05416 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:28.740193 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd47e48-02c6-4d0d-9727-85368fe05416 None admin] PATH_INFO: `/v3/users/edc251576703482fa3a883032c195c5a` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:28.741409 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd47e48-02c6-4d0d-9727-85368fe05416 None admin] RBAC: Authorizing `identity:get_user(user_id=edc251576703482fa3a883032c195c5a)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:28.742865 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd47e48-02c6-4d0d-9727-85368fe05416 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:28.744531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 113/232] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:28 2022] GET /identity/v3/users/edc251576703482fa3a883032c195c5a => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:28.750068 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e630e-523f-4459-981c-930a6ba1f1a0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:28.840711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:28.868508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e630e-523f-4459-981c-930a6ba1f1a0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:28.907361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427c1b6-5a53-4194-8d36-d2ed4acc29d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:28.908004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427c1b6-5a53-4194-8d36-d2ed4acc29d0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:28.908289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427c1b6-5a53-4194-8d36-d2ed4acc29d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:28.908569 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427c1b6-5a53-4194-8d36-d2ed4acc29d0 None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:28.909753 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427c1b6-5a53-4194-8d36-d2ed4acc29d0 None admin] RBAC: Authorizing `identity:get_project(project_id=131c2da412c94e35868fe9dc21137199)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:28.911312 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427c1b6-5a53-4194-8d36-d2ed4acc29d0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:28.913086 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 120/233] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:28 2022] GET /identity/v3/projects/131c2da412c94e35868fe9dc21137199 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:28.918848 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd47e48-02c6-4d0d-9727-85368fe05416 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:29.033193 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd47e48-02c6-4d0d-9727-85368fe05416 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:29.044265 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:29.076884 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35050b4-0bc7-4a7e-a953-a20d170a7cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:29.077562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35050b4-0bc7-4a7e-a953-a20d170a7cc7 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:29.077850 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35050b4-0bc7-4a7e-a953-a20d170a7cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:29.078132 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35050b4-0bc7-4a7e-a953-a20d170a7cc7 None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199/users/edc251576703482fa3a883032c195c5a/roles/b78ed83a66fe4531900cc02bb745f80f` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:29.080450 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35050b4-0bc7-4a7e-a953-a20d170a7cc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=131c2da412c94e35868fe9dc21137199, user_id=edc251576703482fa3a883032c195c5a, role_id=b78ed83a66fe4531900cc02bb745f80f)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:29.081997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35050b4-0bc7-4a7e-a953-a20d170a7cc7 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:29.097486 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 114/234] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:17:28 2022] PUT /identity/v3/projects/131c2da412c94e35868fe9dc21137199/users/edc251576703482fa3a883032c195c5a/roles/b78ed83a66fe4531900cc02bb745f80f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:17:29.267416 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1494c28-e435-4d92-ac1c-9ce14719ba6c None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:29.267800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1494c28-e435-4d92-ac1c-9ce14719ba6c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:29.267978 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1494c28-e435-4d92-ac1c-9ce14719ba6c None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:29.269566 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 121/235] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:29.275670 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e50e74-813a-4141-9e28-e1ba37b13eba None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:29.275969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e50e74-813a-4141-9e28-e1ba37b13eba None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:29.276251 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e50e74-813a-4141-9e28-e1ba37b13eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:29.296808 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e3e50e74-813a-4141-9e28-e1ba37b13eba None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:29.297927 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e3e50e74-813a-4141-9e28-e1ba37b13eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:29.378411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 115/236] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:29.388930 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d6057-88b3-4d02-9259-2455b9eefbae None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:29.389224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d6057-88b3-4d02-9259-2455b9eefbae None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:29.389510 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d6057-88b3-4d02-9259-2455b9eefbae None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:29.390875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 122/237] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:29.396153 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff688378-0171-4de1-bcb8-f0517530b2d6 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:29.396446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff688378-0171-4de1-bcb8-f0517530b2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:29.396747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff688378-0171-4de1-bcb8-f0517530b2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:29.421686 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ff688378-0171-4de1-bcb8-f0517530b2d6 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:29.422893 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ff688378-0171-4de1-bcb8-f0517530b2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:29.511351 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 116/238] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:29.737302 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d6057-88b3-4d02-9259-2455b9eefbae None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:29.897990 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d6057-88b3-4d02-9259-2455b9eefbae None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:29.899983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff688378-0171-4de1-bcb8-f0517530b2d6 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:29.941635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:29.945856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71777ced-dfe5-4791-b8a9-7e0bcb6c9695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:29.946543 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71777ced-dfe5-4791-b8a9-7e0bcb6c9695 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:29.946835 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71777ced-dfe5-4791-b8a9-7e0bcb6c9695 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:29.947151 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71777ced-dfe5-4791-b8a9-7e0bcb6c9695 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:29.962532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71777ced-dfe5-4791-b8a9-7e0bcb6c9695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:29.968021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-71777ced-dfe5-4791-b8a9-7e0bcb6c9695 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:17:29.968021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:29.968021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:29.968021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:29.968021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:29.968021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:29.968021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:29.968021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:29.968021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:29.968021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:29.968021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:29.968021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:29.968021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:29.968021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:29.968021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:29.968021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:29.968950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:29.968950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:29.968950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:29.968950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:29.968950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:29.968950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:29.968950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:29.968950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:29.968950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:29.968950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:29.968950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:29.968950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:29.968950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:29.968950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:29.968950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:29.968950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:29.969744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:29.969744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:29.969744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:29.969744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:29.969744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:29.969744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:29.969744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:29.969744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:29.969744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:29.969744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:29.969744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:17:29.969744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:29.971063 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 123/239] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:29.979216 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71777ced-dfe5-4791-b8a9-7e0bcb6c9695 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:29.994984 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:30.039648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff688378-0171-4de1-bcb8-f0517530b2d6 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:30.099072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709e286-8f48-45a8-9d37-2a3236a22d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:30.099724 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709e286-8f48-45a8-9d37-2a3236a22d69 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:30.100008 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709e286-8f48-45a8-9d37-2a3236a22d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:30.100284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709e286-8f48-45a8-9d37-2a3236a22d69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:30.101450 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709e286-8f48-45a8-9d37-2a3236a22d69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:30.102921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709e286-8f48-45a8-9d37-2a3236a22d69 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:30.104506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 117/240] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:17:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:30.111563 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709e286-8f48-45a8-9d37-2a3236a22d69 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:30.190675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71777ced-dfe5-4791-b8a9-7e0bcb6c9695 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:30.238949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709e286-8f48-45a8-9d37-2a3236a22d69 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:30.241830 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:30.250304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ecaca-5c70-4e70-be1a-0dfb88ba0596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:30.250902 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ecaca-5c70-4e70-be1a-0dfb88ba0596 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:30.251260 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ecaca-5c70-4e70-be1a-0dfb88ba0596 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:30.251539 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ecaca-5c70-4e70-be1a-0dfb88ba0596 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:30.252219 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ecaca-5c70-4e70-be1a-0dfb88ba0596 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:30.252528 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ecaca-5c70-4e70-be1a-0dfb88ba0596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:30.253964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ecaca-5c70-4e70-be1a-0dfb88ba0596 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:30.279017 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 124/241] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:30.284524 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ecaca-5c70-4e70-be1a-0dfb88ba0596 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:30.308290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c99445-317d-4654-a3ae-972677c34955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:30.308936 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c99445-317d-4654-a3ae-972677c34955 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:30.309220 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c99445-317d-4654-a3ae-972677c34955 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:30.309492 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c99445-317d-4654-a3ae-972677c34955 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:30.310225 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c99445-317d-4654-a3ae-972677c34955 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:30.311682 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c99445-317d-4654-a3ae-972677c34955 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:30.344618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 118/242] 10.222.0.96 () {60 vars in 1132 bytes} [Wed Aug 24 04:17:30 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:17:30.346849 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bb1fe-1eaf-4ac9-abb8-5376ab5bbf9e None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:30.347340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bb1fe-1eaf-4ac9-abb8-5376ab5bbf9e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:30.347818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bb1fe-1eaf-4ac9-abb8-5376ab5bbf9e None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:30.349991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 119/243] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:30.359241 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b86e12-bd20-4451-a89a-18b7d9ed84f9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:30.365553 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b86e12-bd20-4451-a89a-18b7d9ed84f9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:30.366446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b86e12-bd20-4451-a89a-18b7d9ed84f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:30.407681 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f4b86e12-bd20-4451-a89a-18b7d9ed84f9 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:30.410761 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f4b86e12-bd20-4451-a89a-18b7d9ed84f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:30.435337 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:30.504908 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ecaca-5c70-4e70-be1a-0dfb88ba0596 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:30.521700 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 120/244] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:30.574236 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4103b1c-8b94-4fb2-b243-a0aa3bc94dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:30.574878 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4103b1c-8b94-4fb2-b243-a0aa3bc94dfa None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:30.575157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4103b1c-8b94-4fb2-b243-a0aa3bc94dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:30.575430 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4103b1c-8b94-4fb2-b243-a0aa3bc94dfa None admin] PATH_INFO: `/v3/users/e157a75a9dc34218b77d5ebfe774e706` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:30.589838 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4103b1c-8b94-4fb2-b243-a0aa3bc94dfa None admin] RBAC: Authorizing `identity:get_user(user_id=e157a75a9dc34218b77d5ebfe774e706)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:30.591301 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4103b1c-8b94-4fb2-b243-a0aa3bc94dfa None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:30.592984 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 125/245] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:30 2022] GET /identity/v3/users/e157a75a9dc34218b77d5ebfe774e706 => generated 297 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:30.598769 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b86e12-bd20-4451-a89a-18b7d9ed84f9 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:30.706128 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:30.727085 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b86e12-bd20-4451-a89a-18b7d9ed84f9 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:30.768445 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e048a8-a704-4ace-a75d-be862b092cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:30.769434 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e048a8-a704-4ace-a75d-be862b092cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:30.769925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e048a8-a704-4ace-a75d-be862b092cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:30.770417 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e048a8-a704-4ace-a75d-be862b092cb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:30.780541 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a8522-07db-4d2a-8c56-479f13a0729b None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:30.781144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a8522-07db-4d2a-8c56-479f13a0729b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:30.781721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a8522-07db-4d2a-8c56-479f13a0729b None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:30.783385 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 126/246] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:17:30.789609 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a93fc-de2f-4984-942f-4b0bb671e6dc None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:30.789892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a93fc-de2f-4984-942f-4b0bb671e6dc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:30.790172 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a93fc-de2f-4984-942f-4b0bb671e6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:30.812815 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d03a93fc-de2f-4984-942f-4b0bb671e6dc None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:30.814388 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d03a93fc-de2f-4984-942f-4b0bb671e6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:30.858634 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e048a8-a704-4ace-a75d-be862b092cb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:30.860117 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e048a8-a704-4ace-a75d-be862b092cb5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:30.919459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 127/247] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:17:30.920551 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a93fc-de2f-4984-942f-4b0bb671e6dc None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:30.970848 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:30.995616 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 121/248] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:31.001731 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e048a8-a704-4ace-a75d-be862b092cb5 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:31.022584 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:31.115549 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a93fc-de2f-4984-942f-4b0bb671e6dc None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:31.157640 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e048a8-a704-4ace-a75d-be862b092cb5 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:31.199603 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6a09a-cf52-4f48-bfb1-5cd8d46a9047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:31.200649 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6a09a-cf52-4f48-bfb1-5cd8d46a9047 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:31.201157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6a09a-cf52-4f48-bfb1-5cd8d46a9047 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:31.202295 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6a09a-cf52-4f48-bfb1-5cd8d46a9047 None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:31.204024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6a09a-cf52-4f48-bfb1-5cd8d46a9047 None admin] RBAC: Authorizing `identity:get_project(project_id=131c2da412c94e35868fe9dc21137199)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:31.205953 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6a09a-cf52-4f48-bfb1-5cd8d46a9047 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:31.208578 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 122/249] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:31 2022] GET /identity/v3/projects/131c2da412c94e35868fe9dc21137199 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:31.214666 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36d1da-6b00-4a07-909f-cb83abb3123d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:31.215336 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36d1da-6b00-4a07-909f-cb83abb3123d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:31.215619 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36d1da-6b00-4a07-909f-cb83abb3123d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:31.215895 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36d1da-6b00-4a07-909f-cb83abb3123d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:31.216053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6a09a-cf52-4f48-bfb1-5cd8d46a9047 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:31.249653 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36d1da-6b00-4a07-909f-cb83abb3123d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:31.256127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-7f36d1da-6b00-4a07-909f-cb83abb3123d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:31.256127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:31.256127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:31.256127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:31.256127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:31.256127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:31.256127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:31.256127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:31.256127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:31.256127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:31.256127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:31.256127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:31.256127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:31.256127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:31.256127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:31.256127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:31.257351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:31.257351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:31.257351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:31.257351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:31.257351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:31.257351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:31.257351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:31.257351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:31.257351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:31.257351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:31.257351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:31.257351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:31.257351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:31.257351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:31.257351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:31.257351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:31.258339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:31.258339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:31.258339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:31.258339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:31.258339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:31.258339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:31.258339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:31.258339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:31.258339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:31.258339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:31.258339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:31.258339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:31.258339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 128/250] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:31.265724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36d1da-6b00-4a07-909f-cb83abb3123d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:31.293303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:31.368269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6a09a-cf52-4f48-bfb1-5cd8d46a9047 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:31.443175 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475bb69-e871-43b1-8802-d1c45abfb760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:31.443798 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475bb69-e871-43b1-8802-d1c45abfb760 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:31.444078 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475bb69-e871-43b1-8802-d1c45abfb760 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:31.444350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475bb69-e871-43b1-8802-d1c45abfb760 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:31.445123 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475bb69-e871-43b1-8802-d1c45abfb760 None admin] RBAC: Adding query filter params (role.id=19ca99e30fa74961a6203a02a8317128, scope.project.id=131c2da412c94e35868fe9dc21137199, user.id=e157a75a9dc34218b77d5ebfe774e706) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:31.445689 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475bb69-e871-43b1-8802-d1c45abfb760 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:31.447157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475bb69-e871-43b1-8802-d1c45abfb760 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:31.453366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 123/251] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:17:31 2022] GET /identity/v3/role_assignments?user.id=e157a75a9dc34218b77d5ebfe774e706&scope.project.id=131c2da412c94e35868fe9dc21137199&role.id=19ca99e30fa74961a6203a02a8317128 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:31.454187 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475bb69-e871-43b1-8802-d1c45abfb760 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:31.466264 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36d1da-6b00-4a07-909f-cb83abb3123d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:31.504681 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:31.553369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91219a11-db20-4d83-9d96-96fa1921c1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:31.554234 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91219a11-db20-4d83-9d96-96fa1921c1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:31.554657 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91219a11-db20-4d83-9d96-96fa1921c1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:31.555112 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91219a11-db20-4d83-9d96-96fa1921c1d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:31.555940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91219a11-db20-4d83-9d96-96fa1921c1d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:31.562231 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91219a11-db20-4d83-9d96-96fa1921c1d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:31.564136 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91219a11-db20-4d83-9d96-96fa1921c1d4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:31.592755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 129/252] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:31.596997 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91219a11-db20-4d83-9d96-96fa1921c1d4 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:31.667423 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475bb69-e871-43b1-8802-d1c45abfb760 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:31.686408 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:31.707261 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fbdd0-07ed-4c8d-a553-dc22235389ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:31.707947 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fbdd0-07ed-4c8d-a553-dc22235389ea None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:31.708228 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fbdd0-07ed-4c8d-a553-dc22235389ea None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:31.708507 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fbdd0-07ed-4c8d-a553-dc22235389ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:31.720121 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fbdd0-07ed-4c8d-a553-dc22235389ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:31.726539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-d98fbdd0-07ed-4c8d-a553-dc22235389ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:17:31.726539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:31.726539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:31.726539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:31.726539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:31.726539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:31.726539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:31.726539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:31.726539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:31.726539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:31.726539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:31.726539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:31.726539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:31.726539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:31.726539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:31.726539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:31.727461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:31.727461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:31.727461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:31.727461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:31.727461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:31.727461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:31.727461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:31.727461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:31.727461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:31.727461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:31.727461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:31.727461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:31.727461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:31.727461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:31.727461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:31.727461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:31.728272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:31.728272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:31.728272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:31.728272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:31.728272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:31.728272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:31.728272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:31.728272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:31.728272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:31.728272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:31.728272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:17:31.728272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:31.728272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 124/253] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:17:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:31.729529 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42034b-113d-4f58-9305-0cd707114da4 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:31.729640 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42034b-113d-4f58-9305-0cd707114da4 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:31.729908 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42034b-113d-4f58-9305-0cd707114da4 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:31.731153 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 125/254] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:31.740208 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42034b-113d-4f58-9305-0cd707114da4 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:31.763168 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91219a11-db20-4d83-9d96-96fa1921c1d4 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:31.817630 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97047f06-518c-46a1-b7c0-07e3e53ad993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:31.818028 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97047f06-518c-46a1-b7c0-07e3e53ad993 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:31.818545 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97047f06-518c-46a1-b7c0-07e3e53ad993 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:31.818828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97047f06-518c-46a1-b7c0-07e3e53ad993 None admin] PATH_INFO: `/v3/users/4b55ed3766ad4af59e00c895b101b11c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:31.819986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97047f06-518c-46a1-b7c0-07e3e53ad993 None admin] RBAC: Authorizing `identity:get_user(user_id=4b55ed3766ad4af59e00c895b101b11c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:31.822030 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97047f06-518c-46a1-b7c0-07e3e53ad993 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:31.825178 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 130/255] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:31 2022] GET /identity/v3/users/4b55ed3766ad4af59e00c895b101b11c => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:31.827243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8178c-282f-494e-9b84-ef6f6f60f7de None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:31.827533 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8178c-282f-494e-9b84-ef6f6f60f7de None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:31.830634 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8178c-282f-494e-9b84-ef6f6f60f7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:31.859525 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-cfd8178c-282f-494e-9b84-ef6f6f60f7de None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:31.860785 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cfd8178c-282f-494e-9b84-ef6f6f60f7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:31.926348 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42034b-113d-4f58-9305-0cd707114da4 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:31.951623 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:31.997137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb8b82-6f41-4566-9445-7fb03b1d35c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:31.997808 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb8b82-6f41-4566-9445-7fb03b1d35c6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:31.998032 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb8b82-6f41-4566-9445-7fb03b1d35c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:31.998307 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb8b82-6f41-4566-9445-7fb03b1d35c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:32.000945 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 131/256] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:32.001354 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb8b82-6f41-4566-9445-7fb03b1d35c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:32.001897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb8b82-6f41-4566-9445-7fb03b1d35c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:32.003519 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb8b82-6f41-4566-9445-7fb03b1d35c6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:32.008741 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8178c-282f-494e-9b84-ef6f6f60f7de None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:32.024569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 126/257] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:32.030885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb8b82-6f41-4566-9445-7fb03b1d35c6 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:32.134359 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:32.206479 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8178c-282f-494e-9b84-ef6f6f60f7de None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:32.255897 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47578f1f-d4b7-4656-afe8-4efdc781dd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:32.256545 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47578f1f-d4b7-4656-afe8-4efdc781dd12 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:32.256859 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47578f1f-d4b7-4656-afe8-4efdc781dd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:32.257136 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47578f1f-d4b7-4656-afe8-4efdc781dd12 None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:32.258279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47578f1f-d4b7-4656-afe8-4efdc781dd12 None admin] RBAC: Authorizing `identity:get_project(project_id=131c2da412c94e35868fe9dc21137199)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:32.259734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47578f1f-d4b7-4656-afe8-4efdc781dd12 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:32.264710 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 132/258] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:32 2022] GET /identity/v3/projects/131c2da412c94e35868fe9dc21137199 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:32.267243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47578f1f-d4b7-4656-afe8-4efdc781dd12 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:32.313114 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb8b82-6f41-4566-9445-7fb03b1d35c6 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:32.337046 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:32.373050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47578f1f-d4b7-4656-afe8-4efdc781dd12 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:32.418830 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d3ef8-16fa-44bb-ae95-2cf5fb4e2ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:32.419420 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d3ef8-16fa-44bb-ae95-2cf5fb4e2ed7 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:32.419704 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d3ef8-16fa-44bb-ae95-2cf5fb4e2ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:32.419985 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d3ef8-16fa-44bb-ae95-2cf5fb4e2ed7 None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199/users/4b55ed3766ad4af59e00c895b101b11c/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:32.422193 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d3ef8-16fa-44bb-ae95-2cf5fb4e2ed7 None admin] RBAC: Authorizing `identity:create_grant(project_id=131c2da412c94e35868fe9dc21137199, user_id=4b55ed3766ad4af59e00c895b101b11c, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:32.423663 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234d3ef8-16fa-44bb-ae95-2cf5fb4e2ed7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:32.436422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d2991-3b0e-46f1-b9f9-87e029c3ff43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:32.437142 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d2991-3b0e-46f1-b9f9-87e029c3ff43 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:32.437432 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d2991-3b0e-46f1-b9f9-87e029c3ff43 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:32.437713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d2991-3b0e-46f1-b9f9-87e029c3ff43 None admin] PATH_INFO: `/v3/users/edc251576703482fa3a883032c195c5a` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:32.439047 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d2991-3b0e-46f1-b9f9-87e029c3ff43 None admin] RBAC: Authorizing `identity:get_user(user_id=edc251576703482fa3a883032c195c5a)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:32.440726 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 133/259] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:17:32 2022] PUT /identity/v3/projects/131c2da412c94e35868fe9dc21137199/users/4b55ed3766ad4af59e00c895b101b11c/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:17:32.441071 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d2991-3b0e-46f1-b9f9-87e029c3ff43 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:32.441653 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d3ef8-16fa-44bb-ae95-2cf5fb4e2ed7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:32.448969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 127/260] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:32 2022] GET /identity/v3/users/edc251576703482fa3a883032c195c5a => generated 283 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:32.450767 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d2991-3b0e-46f1-b9f9-87e029c3ff43 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:32.650120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d3ef8-16fa-44bb-ae95-2cf5fb4e2ed7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:32.655011 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:32.659406 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d2991-3b0e-46f1-b9f9-87e029c3ff43 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:32.671303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:32.709110 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59083bb-99ee-4b62-afdf-875b64262eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:32.709983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59083bb-99ee-4b62-afdf-875b64262eef None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:32.710370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59083bb-99ee-4b62-afdf-875b64262eef None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:32.710746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59083bb-99ee-4b62-afdf-875b64262eef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:32.715343 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc5b05-57d8-4dde-a81e-3c0427ed0c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:32.717043 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc5b05-57d8-4dde-a81e-3c0427ed0c6b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:32.717478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc5b05-57d8-4dde-a81e-3c0427ed0c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:32.718015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc5b05-57d8-4dde-a81e-3c0427ed0c6b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:32.742927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc5b05-57d8-4dde-a81e-3c0427ed0c6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:32.749986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-58dc5b05-57d8-4dde-a81e-3c0427ed0c6b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:32.749986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:32.749986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:32.749986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:32.749986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:32.749986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:32.749986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:32.749986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:32.749986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:32.749986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:32.749986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:32.749986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:32.749986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:32.749986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:32.749986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:32.749986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:32.751040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:32.751040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:32.751040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:32.751040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:32.751040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:32.751040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:32.751040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:32.751040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:32.751040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:32.751040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:32.751040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:32.751040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:32.751040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:32.751040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:32.751040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:32.751040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:32.752049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:32.752049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:32.752049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:32.752049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:32.752049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:32.752049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:32.752049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:32.752049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:32.752049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:32.752049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:32.752049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:32.752049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:32.758181 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 134/261] 10.222.0.96 () {56 vars in 1114 bytes} [Wed Aug 24 04:17:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:32.765032 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc5b05-57d8-4dde-a81e-3c0427ed0c6b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:32.830141 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59083bb-99ee-4b62-afdf-875b64262eef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:32.831651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59083bb-99ee-4b62-afdf-875b64262eef None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:32.959874 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc5b05-57d8-4dde-a81e-3c0427ed0c6b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:32.997511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc8fde-d6d1-468a-80db-5696c2a97afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:32.998132 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc8fde-d6d1-468a-80db-5696c2a97afe None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:32.998467 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc8fde-d6d1-468a-80db-5696c2a97afe None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:32.998756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc8fde-d6d1-468a-80db-5696c2a97afe None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:32.999430 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc8fde-d6d1-468a-80db-5696c2a97afe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:32.999842 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc8fde-d6d1-468a-80db-5696c2a97afe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:33.001275 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc8fde-d6d1-468a-80db-5696c2a97afe None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:33.010360 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 135/262] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:17:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:33.017928 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc8fde-d6d1-468a-80db-5696c2a97afe None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:33.042503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 128/263] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:17:33.048157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59083bb-99ee-4b62-afdf-875b64262eef None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:33.059309 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:33.065302 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:33.138250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc8fde-d6d1-468a-80db-5696c2a97afe None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:33.205934 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59083bb-99ee-4b62-afdf-875b64262eef None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:33.234278 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f4805-0cee-4e6f-812c-e0e5c99510e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:33.234851 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f4805-0cee-4e6f-812c-e0e5c99510e0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:33.235132 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f4805-0cee-4e6f-812c-e0e5c99510e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:33.235406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f4805-0cee-4e6f-812c-e0e5c99510e0 None admin] PATH_INFO: `/v3/users/edc251576703482fa3a883032c195c5a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:33.236563 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f4805-0cee-4e6f-812c-e0e5c99510e0 None admin] RBAC: Authorizing `identity:get_user(user_id=edc251576703482fa3a883032c195c5a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:33.238041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f4805-0cee-4e6f-812c-e0e5c99510e0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:33.240198 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 136/264] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:33 2022] GET /identity/v3/users/edc251576703482fa3a883032c195c5a => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:33.246363 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f4805-0cee-4e6f-812c-e0e5c99510e0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:33.248103 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c92bd-a654-4c86-b1a0-3c107f3a7c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:33.248787 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c92bd-a654-4c86-b1a0-3c107f3a7c0a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:33.249265 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c92bd-a654-4c86-b1a0-3c107f3a7c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:33.249552 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c92bd-a654-4c86-b1a0-3c107f3a7c0a None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:33.253428 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c92bd-a654-4c86-b1a0-3c107f3a7c0a None admin] RBAC: Authorizing `identity:get_project(project_id=131c2da412c94e35868fe9dc21137199)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:33.259247 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c92bd-a654-4c86-b1a0-3c107f3a7c0a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:33.261316 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 129/265] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:33 2022] GET /identity/v3/projects/131c2da412c94e35868fe9dc21137199 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:33.273193 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c92bd-a654-4c86-b1a0-3c107f3a7c0a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:33.369982 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:33.390911 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f4805-0cee-4e6f-812c-e0e5c99510e0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:33.416310 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:33.456129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11c66b-70b1-46cb-a667-d7ff8a5d8c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:33.456772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11c66b-70b1-46cb-a667-d7ff8a5d8c96 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:33.457056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11c66b-70b1-46cb-a667-d7ff8a5d8c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:33.457327 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11c66b-70b1-46cb-a667-d7ff8a5d8c96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:33.477475 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c92bd-a654-4c86-b1a0-3c107f3a7c0a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:33.521288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b98f8-0ad7-40a0-828e-55b587599e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:33.522000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b98f8-0ad7-40a0-828e-55b587599e8f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:33.522281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b98f8-0ad7-40a0-828e-55b587599e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:33.522550 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b98f8-0ad7-40a0-828e-55b587599e8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:33.523282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b98f8-0ad7-40a0-828e-55b587599e8f None admin] RBAC: Adding query filter params (role.id=059d2bf5bb8e42939f5f826bfdad6a21, scope.project.id=131c2da412c94e35868fe9dc21137199, user.id=edc251576703482fa3a883032c195c5a) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:33.523591 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b98f8-0ad7-40a0-828e-55b587599e8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:33.525191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b98f8-0ad7-40a0-828e-55b587599e8f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:33.532000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 130/266] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:17:33 2022] GET /identity/v3/role_assignments?user.id=edc251576703482fa3a883032c195c5a&scope.project.id=131c2da412c94e35868fe9dc21137199&role.id=059d2bf5bb8e42939f5f826bfdad6a21 => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:33.537878 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32028b84-368c-4c82-b00d-80fb11a0afcb None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:33.538223 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32028b84-368c-4c82-b00d-80fb11a0afcb None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:33.538449 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32028b84-368c-4c82-b00d-80fb11a0afcb None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:33.539846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 131/267] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:33.546677 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37edd1f-c5e7-4d1c-8330-673ee539ea1a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:33.547008 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37edd1f-c5e7-4d1c-8330-673ee539ea1a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:33.547222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37edd1f-c5e7-4d1c-8330-673ee539ea1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:33.568132 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11c66b-70b1-46cb-a667-d7ff8a5d8c96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:33.569914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11c66b-70b1-46cb-a667-d7ff8a5d8c96 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:33.582492 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f37edd1f-c5e7-4d1c-8330-673ee539ea1a None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:33.584401 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f37edd1f-c5e7-4d1c-8330-673ee539ea1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:33.662737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 132/268] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:33.664119 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4760cf-2599-4df0-b4c5-1df13e8a261b None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:33.664400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4760cf-2599-4df0-b4c5-1df13e8a261b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:33.664673 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4760cf-2599-4df0-b4c5-1df13e8a261b None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:33.665952 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 133/269] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:33.671434 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42914b1b-4e35-45e9-8214-26cc6ac3fc98 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:33.671723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42914b1b-4e35-45e9-8214-26cc6ac3fc98 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:33.672001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42914b1b-4e35-45e9-8214-26cc6ac3fc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:33.691742 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-42914b1b-4e35-45e9-8214-26cc6ac3fc98 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:33.693652 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-42914b1b-4e35-45e9-8214-26cc6ac3fc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:33.764768 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:33.775127 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 134/270] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:17:33.775416 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:33.797406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 137/271] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:33.804183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42914b1b-4e35-45e9-8214-26cc6ac3fc98 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:33.957750 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42914b1b-4e35-45e9-8214-26cc6ac3fc98 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:34.004609 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967eaf5-7fb5-407b-ae5c-2d5aab515485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:34.005568 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967eaf5-7fb5-407b-ae5c-2d5aab515485 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:34.006011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967eaf5-7fb5-407b-ae5c-2d5aab515485 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:34.006295 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967eaf5-7fb5-407b-ae5c-2d5aab515485 None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:34.013437 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967eaf5-7fb5-407b-ae5c-2d5aab515485 None admin] RBAC: Authorizing `identity:get_project(project_id=131c2da412c94e35868fe9dc21137199)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:34.014937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967eaf5-7fb5-407b-ae5c-2d5aab515485 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:34.016613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 135/272] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:33 2022] GET /identity/v3/projects/131c2da412c94e35868fe9dc21137199 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:34.022918 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11c66b-70b1-46cb-a667-d7ff8a5d8c96 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:34.057636 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967eaf5-7fb5-407b-ae5c-2d5aab515485 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:34.190417 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:34.211337 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11c66b-70b1-46cb-a667-d7ff8a5d8c96 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:34.234652 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967eaf5-7fb5-407b-ae5c-2d5aab515485 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:34.257534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326c27a-4c32-4024-b65d-2e00239e7129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:34.258486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326c27a-4c32-4024-b65d-2e00239e7129 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:34.258990 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326c27a-4c32-4024-b65d-2e00239e7129 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:34.259937 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326c27a-4c32-4024-b65d-2e00239e7129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:34.261183 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326c27a-4c32-4024-b65d-2e00239e7129 None admin] RBAC: Adding query filter params (role.id=b78ed83a66fe4531900cc02bb745f80f, scope.project.id=131c2da412c94e35868fe9dc21137199, user.id=edc251576703482fa3a883032c195c5a) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:34.261695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326c27a-4c32-4024-b65d-2e00239e7129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:34.263846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326c27a-4c32-4024-b65d-2e00239e7129 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:34.272639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 138/273] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:17:34 2022] GET /identity/v3/role_assignments?user.id=edc251576703482fa3a883032c195c5a&scope.project.id=131c2da412c94e35868fe9dc21137199&role.id=b78ed83a66fe4531900cc02bb745f80f => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:34.273726 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326c27a-4c32-4024-b65d-2e00239e7129 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:34.283062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a267c7-0d61-4b68-8ead-5f5d8493d127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:34.283922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a267c7-0d61-4b68-8ead-5f5d8493d127 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:34.284329 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a267c7-0d61-4b68-8ead-5f5d8493d127 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:34.284712 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a267c7-0d61-4b68-8ead-5f5d8493d127 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:34.313831 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a267c7-0d61-4b68-8ead-5f5d8493d127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:34.319629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-c2a267c7-0d61-4b68-8ead-5f5d8493d127 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:34.319629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:34.319629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:34.319629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:34.319629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:34.319629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:34.319629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:34.319629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:34.319629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:34.319629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:34.319629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:34.319629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:34.319629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:34.319629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:34.319629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:34.319629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:34.321095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:34.321095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:34.321095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:34.321095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:34.321095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:34.321095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:34.321095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:34.321095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:34.321095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:34.321095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:34.321095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:34.321095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:34.321095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:34.321095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:34.321095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:34.321095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:34.322091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:34.322091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:34.322091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:34.322091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:34.322091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:34.322091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:34.322091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:34.322091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:34.322091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:34.322091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:34.322091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:34.322091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:34.325260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 136/274] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:17:34.330774 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a267c7-0d61-4b68-8ead-5f5d8493d127 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:34.346903 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:34.433792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326c27a-4c32-4024-b65d-2e00239e7129 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:34.499355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a267c7-0d61-4b68-8ead-5f5d8493d127 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:34.522739 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f3310-3bc6-4a68-8942-fc489c554b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:34.523648 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f3310-3bc6-4a68-8942-fc489c554b67 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:34.524023 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f3310-3bc6-4a68-8942-fc489c554b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:34.524491 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f3310-3bc6-4a68-8942-fc489c554b67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:34.525736 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f3310-3bc6-4a68-8942-fc489c554b67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:34.527206 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f3310-3bc6-4a68-8942-fc489c554b67 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:34.529133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 139/275] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:17:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:34.530088 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6ed62-f8e9-455e-9063-2a9721613512 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:34.530370 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6ed62-f8e9-455e-9063-2a9721613512 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:34.530641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6ed62-f8e9-455e-9063-2a9721613512 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:34.531976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 140/276] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:34.536781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6ed62-f8e9-455e-9063-2a9721613512 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:34.537453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:34.548411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e9e4c-0b3a-401c-826a-a7374bdcf831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:34.549156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e9e4c-0b3a-401c-826a-a7374bdcf831 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:34.549506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e9e4c-0b3a-401c-826a-a7374bdcf831 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:34.549786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e9e4c-0b3a-401c-826a-a7374bdcf831 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:34.550464 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e9e4c-0b3a-401c-826a-a7374bdcf831 None admin] RBAC: Adding query filter params (name=member) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:34.550772 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e9e4c-0b3a-401c-826a-a7374bdcf831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:34.552346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e9e4c-0b3a-401c-826a-a7374bdcf831 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:34.561626 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 137/277] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:34.562692 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadddbbc-75b6-43c5-9043-1fa21a1e17eb None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:34.562978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadddbbc-75b6-43c5-9043-1fa21a1e17eb None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:34.563252 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadddbbc-75b6-43c5-9043-1fa21a1e17eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:34.583872 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-aadddbbc-75b6-43c5-9043-1fa21a1e17eb None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:34.585107 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-aadddbbc-75b6-43c5-9043-1fa21a1e17eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:34.656737 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6ed62-f8e9-455e-9063-2a9721613512 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:34.660800 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 138/278] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:34.661680 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadddbbc-75b6-43c5-9043-1fa21a1e17eb None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:34.693941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:34.706986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6931d5-4736-4522-8bac-1b3e98a089ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:34.709002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6931d5-4736-4522-8bac-1b3e98a089ef None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:34.709689 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6931d5-4736-4522-8bac-1b3e98a089ef None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:34.710163 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6931d5-4736-4522-8bac-1b3e98a089ef None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:34.711019 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6931d5-4736-4522-8bac-1b3e98a089ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:34.713904 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6931d5-4736-4522-8bac-1b3e98a089ef None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:34.744853 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 141/279] 10.222.0.96 () {60 vars in 1132 bytes} [Wed Aug 24 04:17:34 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:17:34.807505 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadddbbc-75b6-43c5-9043-1fa21a1e17eb None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:34.831394 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:34.853674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8313f4b-2d75-42aa-9dc1-8b1bdaa55d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:34.854384 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8313f4b-2d75-42aa-9dc1-8b1bdaa55d74 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:34.854709 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8313f4b-2d75-42aa-9dc1-8b1bdaa55d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:34.855009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8313f4b-2d75-42aa-9dc1-8b1bdaa55d74 None admin] PATH_INFO: `/v3/users/305c08dc7a914d128092a7b047daca71` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:34.872615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8313f4b-2d75-42aa-9dc1-8b1bdaa55d74 None admin] RBAC: Authorizing `identity:get_user(user_id=305c08dc7a914d128092a7b047daca71)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:34.874241 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8313f4b-2d75-42aa-9dc1-8b1bdaa55d74 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:34.876576 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 139/280] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:34 2022] GET /identity/v3/users/305c08dc7a914d128092a7b047daca71 => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:34.883252 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6931d5-4736-4522-8bac-1b3e98a089ef None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:34.974683 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8313f4b-2d75-42aa-9dc1-8b1bdaa55d74 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:35.010586 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6931d5-4736-4522-8bac-1b3e98a089ef None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:35.061292 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516b99f-718a-45ac-8c8c-ea1a8642932d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:35.061920 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516b99f-718a-45ac-8c8c-ea1a8642932d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:35.062205 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516b99f-718a-45ac-8c8c-ea1a8642932d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:35.062480 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516b99f-718a-45ac-8c8c-ea1a8642932d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:35.063432 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516b99f-718a-45ac-8c8c-ea1a8642932d None admin] RBAC: Adding query filter params (role.id=dbb1f67486534e8dbbc250bfe0978e6c, user.id=305c08dc7a914d128092a7b047daca71, scope.system=all) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:35.063724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516b99f-718a-45ac-8c8c-ea1a8642932d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:35.066107 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516b99f-718a-45ac-8c8c-ea1a8642932d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:35.073891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 142/281] 10.222.0.96 () {56 vars in 1308 bytes} [Wed Aug 24 04:17:34 2022] GET /identity/v3/role_assignments?user.id=305c08dc7a914d128092a7b047daca71&scope.system=all&role.id=dbb1f67486534e8dbbc250bfe0978e6c => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:35.109869 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8313f4b-2d75-42aa-9dc1-8b1bdaa55d74 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:35.155674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba16aa9-2fae-43b9-9cc7-c0a37ca0847f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:35.156330 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba16aa9-2fae-43b9-9cc7-c0a37ca0847f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:35.156606 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba16aa9-2fae-43b9-9cc7-c0a37ca0847f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:35.156910 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba16aa9-2fae-43b9-9cc7-c0a37ca0847f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:35.172562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba16aa9-2fae-43b9-9cc7-c0a37ca0847f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:35.175565 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186cc9d-bb93-4061-ae8d-addfe5d46ba2 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:35.175869 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186cc9d-bb93-4061-ae8d-addfe5d46ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:35.178375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186cc9d-bb93-4061-ae8d-addfe5d46ba2 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:35.179587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-bba16aa9-2fae-43b9-9cc7-c0a37ca0847f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:17:35.179587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:35.179587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:35.179587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:35.179587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:35.179587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:35.179587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:35.179587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:35.179587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:35.179587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:35.179587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:35.179587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:35.179587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:35.179587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:35.179587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:35.179587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:35.180479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:35.180479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:35.180479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:35.180479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:35.180479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:35.180479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:35.180479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:35.180479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:35.180479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:35.180479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:35.180479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:35.180479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:35.180479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:35.180479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:35.180479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:35.180479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:35.181328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:35.181328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:35.181328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:35.181328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:35.181328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:35.181328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:35.181328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:35.181328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:35.181328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:35.181328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:35.181328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:17:35.181328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:35.181931 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 143/282] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:17:35.181998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 140/283] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:17:35.187373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186cc9d-bb93-4061-ae8d-addfe5d46ba2 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:35.187936 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847091c1-87fc-4237-86d9-249e8dd5bde0 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:35.188226 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847091c1-87fc-4237-86d9-249e8dd5bde0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:35.188525 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847091c1-87fc-4237-86d9-249e8dd5bde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:35.210476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-847091c1-87fc-4237-86d9-249e8dd5bde0 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:35.211746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-847091c1-87fc-4237-86d9-249e8dd5bde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:35.253885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:35.265070 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:35.310846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 141/284] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:35.338406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186cc9d-bb93-4061-ae8d-addfe5d46ba2 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:35.378944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22a956-f9fa-4517-85f5-f786c26691de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:35.379616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22a956-f9fa-4517-85f5-f786c26691de None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:35.380036 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22a956-f9fa-4517-85f5-f786c26691de None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:35.380452 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22a956-f9fa-4517-85f5-f786c26691de None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:35.381637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22a956-f9fa-4517-85f5-f786c26691de None admin] RBAC: Adding query filter params (name=reader) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:35.381977 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22a956-f9fa-4517-85f5-f786c26691de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:35.383384 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22a956-f9fa-4517-85f5-f786c26691de None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:35.392818 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 144/285] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:35.399136 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847091c1-87fc-4237-86d9-249e8dd5bde0 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:35.536869 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847091c1-87fc-4237-86d9-249e8dd5bde0 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:35.585448 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217f48c-f876-4e23-9019-394edf41acfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:35.586114 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217f48c-f876-4e23-9019-394edf41acfd None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:35.586400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217f48c-f876-4e23-9019-394edf41acfd None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:35.586678 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217f48c-f876-4e23-9019-394edf41acfd None admin] PATH_INFO: `/v3/users/e157a75a9dc34218b77d5ebfe774e706` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:35.587934 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217f48c-f876-4e23-9019-394edf41acfd None admin] RBAC: Authorizing `identity:get_user(user_id=e157a75a9dc34218b77d5ebfe774e706)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:35.589446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217f48c-f876-4e23-9019-394edf41acfd None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:35.591431 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 142/286] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:35 2022] GET /identity/v3/users/e157a75a9dc34218b77d5ebfe774e706 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:35.597348 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22a956-f9fa-4517-85f5-f786c26691de None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:35.749665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22a956-f9fa-4517-85f5-f786c26691de None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:35.759239 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:35.766160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217f48c-f876-4e23-9019-394edf41acfd None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:35.790929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b661ca0-6f11-4339-afb3-1fba537749d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:35.791634 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b661ca0-6f11-4339-afb3-1fba537749d2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:35.791925 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b661ca0-6f11-4339-afb3-1fba537749d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:35.792206 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b661ca0-6f11-4339-afb3-1fba537749d2 None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:35.794249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b661ca0-6f11-4339-afb3-1fba537749d2 None admin] RBAC: Authorizing `identity:get_project(project_id=131c2da412c94e35868fe9dc21137199)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:35.795762 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b661ca0-6f11-4339-afb3-1fba537749d2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:35.798334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 145/287] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:35 2022] GET /identity/v3/projects/131c2da412c94e35868fe9dc21137199 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:35.804211 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b661ca0-6f11-4339-afb3-1fba537749d2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:35.813664 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:35.901422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217f48c-f876-4e23-9019-394edf41acfd None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:35.940007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36785190-a939-4ee3-be59-3660fecbe23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:35.941085 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36785190-a939-4ee3-be59-3660fecbe23c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:35.941572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36785190-a939-4ee3-be59-3660fecbe23c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:35.942046 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36785190-a939-4ee3-be59-3660fecbe23c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:35.954274 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36785190-a939-4ee3-be59-3660fecbe23c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:35.960294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-36785190-a939-4ee3-be59-3660fecbe23c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:35.960294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:35.960294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:35.960294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:35.960294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:35.960294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:35.960294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:35.960294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:35.960294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:35.960294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:35.960294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:35.960294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:35.960294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:35.960294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:35.960294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:35.960294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:35.961236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:35.961236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:35.961236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:35.961236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:35.961236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:35.961236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:35.961236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:35.961236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:35.961236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:35.961236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:35.961236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:35.961236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:35.961236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:35.961236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:35.961236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:35.961236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:35.962019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:35.962019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:35.962019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:35.962019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:35.962019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:35.962019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:35.962019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:35.962019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:35.962019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:35.962019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:35.962019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:35.962019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:35.964485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 143/288] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:35.970416 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36785190-a939-4ee3-be59-3660fecbe23c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:36.055581 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b661ca0-6f11-4339-afb3-1fba537749d2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:36.077949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:36.087530 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36785190-a939-4ee3-be59-3660fecbe23c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:36.121476 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1c32d-97cf-48e4-949c-367a96f9af62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:36.122152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1c32d-97cf-48e4-949c-367a96f9af62 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:36.122429 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1c32d-97cf-48e4-949c-367a96f9af62 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:36.122706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1c32d-97cf-48e4-949c-367a96f9af62 None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199/users/e157a75a9dc34218b77d5ebfe774e706/roles/19ca99e30fa74961a6203a02a8317128` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:36.124768 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1c32d-97cf-48e4-949c-367a96f9af62 None admin] RBAC: Authorizing `identity:create_grant(project_id=131c2da412c94e35868fe9dc21137199, user_id=e157a75a9dc34218b77d5ebfe774e706, role_id=19ca99e30fa74961a6203a02a8317128)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:36.126236 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1c32d-97cf-48e4-949c-367a96f9af62 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:36.127458 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623ac10-a629-41ad-bb9e-63a62c773578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:36.128791 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623ac10-a629-41ad-bb9e-63a62c773578 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:36.129332 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623ac10-a629-41ad-bb9e-63a62c773578 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:36.130409 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623ac10-a629-41ad-bb9e-63a62c773578 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:36.131663 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623ac10-a629-41ad-bb9e-63a62c773578 None admin] RBAC: Adding query filter params (name=member) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:36.132138 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623ac10-a629-41ad-bb9e-63a62c773578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:36.133960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623ac10-a629-41ad-bb9e-63a62c773578 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:36.141909 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 146/289] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:17:35 2022] PUT /identity/v3/projects/131c2da412c94e35868fe9dc21137199/users/e157a75a9dc34218b77d5ebfe774e706/roles/19ca99e30fa74961a6203a02a8317128 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:17:36.144074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 144/290] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:36.158114 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1c32d-97cf-48e4-949c-367a96f9af62 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:36.218000 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:36.292300 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1c32d-97cf-48e4-949c-367a96f9af62 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:36.330254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c32884-a4e6-495c-97ae-ad0c9e78eecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:36.330918 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c32884-a4e6-495c-97ae-ad0c9e78eecc None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:36.331202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c32884-a4e6-495c-97ae-ad0c9e78eecc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:36.331486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c32884-a4e6-495c-97ae-ad0c9e78eecc None admin] PATH_INFO: `/v3/users/4b55ed3766ad4af59e00c895b101b11c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:36.332775 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c32884-a4e6-495c-97ae-ad0c9e78eecc None admin] RBAC: Authorizing `identity:get_user(user_id=4b55ed3766ad4af59e00c895b101b11c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:36.335042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c32884-a4e6-495c-97ae-ad0c9e78eecc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:36.336721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 147/291] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:36 2022] GET /identity/v3/users/4b55ed3766ad4af59e00c895b101b11c => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:36.342432 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623ac10-a629-41ad-bb9e-63a62c773578 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:36.480896 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623ac10-a629-41ad-bb9e-63a62c773578 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:36.533415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b0e33-92b8-4410-a335-7279a6acb32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:36.534098 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b0e33-92b8-4410-a335-7279a6acb32c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:36.534493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b0e33-92b8-4410-a335-7279a6acb32c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:36.534802 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b0e33-92b8-4410-a335-7279a6acb32c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:36.569451 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:36.625254 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b0e33-92b8-4410-a335-7279a6acb32c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:36.626849 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b0e33-92b8-4410-a335-7279a6acb32c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:36.744824 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 145/292] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:36.751108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c32884-a4e6-495c-97ae-ad0c9e78eecc None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:36.890562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c32884-a4e6-495c-97ae-ad0c9e78eecc None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:36.892986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:36.927656 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ab29f-e29b-43fe-8993-674c81a0ab7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:36.928338 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ab29f-e29b-43fe-8993-674c81a0ab7c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:36.928631 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ab29f-e29b-43fe-8993-674c81a0ab7c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:36.928948 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ab29f-e29b-43fe-8993-674c81a0ab7c None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:36.930207 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ab29f-e29b-43fe-8993-674c81a0ab7c None admin] RBAC: Authorizing `identity:get_project(project_id=131c2da412c94e35868fe9dc21137199)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:36.931680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ab29f-e29b-43fe-8993-674c81a0ab7c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:36.933692 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 148/293] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:36 2022] GET /identity/v3/projects/131c2da412c94e35868fe9dc21137199 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:36.941498 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b0e33-92b8-4410-a335-7279a6acb32c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:37.044260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:37.104585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b0e33-92b8-4410-a335-7279a6acb32c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:37.155896 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7474ad-5e9e-47a1-a18a-65107b2b012f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:37.156502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7474ad-5e9e-47a1-a18a-65107b2b012f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:37.156861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7474ad-5e9e-47a1-a18a-65107b2b012f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:37.157068 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7474ad-5e9e-47a1-a18a-65107b2b012f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:37.157746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7474ad-5e9e-47a1-a18a-65107b2b012f None admin] RBAC: Adding query filter params (role.id=dbb1f67486534e8dbbc250bfe0978e6c, scope.project.id=131c2da412c94e35868fe9dc21137199, user.id=4b55ed3766ad4af59e00c895b101b11c) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:37.158058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7474ad-5e9e-47a1-a18a-65107b2b012f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:37.159513 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7474ad-5e9e-47a1-a18a-65107b2b012f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:37.169326 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 146/294] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:17:36 2022] GET /identity/v3/role_assignments?user.id=4b55ed3766ad4af59e00c895b101b11c&scope.project.id=131c2da412c94e35868fe9dc21137199&role.id=dbb1f67486534e8dbbc250bfe0978e6c => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:37.465825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8c387-2b99-4866-b44f-827c228cac91 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:37.466334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8c387-2b99-4866-b44f-827c228cac91 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:37.466334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8c387-2b99-4866-b44f-827c228cac91 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:37.467641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 149/295] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:37.473052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e428a-0de1-486c-9899-c936e8d2b347 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:37.473344 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e428a-0de1-486c-9899-c936e8d2b347 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:37.474165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e428a-0de1-486c-9899-c936e8d2b347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:37.498405 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-be6e428a-0de1-486c-9899-c936e8d2b347 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:37.499610 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-be6e428a-0de1-486c-9899-c936e8d2b347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:37.592299 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f0793-3d2f-4821-98f5-f631a81bd496 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:37.592767 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f0793-3d2f-4821-98f5-f631a81bd496 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:37.593201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f0793-3d2f-4821-98f5-f631a81bd496 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:37.595936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 150/296] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:37.604224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc801b9-1aec-47c3-9deb-e87bd0b379dd None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:37.604651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc801b9-1aec-47c3-9deb-e87bd0b379dd None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:37.605143 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc801b9-1aec-47c3-9deb-e87bd0b379dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:37.605247 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 147/297] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:37.632720 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1bc801b9-1aec-47c3-9deb-e87bd0b379dd None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:37.633997 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1bc801b9-1aec-47c3-9deb-e87bd0b379dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:37.704604 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9944ea-8726-4bd9-838a-55a97b5b0eb1 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:37.704931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9944ea-8726-4bd9-838a-55a97b5b0eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:37.705216 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9944ea-8726-4bd9-838a-55a97b5b0eb1 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:37.706570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 148/298] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:17:37.712551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e4a35-e307-4f09-b43f-0570d28e11bd None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:37.712893 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e4a35-e307-4f09-b43f-0570d28e11bd None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:37.713146 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e4a35-e307-4f09-b43f-0570d28e11bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:37.726141 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 151/299] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:17:37.741405 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-fb2e4a35-e307-4f09-b43f-0570d28e11bd None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:37.742544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-fb2e4a35-e307-4f09-b43f-0570d28e11bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:37.804217 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:37.823855 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 149/300] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:17:37.945805 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc801b9-1aec-47c3-9deb-e87bd0b379dd None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:38.052174 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc801b9-1aec-47c3-9deb-e87bd0b379dd None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:38.053676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:38.089753 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56fdbd-e9d2-435c-94b3-2e1e53e0d3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:38.090403 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56fdbd-e9d2-435c-94b3-2e1e53e0d3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:38.090690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56fdbd-e9d2-435c-94b3-2e1e53e0d3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:38.090968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56fdbd-e9d2-435c-94b3-2e1e53e0d3a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:38.102670 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56fdbd-e9d2-435c-94b3-2e1e53e0d3a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:38.107806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-ac56fdbd-e9d2-435c-94b3-2e1e53e0d3a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:17:38.107806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:38.107806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:38.107806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:38.107806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:38.107806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:38.107806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:38.107806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:38.107806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:38.107806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:38.107806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:38.107806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:38.107806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:38.107806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:38.107806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:38.107806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:38.108711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:38.108711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:38.108711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:38.108711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:38.108711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:38.108711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:38.108711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:38.108711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:38.108711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:38.108711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:38.108711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:38.108711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:38.108711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:38.108711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:38.108711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:38.108711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:38.109523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:38.109523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:38.109523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:38.109523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:38.109523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:38.109523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:38.109523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:38.109523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:38.109523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:38.109523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:38.109523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:17:38.109523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:38.109523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 152/301] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:17:38.115581 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e4a35-e307-4f09-b43f-0570d28e11bd None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:38.153781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56fdbd-e9d2-435c-94b3-2e1e53e0d3a7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:38.239427 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e4a35-e307-4f09-b43f-0570d28e11bd None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:38.271085 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56fdbd-e9d2-435c-94b3-2e1e53e0d3a7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:38.285878 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd53f2f-1ed9-40f8-b5ca-e1b3ad0dc513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:38.286520 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd53f2f-1ed9-40f8-b5ca-e1b3ad0dc513 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:38.286807 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd53f2f-1ed9-40f8-b5ca-e1b3ad0dc513 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:38.287085 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd53f2f-1ed9-40f8-b5ca-e1b3ad0dc513 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:38.287771 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd53f2f-1ed9-40f8-b5ca-e1b3ad0dc513 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:38.288088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd53f2f-1ed9-40f8-b5ca-e1b3ad0dc513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:38.289558 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd53f2f-1ed9-40f8-b5ca-e1b3ad0dc513 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:38.303713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 150/302] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:38.304571 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd53f2f-1ed9-40f8-b5ca-e1b3ad0dc513 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:38.314358 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c579b80-57e5-4e10-82c4-8078c01a158b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:38.315073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c579b80-57e5-4e10-82c4-8078c01a158b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:38.315399 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c579b80-57e5-4e10-82c4-8078c01a158b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:38.315729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c579b80-57e5-4e10-82c4-8078c01a158b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:38.317066 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c579b80-57e5-4e10-82c4-8078c01a158b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:38.319627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c579b80-57e5-4e10-82c4-8078c01a158b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:38.324733 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 153/303] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:17:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:38.324733 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c579b80-57e5-4e10-82c4-8078c01a158b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:38.360135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:38.362401 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:38.433755 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd53f2f-1ed9-40f8-b5ca-e1b3ad0dc513 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:38.445733 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c579b80-57e5-4e10-82c4-8078c01a158b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:38.482859 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41660aa2-5d99-4cd3-9135-a7629aa4de73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:38.483923 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41660aa2-5d99-4cd3-9135-a7629aa4de73 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:38.484198 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41660aa2-5d99-4cd3-9135-a7629aa4de73 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:38.484478 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41660aa2-5d99-4cd3-9135-a7629aa4de73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:38.496293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14525e-d96b-4f92-aadd-5fe096653ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:38.497417 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14525e-d96b-4f92-aadd-5fe096653ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:38.497722 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14525e-d96b-4f92-aadd-5fe096653ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:38.498090 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14525e-d96b-4f92-aadd-5fe096653ee9 None admin] PATH_INFO: `/v3/users/8b11e3f14e5f418886c9b1acfdb750a4` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:38.498251 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41660aa2-5d99-4cd3-9135-a7629aa4de73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:38.504341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-41660aa2-5d99-4cd3-9135-a7629aa4de73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:38.504341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:38.504341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:38.504341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:38.504341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:38.504341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:38.504341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:38.504341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:38.504341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:38.504341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:38.504341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:38.504341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:38.504341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:38.504341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:38.504341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:38.504341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:38.505847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:38.505847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:38.505847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:38.505847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:38.505847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:38.505847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:38.505847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:38.505847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:38.505847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:38.505847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:38.505847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:38.505847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:38.505847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:38.505847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:38.505847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:38.505847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:38.506829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:38.506829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:38.506829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:38.506829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:38.506829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:38.506829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:38.506829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:38.506829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:38.506829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:38.506829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:38.506829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:38.506829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:38.506829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 151/304] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:38.508447 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41660aa2-5d99-4cd3-9135-a7629aa4de73 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:38.519656 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14525e-d96b-4f92-aadd-5fe096653ee9 None admin] RBAC: Authorizing `identity:get_user(user_id=8b11e3f14e5f418886c9b1acfdb750a4)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:38.522169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14525e-d96b-4f92-aadd-5fe096653ee9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:38.523867 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 154/305] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:38 2022] GET /identity/v3/users/8b11e3f14e5f418886c9b1acfdb750a4 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:38.529087 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14525e-d96b-4f92-aadd-5fe096653ee9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:38.632090 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:38.644298 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41660aa2-5d99-4cd3-9135-a7629aa4de73 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:38.646365 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:38.646824 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14525e-d96b-4f92-aadd-5fe096653ee9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:38.683018 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c735e28-6e69-4652-a731-4de2a05c6908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:38.683640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c735e28-6e69-4652-a731-4de2a05c6908 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:38.683928 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c735e28-6e69-4652-a731-4de2a05c6908 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:38.684273 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c735e28-6e69-4652-a731-4de2a05c6908 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:38.684914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c735e28-6e69-4652-a731-4de2a05c6908 None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:38.685225 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c735e28-6e69-4652-a731-4de2a05c6908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:38.686599 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c735e28-6e69-4652-a731-4de2a05c6908 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:38.687529 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996bbcc-5907-4f2e-a0f1-6735f8531a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:38.688150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996bbcc-5907-4f2e-a0f1-6735f8531a52 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:38.688425 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996bbcc-5907-4f2e-a0f1-6735f8531a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:38.688737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996bbcc-5907-4f2e-a0f1-6735f8531a52 None admin] PATH_INFO: `/v3/groups` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:38.689359 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996bbcc-5907-4f2e-a0f1-6735f8531a52 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:38.690797 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996bbcc-5907-4f2e-a0f1-6735f8531a52 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:38.696004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 155/306] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:38.696948 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c735e28-6e69-4652-a731-4de2a05c6908 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:38.712318 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 152/307] 10.222.0.96 () {60 vars in 1134 bytes} [Wed Aug 24 04:17:38 2022] POST /identity/v3/groups => generated 229 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:17:38.713910 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22156a-e684-432c-9b13-5708382ca13e None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:38.714273 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22156a-e684-432c-9b13-5708382ca13e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:38.714617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22156a-e684-432c-9b13-5708382ca13e None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:38.716275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 153/308] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:38.717239 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22156a-e684-432c-9b13-5708382ca13e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:38.840621 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c735e28-6e69-4652-a731-4de2a05c6908 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:38.857854 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22156a-e684-432c-9b13-5708382ca13e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:38.886336 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669597f-053a-4393-86cd-18a6512921a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:38.887090 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669597f-053a-4393-86cd-18a6512921a1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:38.887368 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669597f-053a-4393-86cd-18a6512921a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:38.887644 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669597f-053a-4393-86cd-18a6512921a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:38.888426 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669597f-053a-4393-86cd-18a6512921a1 None admin] RBAC: Adding query filter params (role.id=19ca99e30fa74961a6203a02a8317128, user.id=8b11e3f14e5f418886c9b1acfdb750a4, scope.system=all) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:38.888846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669597f-053a-4393-86cd-18a6512921a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:38.890225 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669597f-053a-4393-86cd-18a6512921a1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:38.897278 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 156/309] 10.222.0.96 () {56 vars in 1308 bytes} [Wed Aug 24 04:17:38 2022] GET /identity/v3/role_assignments?user.id=8b11e3f14e5f418886c9b1acfdb750a4&scope.system=all&role.id=19ca99e30fa74961a6203a02a8317128 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:38.898243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7468e3-1cd8-4db0-9a6c-a334cf02e9fa None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:38.898492 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7468e3-1cd8-4db0-9a6c-a334cf02e9fa None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:38.898887 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7468e3-1cd8-4db0-9a6c-a334cf02e9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:38.904075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea247f-79c8-4c6e-b0db-b46471b1b9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:38.905822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea247f-79c8-4c6e-b0db-b46471b1b9dc None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:38.905822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea247f-79c8-4c6e-b0db-b46471b1b9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:38.905822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea247f-79c8-4c6e-b0db-b46471b1b9dc None admin] PATH_INFO: `/v3/users/305c08dc7a914d128092a7b047daca71` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:38.907784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea247f-79c8-4c6e-b0db-b46471b1b9dc None admin] RBAC: Authorizing `identity:get_user(user_id=305c08dc7a914d128092a7b047daca71)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:38.909402 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea247f-79c8-4c6e-b0db-b46471b1b9dc None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:38.911896 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 154/310] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:38 2022] GET /identity/v3/users/305c08dc7a914d128092a7b047daca71 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:38.918057 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea247f-79c8-4c6e-b0db-b46471b1b9dc None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:38.932346 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bb7468e3-1cd8-4db0-9a6c-a334cf02e9fa None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:38.933644 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bb7468e3-1cd8-4db0-9a6c-a334cf02e9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:38.947877 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:38.966527 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:39.050338 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 157/311] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:39.068425 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea247f-79c8-4c6e-b0db-b46471b1b9dc None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:39.113052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef3ff2-05c5-4236-95ef-007b87b4d602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:39.113784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef3ff2-05c5-4236-95ef-007b87b4d602 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:39.114636 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef3ff2-05c5-4236-95ef-007b87b4d602 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:39.114978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef3ff2-05c5-4236-95ef-007b87b4d602 None admin] PATH_INFO: `/v3/system/users/305c08dc7a914d128092a7b047daca71/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:39.116436 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef3ff2-05c5-4236-95ef-007b87b4d602 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=305c08dc7a914d128092a7b047daca71, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:39.117864 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef3ff2-05c5-4236-95ef-007b87b4d602 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:39.128190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 155/312] 10.222.0.96 () {58 vars in 1334 bytes} [Wed Aug 24 04:17:38 2022] PUT /identity/v3/system/users/305c08dc7a914d128092a7b047daca71/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:17:39.333056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7468e3-1cd8-4db0-9a6c-a334cf02e9fa None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:39.443020 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7468e3-1cd8-4db0-9a6c-a334cf02e9fa None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:39.480918 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91c3d2-33f8-4c22-b4f7-e42efb6fbb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:39.481620 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91c3d2-33f8-4c22-b4f7-e42efb6fbb2e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:39.481912 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91c3d2-33f8-4c22-b4f7-e42efb6fbb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:39.482194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91c3d2-33f8-4c22-b4f7-e42efb6fbb2e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:39.493477 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91c3d2-33f8-4c22-b4f7-e42efb6fbb2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:39.498361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-7f91c3d2-33f8-4c22-b4f7-e42efb6fbb2e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:17:39.498361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:39.498361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:39.498361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:39.498361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:39.498361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:39.498361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:39.498361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:39.498361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:39.498361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:39.498361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:39.498361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:39.498361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:39.498361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:39.498361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:39.498361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:39.499640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:39.499640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:39.499640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:39.499640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:39.499640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:39.499640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:39.499640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:39.499640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:39.499640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:39.499640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:39.499640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:39.499640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:39.499640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:39.499640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:39.499640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:39.499640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:39.500419 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:39.500419 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:39.500419 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:39.500419 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:39.500419 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:39.500419 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:39.500419 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:39.500419 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:39.500419 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:39.500419 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:39.500419 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:17:39.500419 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:39.500419 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 158/313] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:39.505636 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef3ff2-05c5-4236-95ef-007b87b4d602 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:39.610057 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:39.617300 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef3ff2-05c5-4236-95ef-007b87b4d602 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:39.654754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf87ae7-29fb-4560-9b46-9acb9315a519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:39.655373 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf87ae7-29fb-4560-9b46-9acb9315a519 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:39.655661 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf87ae7-29fb-4560-9b46-9acb9315a519 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:39.655939 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf87ae7-29fb-4560-9b46-9acb9315a519 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:39.656611 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf87ae7-29fb-4560-9b46-9acb9315a519 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:39.656939 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf87ae7-29fb-4560-9b46-9acb9315a519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:39.658349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf87ae7-29fb-4560-9b46-9acb9315a519 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:39.668323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 156/314] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:39.674070 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91c3d2-33f8-4c22-b4f7-e42efb6fbb2e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:39.681043 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:39.787553 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91c3d2-33f8-4c22-b4f7-e42efb6fbb2e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:39.824368 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc08e3e-3ef2-4151-b223-16f65b27d965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:39.825482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc08e3e-3ef2-4151-b223-16f65b27d965 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:39.825774 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc08e3e-3ef2-4151-b223-16f65b27d965 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:39.826104 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc08e3e-3ef2-4151-b223-16f65b27d965 None admin] PATH_INFO: `/v3/users/e157a75a9dc34218b77d5ebfe774e706` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:39.830406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc08e3e-3ef2-4151-b223-16f65b27d965 None admin] RBAC: Authorizing `identity:get_user(user_id=e157a75a9dc34218b77d5ebfe774e706)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:39.831888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc08e3e-3ef2-4151-b223-16f65b27d965 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:39.834428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 159/315] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:39 2022] GET /identity/v3/users/e157a75a9dc34218b77d5ebfe774e706 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:39.840050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf87ae7-29fb-4560-9b46-9acb9315a519 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:39.978344 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf87ae7-29fb-4560-9b46-9acb9315a519 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:40.021475 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac29a9-ad9b-4e4c-84f0-006000fe9f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:40.022173 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac29a9-ad9b-4e4c-84f0-006000fe9f5a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:40.022489 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac29a9-ad9b-4e4c-84f0-006000fe9f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:40.022807 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac29a9-ad9b-4e4c-84f0-006000fe9f5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:40.055020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:40.111230 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac29a9-ad9b-4e4c-84f0-006000fe9f5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:40.112945 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac29a9-ad9b-4e4c-84f0-006000fe9f5a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:40.240345 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 157/316] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:40.245441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc08e3e-3ef2-4151-b223-16f65b27d965 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:40.326148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:40.364862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc08e3e-3ef2-4151-b223-16f65b27d965 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:40.405343 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c805f-a6cf-49f7-b785-94540ced5b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:40.406076 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c805f-a6cf-49f7-b785-94540ced5b70 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:40.406431 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c805f-a6cf-49f7-b785-94540ced5b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:40.406751 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c805f-a6cf-49f7-b785-94540ced5b70 None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:40.408025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c805f-a6cf-49f7-b785-94540ced5b70 None admin] RBAC: Authorizing `identity:get_project(project_id=131c2da412c94e35868fe9dc21137199)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:40.409674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c805f-a6cf-49f7-b785-94540ced5b70 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:40.412721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 160/317] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:40 2022] GET /identity/v3/projects/131c2da412c94e35868fe9dc21137199 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:40.421962 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac29a9-ad9b-4e4c-84f0-006000fe9f5a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:40.487940 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:40.545675 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac29a9-ad9b-4e4c-84f0-006000fe9f5a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:40.583981 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd2375-187e-4ba9-a3bc-d56483105a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:40.584617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd2375-187e-4ba9-a3bc-d56483105a7f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:40.584922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd2375-187e-4ba9-a3bc-d56483105a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:40.585288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd2375-187e-4ba9-a3bc-d56483105a7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:40.586282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd2375-187e-4ba9-a3bc-d56483105a7f None admin] RBAC: Adding query filter params (role.id=19ca99e30fa74961a6203a02a8317128, scope.project.id=131c2da412c94e35868fe9dc21137199, user.id=e157a75a9dc34218b77d5ebfe774e706) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:40.586876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd2375-187e-4ba9-a3bc-d56483105a7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:40.588358 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd2375-187e-4ba9-a3bc-d56483105a7f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:40.595415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 158/318] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:17:40 2022] GET /identity/v3/role_assignments?user.id=e157a75a9dc34218b77d5ebfe774e706&scope.project.id=131c2da412c94e35868fe9dc21137199&role.id=19ca99e30fa74961a6203a02a8317128 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:40.852119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fe02c-1359-4678-8215-72caabf91783 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:40.852662 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fe02c-1359-4678-8215-72caabf91783 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:40.852662 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fe02c-1359-4678-8215-72caabf91783 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:40.854219 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 161/319] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:40.865300 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda36a4-4428-4a1a-be6c-d37a2355daf4 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:40.865712 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda36a4-4428-4a1a-be6c-d37a2355daf4 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:40.866047 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda36a4-4428-4a1a-be6c-d37a2355daf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:40.886441 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9cda36a4-4428-4a1a-be6c-d37a2355daf4 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:40.888004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9cda36a4-4428-4a1a-be6c-d37a2355daf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:40.964321 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 159/320] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:40.986431 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd336c-21d6-43a0-bcaf-0ac60f446468 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:40.986729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd336c-21d6-43a0-bcaf-0ac60f446468 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:40.987218 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd336c-21d6-43a0-bcaf-0ac60f446468 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:40.991420 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 162/321] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:40.995447 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de7412-c7d6-4d1d-bd49-172936c4c2e0 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:40.995740 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de7412-c7d6-4d1d-bd49-172936c4c2e0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:40.996017 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de7412-c7d6-4d1d-bd49-172936c4c2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:41.017857 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-b5de7412-c7d6-4d1d-bd49-172936c4c2e0 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:41.018087 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b5de7412-c7d6-4d1d-bd49-172936c4c2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:41.078733 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:41.104566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 160/322] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:41.241529 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18f851-d1d8-405b-a7c3-94a94dec2943 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:41.241899 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18f851-d1d8-405b-a7c3-94a94dec2943 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:41.242125 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18f851-d1d8-405b-a7c3-94a94dec2943 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:41.243668 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 163/323] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:41.250002 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a67052-b790-4c4d-b676-3ec8b3e6d87f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:41.250291 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a67052-b790-4c4d-b676-3ec8b3e6d87f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:41.250571 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a67052-b790-4c4d-b676-3ec8b3e6d87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:41.270422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e9a67052-b790-4c4d-b676-3ec8b3e6d87f None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:41.271941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e9a67052-b790-4c4d-b676-3ec8b3e6d87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:41.287124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18f851-d1d8-405b-a7c3-94a94dec2943 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:41.362264 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 161/324] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:41.407437 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a67052-b790-4c4d-b676-3ec8b3e6d87f None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:41.444106 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18f851-d1d8-405b-a7c3-94a94dec2943 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:41.485222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68235589-bf04-4c2f-8ca1-10a34ebc8b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:41.486223 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68235589-bf04-4c2f-8ca1-10a34ebc8b5e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:41.486710 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68235589-bf04-4c2f-8ca1-10a34ebc8b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:41.487170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68235589-bf04-4c2f-8ca1-10a34ebc8b5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:41.488488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68235589-bf04-4c2f-8ca1-10a34ebc8b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:41.490761 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68235589-bf04-4c2f-8ca1-10a34ebc8b5e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:41.492640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 164/325] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:17:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:41.497965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68235589-bf04-4c2f-8ca1-10a34ebc8b5e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:41.513661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:41.556989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a67052-b790-4c4d-b676-3ec8b3e6d87f None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:41.573702 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:41.606379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb802a-f8d2-4e06-920a-3e1c50fded4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:41.607004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb802a-f8d2-4e06-920a-3e1c50fded4b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:41.607283 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb802a-f8d2-4e06-920a-3e1c50fded4b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:41.607616 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb802a-f8d2-4e06-920a-3e1c50fded4b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:41.622048 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb802a-f8d2-4e06-920a-3e1c50fded4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:41.626844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-8ecb802a-f8d2-4e06-920a-3e1c50fded4b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:17:41.626844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:41.626844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:41.626844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:41.626844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:41.626844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:41.626844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:41.626844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:41.626844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:41.626844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:41.626844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:41.626844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:41.626844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:41.626844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:41.626844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:41.626844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:41.628038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:41.628038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:41.628038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:41.628038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:41.628038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:41.628038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:41.628038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:41.628038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:41.628038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:41.628038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:41.628038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:41.628038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:41.628038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:41.628038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:41.628038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:41.628038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:41.629812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:41.629812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:41.629812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:41.629812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:41.629812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:41.629812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:41.629812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:41.629812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:41.629812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:41.629812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:41.629812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:17:41.629812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:41.629812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 162/326] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:41.634246 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb802a-f8d2-4e06-920a-3e1c50fded4b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:41.641995 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68235589-bf04-4c2f-8ca1-10a34ebc8b5e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:41.686444 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72ae69-e881-4f1f-988c-c70128bc35ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:41.687416 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72ae69-e881-4f1f-988c-c70128bc35ca None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:41.687788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72ae69-e881-4f1f-988c-c70128bc35ca None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:41.688071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72ae69-e881-4f1f-988c-c70128bc35ca None admin] PATH_INFO: `/v3/groups` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:41.688742 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72ae69-e881-4f1f-988c-c70128bc35ca None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:41.690208 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72ae69-e881-4f1f-988c-c70128bc35ca None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:41.707540 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 165/327] 10.222.0.96 () {60 vars in 1134 bytes} [Wed Aug 24 04:17:41 2022] POST /identity/v3/groups => generated 226 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:17:41.708926 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72ae69-e881-4f1f-988c-c70128bc35ca None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:41.779440 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb802a-f8d2-4e06-920a-3e1c50fded4b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:41.816130 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:41.824734 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c36e6-0813-4800-a6dc-2379a6de0cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:41.825374 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c36e6-0813-4800-a6dc-2379a6de0cea None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:41.831637 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c36e6-0813-4800-a6dc-2379a6de0cea None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:41.831967 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c36e6-0813-4800-a6dc-2379a6de0cea None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:41.833298 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c36e6-0813-4800-a6dc-2379a6de0cea None admin] RBAC: Adding query filter params (name=reader) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:41.833607 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c36e6-0813-4800-a6dc-2379a6de0cea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:41.835191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c36e6-0813-4800-a6dc-2379a6de0cea None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:41.849595 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 163/328] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:41.855465 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c36e6-0813-4800-a6dc-2379a6de0cea None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:41.876909 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72ae69-e881-4f1f-988c-c70128bc35ca None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:41.919228 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:41.924226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3aef3-6abc-4f1d-a37c-8e29930e91a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:41.924904 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3aef3-6abc-4f1d-a37c-8e29930e91a7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:41.925187 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3aef3-6abc-4f1d-a37c-8e29930e91a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:41.925456 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3aef3-6abc-4f1d-a37c-8e29930e91a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:41.943866 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3aef3-6abc-4f1d-a37c-8e29930e91a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:41.952375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-38f3aef3-6abc-4f1d-a37c-8e29930e91a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:41.952375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:41.952375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:41.952375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:41.952375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:41.952375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:41.952375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:41.952375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:41.952375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:41.952375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:41.952375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:41.952375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:41.952375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:41.952375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:41.952375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:41.952375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:41.953396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:41.953396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:41.953396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:41.953396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:41.953396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:41.953396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:41.953396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:41.953396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:41.953396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:41.953396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:41.953396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:41.953396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:41.953396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:41.953396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:41.953396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:41.953396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:41.954192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:41.954192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:41.954192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:41.954192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:41.954192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:41.954192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:41.954192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:41.954192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:41.954192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:41.954192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:41.954192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:41.954192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:41.954192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 166/329] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:41.960519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3aef3-6abc-4f1d-a37c-8e29930e91a7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:42.032927 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c36e6-0813-4800-a6dc-2379a6de0cea None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:42.080893 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f43de2-6111-4b25-8945-c6ca6744abab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:42.082263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f43de2-6111-4b25-8945-c6ca6744abab None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:42.083422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f43de2-6111-4b25-8945-c6ca6744abab None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:42.083708 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f43de2-6111-4b25-8945-c6ca6744abab None admin] PATH_INFO: `/v3/users/8b11e3f14e5f418886c9b1acfdb750a4` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:42.085051 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f43de2-6111-4b25-8945-c6ca6744abab None admin] RBAC: Authorizing `identity:get_user(user_id=8b11e3f14e5f418886c9b1acfdb750a4)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:42.086629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f43de2-6111-4b25-8945-c6ca6744abab None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:42.088421 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 164/330] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:41 2022] GET /identity/v3/users/8b11e3f14e5f418886c9b1acfdb750a4 => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:42.094183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f43de2-6111-4b25-8945-c6ca6744abab None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:42.113584 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3aef3-6abc-4f1d-a37c-8e29930e91a7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:42.155010 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:42.168251 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ea2f1-f812-402d-9d11-d01c5d14d087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:42.169191 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ea2f1-f812-402d-9d11-d01c5d14d087 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:42.169660 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ea2f1-f812-402d-9d11-d01c5d14d087 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:42.170130 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ea2f1-f812-402d-9d11-d01c5d14d087 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:42.171635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ea2f1-f812-402d-9d11-d01c5d14d087 None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:42.172114 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ea2f1-f812-402d-9d11-d01c5d14d087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:42.174015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ea2f1-f812-402d-9d11-d01c5d14d087 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:42.188966 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 167/331] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:42.195931 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ea2f1-f812-402d-9d11-d01c5d14d087 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:42.236470 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:42.244112 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f43de2-6111-4b25-8945-c6ca6744abab None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:42.298105 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416316c-e797-4c73-b65b-161b614df42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:42.299139 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416316c-e797-4c73-b65b-161b614df42e None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:42.299689 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416316c-e797-4c73-b65b-161b614df42e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:42.300263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416316c-e797-4c73-b65b-161b614df42e None admin] PATH_INFO: `/v3/system/users/8b11e3f14e5f418886c9b1acfdb750a4/roles/19ca99e30fa74961a6203a02a8317128` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:42.302189 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416316c-e797-4c73-b65b-161b614df42e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8b11e3f14e5f418886c9b1acfdb750a4, role_id=19ca99e30fa74961a6203a02a8317128)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:42.304644 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416316c-e797-4c73-b65b-161b614df42e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:42.316479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 165/332] 10.222.0.96 () {58 vars in 1334 bytes} [Wed Aug 24 04:17:42 2022] PUT /identity/v3/system/users/8b11e3f14e5f418886c9b1acfdb750a4/roles/19ca99e30fa74961a6203a02a8317128 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:17:42.360719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ea2f1-f812-402d-9d11-d01c5d14d087 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:42.409763 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18482175-5b2c-4cea-81e0-d758af3a286e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:42.410342 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18482175-5b2c-4cea-81e0-d758af3a286e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:42.410631 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18482175-5b2c-4cea-81e0-d758af3a286e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:42.411086 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18482175-5b2c-4cea-81e0-d758af3a286e None admin] PATH_INFO: `/v3/users/305c08dc7a914d128092a7b047daca71` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:42.412451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18482175-5b2c-4cea-81e0-d758af3a286e None admin] RBAC: Authorizing `identity:get_user(user_id=305c08dc7a914d128092a7b047daca71)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:42.414043 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18482175-5b2c-4cea-81e0-d758af3a286e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:42.416065 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 168/333] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:42 2022] GET /identity/v3/users/305c08dc7a914d128092a7b047daca71 => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:42.424422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416316c-e797-4c73-b65b-161b614df42e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:42.572095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416316c-e797-4c73-b65b-161b614df42e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:42.611895 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da36e34-e390-4780-b7c5-757c5f26b39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:42.612517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da36e34-e390-4780-b7c5-757c5f26b39f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:42.612903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da36e34-e390-4780-b7c5-757c5f26b39f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:42.613180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da36e34-e390-4780-b7c5-757c5f26b39f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:42.614447 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da36e34-e390-4780-b7c5-757c5f26b39f None admin] RBAC: Adding query filter params (role.id=dbb1f67486534e8dbbc250bfe0978e6c, user.id=305c08dc7a914d128092a7b047daca71, scope.system=all) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:42.614970 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da36e34-e390-4780-b7c5-757c5f26b39f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:42.617605 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da36e34-e390-4780-b7c5-757c5f26b39f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:42.633824 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 166/334] 10.222.0.96 () {56 vars in 1308 bytes} [Wed Aug 24 04:17:42 2022] GET /identity/v3/role_assignments?user.id=305c08dc7a914d128092a7b047daca71&scope.system=all&role.id=dbb1f67486534e8dbbc250bfe0978e6c => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:44.218939 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce6a1f-f977-49c3-b5ad-af32569bc3db None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:44.219423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce6a1f-f977-49c3-b5ad-af32569bc3db None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:44.219423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce6a1f-f977-49c3-b5ad-af32569bc3db None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:44.220813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 169/335] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:44.227581 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e5570-48bf-402b-9081-d19f128efc44 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:44.228078 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e5570-48bf-402b-9081-d19f128efc44 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:44.228274 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e5570-48bf-402b-9081-d19f128efc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:44.253705 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-7f0e5570-48bf-402b-9081-d19f128efc44 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:44.255589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7f0e5570-48bf-402b-9081-d19f128efc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:44.276264 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:44.346314 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 167/336] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:17:44.478236 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49907a0a-cd79-4b72-b3ba-93bc14d58ddc None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:44.478529 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49907a0a-cd79-4b72-b3ba-93bc14d58ddc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:44.478724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49907a0a-cd79-4b72-b3ba-93bc14d58ddc None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:44.480282 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 170/337] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:44.496204 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33337b2-4676-4533-a1f6-0a3b34a0a52c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:44.496528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33337b2-4676-4533-a1f6-0a3b34a0a52c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:44.496794 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33337b2-4676-4533-a1f6-0a3b34a0a52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:44.522191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a33337b2-4676-4533-a1f6-0a3b34a0a52c None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:44.523391 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a33337b2-4676-4533-a1f6-0a3b34a0a52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:44.627506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 168/338] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:44.727803 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351baa0c-bef2-4e58-a289-b9835d3f7366 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:44.728122 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351baa0c-bef2-4e58-a289-b9835d3f7366 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:44.728418 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351baa0c-bef2-4e58-a289-b9835d3f7366 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:44.730098 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 171/339] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:44.735235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773f8a1-b63a-450a-8bcf-73e3b6119a71 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:44.735523 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773f8a1-b63a-450a-8bcf-73e3b6119a71 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:44.735800 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773f8a1-b63a-450a-8bcf-73e3b6119a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:44.758334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351baa0c-bef2-4e58-a289-b9835d3f7366 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:44.761988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d773f8a1-b63a-450a-8bcf-73e3b6119a71 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:44.763231 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d773f8a1-b63a-450a-8bcf-73e3b6119a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:44.878883 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:44.881526 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 169/340] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:44.938002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351baa0c-bef2-4e58-a289-b9835d3f7366 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:44.980498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be7315-cfc2-4648-b248-6bb977c5b4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:44.981111 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be7315-cfc2-4648-b248-6bb977c5b4ed None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:44.981396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be7315-cfc2-4648-b248-6bb977c5b4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:44.981674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be7315-cfc2-4648-b248-6bb977c5b4ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:44.995758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be7315-cfc2-4648-b248-6bb977c5b4ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:45.000798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-a2be7315-cfc2-4648-b248-6bb977c5b4ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:45.000798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:45.000798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:45.000798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:45.000798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:45.000798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:45.000798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:45.000798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:45.000798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:45.000798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:45.000798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:45.000798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:45.000798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:45.000798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:45.000798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:45.000798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:45.001693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:45.001693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:45.001693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:45.001693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:45.001693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:45.001693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:45.001693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:45.001693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:45.001693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:45.001693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:45.001693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:45.001693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:45.001693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:45.001693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:45.001693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:45.001693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:45.002486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:45.002486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:45.002486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:45.002486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:45.002486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:45.002486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:45.002486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:45.002486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:45.002486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:45.002486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:45.002486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:45.002486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:45.002486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 172/341] 10.222.0.96 () {56 vars in 1114 bytes} [Wed Aug 24 04:17:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:45.008059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773f8a1-b63a-450a-8bcf-73e3b6119a71 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:45.023629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:45.129263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773f8a1-b63a-450a-8bcf-73e3b6119a71 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:45.175343 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c5168-d1e5-4a10-b2ef-ead3e9ca10bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:45.175964 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c5168-d1e5-4a10-b2ef-ead3e9ca10bb None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:45.176248 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c5168-d1e5-4a10-b2ef-ead3e9ca10bb None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:45.177115 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c5168-d1e5-4a10-b2ef-ead3e9ca10bb None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:45.177799 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c5168-d1e5-4a10-b2ef-ead3e9ca10bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:45.178108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c5168-d1e5-4a10-b2ef-ead3e9ca10bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:45.179561 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c5168-d1e5-4a10-b2ef-ead3e9ca10bb None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:45.192561 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 170/342] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:17:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:45.198719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be7315-cfc2-4648-b248-6bb977c5b4ed None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:45.221483 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c5168-d1e5-4a10-b2ef-ead3e9ca10bb None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:45.333926 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be7315-cfc2-4648-b248-6bb977c5b4ed None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:45.355215 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:45.379356 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:45.386325 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd234a2-f054-4696-826c-6f5081899534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:45.388228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd234a2-f054-4696-826c-6f5081899534 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:45.388228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd234a2-f054-4696-826c-6f5081899534 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:45.388228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd234a2-f054-4696-826c-6f5081899534 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:45.417688 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c5168-d1e5-4a10-b2ef-ead3e9ca10bb None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:45.489077 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b41f0f-39c9-401d-a357-ed4a599a28c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:45.490071 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b41f0f-39c9-401d-a357-ed4a599a28c6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:45.490375 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b41f0f-39c9-401d-a357-ed4a599a28c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:45.490651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b41f0f-39c9-401d-a357-ed4a599a28c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:45.502852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd234a2-f054-4696-826c-6f5081899534 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:45.503122 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b41f0f-39c9-401d-a357-ed4a599a28c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:45.505071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd234a2-f054-4696-826c-6f5081899534 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:45.509851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-84b41f0f-39c9-401d-a357-ed4a599a28c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:45.509851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:45.509851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:45.509851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:45.509851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:45.509851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:45.509851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:45.509851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:45.509851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:45.509851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:45.509851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:45.509851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:45.509851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:45.509851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:45.509851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:45.509851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:45.510838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:45.510838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:45.510838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:45.510838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:45.510838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:45.510838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:45.510838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:45.510838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:45.510838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:45.510838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:45.510838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:45.510838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:45.510838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:45.510838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:45.510838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:45.510838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:45.511719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:45.511719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:45.511719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:45.511719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:45.511719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:45.511719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:45.511719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:45.511719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:45.511719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:45.511719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:45.511719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:45.511719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:45.511719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 171/343] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:17:45.512566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1365d6-6668-4312-a8a6-73b4b3a99599 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:45.512566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1365d6-6668-4312-a8a6-73b4b3a99599 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:45.512566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1365d6-6668-4312-a8a6-73b4b3a99599 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:45.514025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 172/344] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:45.514726 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1365d6-6668-4312-a8a6-73b4b3a99599 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:45.659862 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1365d6-6668-4312-a8a6-73b4b3a99599 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:45.666578 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 173/345] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:45.670239 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e49885-88e8-4305-9adb-97a347a52eb8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:45.671182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e49885-88e8-4305-9adb-97a347a52eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:45.671486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e49885-88e8-4305-9adb-97a347a52eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:45.696119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c7e49885-88e8-4305-9adb-97a347a52eb8 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:45.697375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c7e49885-88e8-4305-9adb-97a347a52eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:45.718106 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:45.722093 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec477b7-b6fb-4bff-b0eb-670b49358b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:45.723150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec477b7-b6fb-4bff-b0eb-670b49358b75 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:45.724372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec477b7-b6fb-4bff-b0eb-670b49358b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:45.724943 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec477b7-b6fb-4bff-b0eb-670b49358b75 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:45.727705 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:45.741399 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec477b7-b6fb-4bff-b0eb-670b49358b75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:45.746599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-cec477b7-b6fb-4bff-b0eb-670b49358b75 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:17:45.746599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:45.746599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:45.746599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:45.746599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:45.746599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:45.746599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:45.746599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:45.746599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:45.746599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:45.746599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:45.746599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:45.746599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:45.746599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:45.746599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:45.746599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:45.747500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:45.747500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:45.747500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:45.747500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:45.747500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:45.747500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:45.747500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:45.747500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:45.747500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:45.747500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:45.747500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:45.747500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:45.747500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:45.747500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:45.747500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:45.747500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:45.748477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:45.748477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:45.748477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:45.748477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:45.748477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:45.748477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:45.748477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:45.748477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:45.748477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:45.748477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:45.748477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:17:45.748477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:45.751018 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 173/346] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:45.752019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec477b7-b6fb-4bff-b0eb-670b49358b75 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:45.800834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 174/347] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:45.802204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e49885-88e8-4305-9adb-97a347a52eb8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:45.886904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec477b7-b6fb-4bff-b0eb-670b49358b75 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:45.927618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8c331-f697-4351-b8d8-7980ae73672e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:45.928556 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8c331-f697-4351-b8d8-7980ae73672e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:45.929126 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8c331-f697-4351-b8d8-7980ae73672e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:45.929613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8c331-f697-4351-b8d8-7980ae73672e None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:45.930514 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8c331-f697-4351-b8d8-7980ae73672e None admin] RBAC: Adding query filter params (name=member) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:45.931023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8c331-f697-4351-b8d8-7980ae73672e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:45.932716 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8c331-f697-4351-b8d8-7980ae73672e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:45.942904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 174/348] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:45.944065 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8c331-f697-4351-b8d8-7980ae73672e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:46.006320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e49885-88e8-4305-9adb-97a347a52eb8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:46.010443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:46.071814 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8c331-f697-4351-b8d8-7980ae73672e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:46.081983 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0546c-8782-4743-a433-6bd10355e641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:46.083163 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0546c-8782-4743-a433-6bd10355e641 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:46.083464 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0546c-8782-4743-a433-6bd10355e641 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:46.083738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0546c-8782-4743-a433-6bd10355e641 None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:46.089478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0546c-8782-4743-a433-6bd10355e641 None admin] RBAC: Authorizing `identity:get_project(project_id=96630a4e703341619588eb5481011618)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:46.090959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0546c-8782-4743-a433-6bd10355e641 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:46.092662 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 175/349] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:45 2022] GET /identity/v3/projects/96630a4e703341619588eb5481011618 => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:46.093467 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0546c-8782-4743-a433-6bd10355e641 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:46.113434 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2012d73-0947-46e1-a176-11fa87efafba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:46.114468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2012d73-0947-46e1-a176-11fa87efafba None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:46.115001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2012d73-0947-46e1-a176-11fa87efafba None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:46.115465 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2012d73-0947-46e1-a176-11fa87efafba None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:46.116369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2012d73-0947-46e1-a176-11fa87efafba None admin] RBAC: Adding query filter params (name=reader) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:46.116877 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2012d73-0947-46e1-a176-11fa87efafba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:46.118445 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2012d73-0947-46e1-a176-11fa87efafba None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:46.119042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:46.127885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 175/350] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:46.129000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2012d73-0947-46e1-a176-11fa87efafba None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:46.213659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0546c-8782-4743-a433-6bd10355e641 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:46.247626 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2012d73-0947-46e1-a176-11fa87efafba None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:46.251533 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3960fe0-eaa2-491c-bfef-daffbb8259e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:46.252165 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3960fe0-eaa2-491c-bfef-daffbb8259e1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:46.252451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3960fe0-eaa2-491c-bfef-daffbb8259e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:46.252772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3960fe0-eaa2-491c-bfef-daffbb8259e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:46.267713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:46.290117 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e5f16-07d5-47e4-9e35-1dbbb6a6c156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:46.292062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e5f16-07d5-47e4-9e35-1dbbb6a6c156 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:46.292561 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e5f16-07d5-47e4-9e35-1dbbb6a6c156 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:46.293033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e5f16-07d5-47e4-9e35-1dbbb6a6c156 None admin] PATH_INFO: `/v3/groups/31d32a6489ef4c96bee919dc004b9b98` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:46.301084 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e5f16-07d5-47e4-9e35-1dbbb6a6c156 None admin] RBAC: Authorizing `identity:get_group(group_id=31d32a6489ef4c96bee919dc004b9b98)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:46.303668 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e5f16-07d5-47e4-9e35-1dbbb6a6c156 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:46.306692 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 176/351] 10.222.0.96 () {56 vars in 1180 bytes} [Wed Aug 24 04:17:46 2022] GET /identity/v3/groups/31d32a6489ef4c96bee919dc004b9b98 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:46.307676 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e5f16-07d5-47e4-9e35-1dbbb6a6c156 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:46.342029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3960fe0-eaa2-491c-bfef-daffbb8259e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:46.343712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3960fe0-eaa2-491c-bfef-daffbb8259e1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:46.364894 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:46.453230 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e5f16-07d5-47e4-9e35-1dbbb6a6c156 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:46.488289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 176/352] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:46.493075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3960fe0-eaa2-491c-bfef-daffbb8259e1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:46.501260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9839e-91be-44d0-b6f8-8bdb80ad6943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:46.502254 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9839e-91be-44d0-b6f8-8bdb80ad6943 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:46.502769 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9839e-91be-44d0-b6f8-8bdb80ad6943 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:46.503249 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9839e-91be-44d0-b6f8-8bdb80ad6943 None admin] PATH_INFO: `/v3/users/8b11e3f14e5f418886c9b1acfdb750a4` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:46.509342 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9839e-91be-44d0-b6f8-8bdb80ad6943 None admin] RBAC: Authorizing `identity:get_user(user_id=8b11e3f14e5f418886c9b1acfdb750a4)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:46.510826 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9839e-91be-44d0-b6f8-8bdb80ad6943 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:46.516247 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 177/353] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:17:46 2022] GET /identity/v3/users/8b11e3f14e5f418886c9b1acfdb750a4 => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:46.517216 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9839e-91be-44d0-b6f8-8bdb80ad6943 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:46.592140 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:46.629731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3960fe0-eaa2-491c-bfef-daffbb8259e1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:46.651669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:46.660597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9839e-91be-44d0-b6f8-8bdb80ad6943 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:46.675448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823c470-b5c1-4bf6-896a-7b0c5e1fb328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:46.676096 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823c470-b5c1-4bf6-896a-7b0c5e1fb328 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:46.676421 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823c470-b5c1-4bf6-896a-7b0c5e1fb328 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:46.677229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823c470-b5c1-4bf6-896a-7b0c5e1fb328 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:46.692332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823c470-b5c1-4bf6-896a-7b0c5e1fb328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:46.702848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-7823c470-b5c1-4bf6-896a-7b0c5e1fb328 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:46.702848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:46.702848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:46.702848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:46.702848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:46.702848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:46.702848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:46.702848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:46.702848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:46.702848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:46.702848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:46.702848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:46.702848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:46.702848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:46.702848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:46.702848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:46.703896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:46.703896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:46.703896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:46.703896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:46.703896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:46.703896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:46.703896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:46.703896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:46.703896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:46.703896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:46.703896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:46.703896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:46.703896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:46.703896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:46.703896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:46.703896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:46.704929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:46.704929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:46.704929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:46.704929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:46.704929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:46.704929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:46.704929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:46.704929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:46.704929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:46.704929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:46.704929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:46.704929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:46.704929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 177/354] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:46.704929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0cf11-af8e-4608-b177-bc70d969b8fc None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:46.705775 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0cf11-af8e-4608-b177-bc70d969b8fc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:46.705775 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0cf11-af8e-4608-b177-bc70d969b8fc None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:46.705775 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 178/355] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:46.708892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0cf11-af8e-4608-b177-bc70d969b8fc None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:46.715380 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bff50-2e66-40b4-9c76-80018e39ef6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:46.716014 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bff50-2e66-40b4-9c76-80018e39ef6c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:46.716300 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bff50-2e66-40b4-9c76-80018e39ef6c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:46.716579 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968bff50-2e66-40b4-9c76-80018e39ef6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:46.717407 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bff50-2e66-40b4-9c76-80018e39ef6c None admin] RBAC: Adding query filter params (group.id=31d32a6489ef4c96bee919dc004b9b98, role.id=b78ed83a66fe4531900cc02bb745f80f, scope.project.id=96630a4e703341619588eb5481011618) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:46.717730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bff50-2e66-40b4-9c76-80018e39ef6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:46.719200 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968bff50-2e66-40b4-9c76-80018e39ef6c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:46.730319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 178/356] 10.222.0.96 () {56 vars in 1376 bytes} [Wed Aug 24 04:17:46 2022] GET /identity/v3/role_assignments?group.id=31d32a6489ef4c96bee919dc004b9b98&scope.project.id=96630a4e703341619588eb5481011618&role.id=b78ed83a66fe4531900cc02bb745f80f => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:46.731167 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bff50-2e66-40b4-9c76-80018e39ef6c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:46.866221 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0cf11-af8e-4608-b177-bc70d969b8fc None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:46.914580 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be13316-5cc9-4f43-a0c3-4edd6fae0966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:46.914830 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be13316-5cc9-4f43-a0c3-4edd6fae0966 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:46.915120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be13316-5cc9-4f43-a0c3-4edd6fae0966 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:46.915402 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be13316-5cc9-4f43-a0c3-4edd6fae0966 None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:46.915705 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968bff50-2e66-40b4-9c76-80018e39ef6c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:46.917561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be13316-5cc9-4f43-a0c3-4edd6fae0966 None admin] RBAC: Authorizing `identity:get_project(project_id=96630a4e703341619588eb5481011618)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:46.919977 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be13316-5cc9-4f43-a0c3-4edd6fae0966 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:46.921713 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 179/357] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:46 2022] GET /identity/v3/projects/96630a4e703341619588eb5481011618 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:46.922605 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be13316-5cc9-4f43-a0c3-4edd6fae0966 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:46.933785 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:46.961811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a449e-2978-463c-a91b-312acd031118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:46.961811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a449e-2978-463c-a91b-312acd031118 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:46.961811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a449e-2978-463c-a91b-312acd031118 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:46.961811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a449e-2978-463c-a91b-312acd031118 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:46.962525 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a449e-2978-463c-a91b-312acd031118 None admin] RBAC: Adding query filter params (role.id=19ca99e30fa74961a6203a02a8317128, user.id=8b11e3f14e5f418886c9b1acfdb750a4, scope.system=all) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:46.962844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a449e-2978-463c-a91b-312acd031118 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:46.964585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a449e-2978-463c-a91b-312acd031118 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:46.983456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 179/358] 10.222.0.96 () {56 vars in 1308 bytes} [Wed Aug 24 04:17:46 2022] GET /identity/v3/role_assignments?user.id=8b11e3f14e5f418886c9b1acfdb750a4&scope.system=all&role.id=19ca99e30fa74961a6203a02a8317128 => generated 510 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:46.984740 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bf809-bd24-4432-a069-eb3dbca27628 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:46.986837 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bf809-bd24-4432-a069-eb3dbca27628 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:46.987120 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bf809-bd24-4432-a069-eb3dbca27628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:46.996335 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:47.021862 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-c74bf809-bd24-4432-a069-eb3dbca27628 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:47.024075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c74bf809-bd24-4432-a069-eb3dbca27628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:47.090079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be13316-5cc9-4f43-a0c3-4edd6fae0966 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:47.127972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 180/359] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:47.130295 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6d11a-76e9-4ebf-b7e7-89d3b4c1c71d None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:47.130689 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6d11a-76e9-4ebf-b7e7-89d3b4c1c71d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:47.131060 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6d11a-76e9-4ebf-b7e7-89d3b4c1c71d None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:47.133170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 181/360] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:47.136717 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6d11a-76e9-4ebf-b7e7-89d3b4c1c71d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:47.151971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39686662-8c47-4631-9db9-5c46f3190614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:47.153071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39686662-8c47-4631-9db9-5c46f3190614 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:47.153800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39686662-8c47-4631-9db9-5c46f3190614 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:47.154661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39686662-8c47-4631-9db9-5c46f3190614 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:47.156243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39686662-8c47-4631-9db9-5c46f3190614 None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:47.157055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39686662-8c47-4631-9db9-5c46f3190614 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:47.158913 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39686662-8c47-4631-9db9-5c46f3190614 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:47.178073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 180/361] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:47.179441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51dc14-6521-4000-aa6c-6a51038c7809 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:47.179729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51dc14-6521-4000-aa6c-6a51038c7809 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:47.180005 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51dc14-6521-4000-aa6c-6a51038c7809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:47.199402 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8d51dc14-6521-4000-aa6c-6a51038c7809 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:47.200604 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8d51dc14-6521-4000-aa6c-6a51038c7809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:47.281742 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6d11a-76e9-4ebf-b7e7-89d3b4c1c71d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:47.283973 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:47.288022 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 181/362] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:47.289028 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51dc14-6521-4000-aa6c-6a51038c7809 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:47.332575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:47.339993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229fb29-7f3b-4e1f-b7b3-c07f19fdd1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:47.341031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229fb29-7f3b-4e1f-b7b3-c07f19fdd1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:47.341540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229fb29-7f3b-4e1f-b7b3-c07f19fdd1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:47.342016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229fb29-7f3b-4e1f-b7b3-c07f19fdd1f6 None admin] PATH_INFO: `/v3/groups/31d32a6489ef4c96bee919dc004b9b98` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:47.343436 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229fb29-7f3b-4e1f-b7b3-c07f19fdd1f6 None admin] RBAC: Authorizing `identity:get_group(group_id=31d32a6489ef4c96bee919dc004b9b98)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:47.345286 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229fb29-7f3b-4e1f-b7b3-c07f19fdd1f6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:47.348219 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 182/363] 10.222.0.96 () {56 vars in 1180 bytes} [Wed Aug 24 04:17:47 2022] GET /identity/v3/groups/31d32a6489ef4c96bee919dc004b9b98 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:47.357004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229fb29-7f3b-4e1f-b7b3-c07f19fdd1f6 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:47.443110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51dc14-6521-4000-aa6c-6a51038c7809 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:47.487356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f4033-38c8-43d4-a46d-73189fc4fbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:47.488391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f4033-38c8-43d4-a46d-73189fc4fbab None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:47.489042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f4033-38c8-43d4-a46d-73189fc4fbab None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:47.489625 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f4033-38c8-43d4-a46d-73189fc4fbab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:47.499252 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229fb29-7f3b-4e1f-b7b3-c07f19fdd1f6 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:47.538069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7db7e7-e542-4afe-95f1-f153b172187c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:47.539003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7db7e7-e542-4afe-95f1-f153b172187c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:47.539003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7db7e7-e542-4afe-95f1-f153b172187c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:47.539276 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7db7e7-e542-4afe-95f1-f153b172187c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:47.539977 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7db7e7-e542-4afe-95f1-f153b172187c None admin] RBAC: Adding query filter params (group.id=31d32a6489ef4c96bee919dc004b9b98, role.id=dbb1f67486534e8dbbc250bfe0978e6c, scope.project.id=96630a4e703341619588eb5481011618) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:47.540291 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7db7e7-e542-4afe-95f1-f153b172187c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:47.541782 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7db7e7-e542-4afe-95f1-f153b172187c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:47.547967 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 183/364] 10.222.0.96 () {56 vars in 1376 bytes} [Wed Aug 24 04:17:47 2022] GET /identity/v3/role_assignments?group.id=31d32a6489ef4c96bee919dc004b9b98&scope.project.id=96630a4e703341619588eb5481011618&role.id=dbb1f67486534e8dbbc250bfe0978e6c => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:47.573799 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f4033-38c8-43d4-a46d-73189fc4fbab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:47.575703 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f4033-38c8-43d4-a46d-73189fc4fbab None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:47.617713 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:47.703424 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 182/365] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:47.710137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7db7e7-e542-4afe-95f1-f153b172187c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:47.739375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f4033-38c8-43d4-a46d-73189fc4fbab None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:47.755225 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:47.852438 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7db7e7-e542-4afe-95f1-f153b172187c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:47.866122 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f4033-38c8-43d4-a46d-73189fc4fbab None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:47.915463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9331f-7eb6-4eee-acbc-afb0e69d5b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:47.916047 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9331f-7eb6-4eee-acbc-afb0e69d5b0a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:47.916331 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9331f-7eb6-4eee-acbc-afb0e69d5b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:47.916607 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9331f-7eb6-4eee-acbc-afb0e69d5b0a None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:47.919074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9331f-7eb6-4eee-acbc-afb0e69d5b0a None admin] RBAC: Authorizing `identity:get_project(project_id=131c2da412c94e35868fe9dc21137199)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:47.920530 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9331f-7eb6-4eee-acbc-afb0e69d5b0a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:47.922367 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 184/366] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:47 2022] GET /identity/v3/projects/131c2da412c94e35868fe9dc21137199 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:47.923951 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9331f-7eb6-4eee-acbc-afb0e69d5b0a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:47.930060 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37ce4b-04e0-4ab9-acae-72d55507df64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:47.930721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37ce4b-04e0-4ab9-acae-72d55507df64 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:47.931006 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37ce4b-04e0-4ab9-acae-72d55507df64 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:47.931283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37ce4b-04e0-4ab9-acae-72d55507df64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:47.934324 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:47.945106 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37ce4b-04e0-4ab9-acae-72d55507df64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:47.950369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-dd37ce4b-04e0-4ab9-acae-72d55507df64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:47.950369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:47.950369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:47.950369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:47.950369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:47.950369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:47.950369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:47.950369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:47.950369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:47.950369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:47.950369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:47.950369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:47.950369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:47.950369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:47.950369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:47.950369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:47.951293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:47.951293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:47.951293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:47.951293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:47.951293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:47.951293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:47.951293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:47.951293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:47.951293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:47.951293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:47.951293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:47.951293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:47.951293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:47.951293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:47.951293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:47.951293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:47.952128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:47.952128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:47.952128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:47.952128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:47.952128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:47.952128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:47.952128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:47.952128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:47.952128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:47.952128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:47.952128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:47.952128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:47.952128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 183/367] 10.222.0.96 () {56 vars in 1114 bytes} [Wed Aug 24 04:17:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:17:47.953521 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37ce4b-04e0-4ab9-acae-72d55507df64 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:48.063435 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9331f-7eb6-4eee-acbc-afb0e69d5b0a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:48.065594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:48.092282 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37ce4b-04e0-4ab9-acae-72d55507df64 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:48.106240 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ed6ed-1095-42bf-9528-a3e5bf38e13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:48.107014 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ed6ed-1095-42bf-9528-a3e5bf38e13f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:48.107483 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ed6ed-1095-42bf-9528-a3e5bf38e13f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:48.108009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ed6ed-1095-42bf-9528-a3e5bf38e13f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:48.120947 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ed6ed-1095-42bf-9528-a3e5bf38e13f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:48.126493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-548ed6ed-1095-42bf-9528-a3e5bf38e13f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:17:48.126493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:48.126493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:48.126493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:48.126493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:48.126493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:48.126493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:48.126493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:48.126493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:48.126493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:48.126493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:48.126493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:48.126493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:48.126493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:48.126493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:48.126493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:48.127659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:48.127659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:48.127659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:48.127659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:48.127659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:48.127659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:48.127659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:48.127659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:48.127659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:48.127659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:48.127659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:48.127659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:48.127659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:48.127659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:48.127659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:48.127659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:48.128551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:48.128551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:48.128551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:48.128551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:48.128551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:48.128551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:48.128551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:48.128551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:48.128551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:48.128551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:48.128551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:17:48.128551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:48.129255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 185/368] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:17:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:48.131053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ed6ed-1095-42bf-9528-a3e5bf38e13f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:48.139821 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18959269-5d62-47a4-bdc5-33137340fd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:48.140833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18959269-5d62-47a4-bdc5-33137340fd2b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:48.141330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18959269-5d62-47a4-bdc5-33137340fd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:48.141820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18959269-5d62-47a4-bdc5-33137340fd2b None admin] PATH_INFO: `/v3/groups/31d32a6489ef4c96bee919dc004b9b98` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:48.143193 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18959269-5d62-47a4-bdc5-33137340fd2b None admin] RBAC: Authorizing `identity:get_group(group_id=31d32a6489ef4c96bee919dc004b9b98)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:48.145069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18959269-5d62-47a4-bdc5-33137340fd2b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:48.147371 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 184/369] 10.222.0.96 () {56 vars in 1180 bytes} [Wed Aug 24 04:17:47 2022] GET /identity/v3/groups/31d32a6489ef4c96bee919dc004b9b98 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:48.148456 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18959269-5d62-47a4-bdc5-33137340fd2b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:48.275671 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ed6ed-1095-42bf-9528-a3e5bf38e13f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:48.276297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:48.314806 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51420f4-446e-4bac-8e62-8e3c1edaf88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:48.315428 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51420f4-446e-4bac-8e62-8e3c1edaf88e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:48.315713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51420f4-446e-4bac-8e62-8e3c1edaf88e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:48.315990 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51420f4-446e-4bac-8e62-8e3c1edaf88e None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:48.316740 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51420f4-446e-4bac-8e62-8e3c1edaf88e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:48.317091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51420f4-446e-4bac-8e62-8e3c1edaf88e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:48.318477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51420f4-446e-4bac-8e62-8e3c1edaf88e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:48.327816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 186/370] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:17:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:48.328669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51420f4-446e-4bac-8e62-8e3c1edaf88e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:48.344141 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18959269-5d62-47a4-bdc5-33137340fd2b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:48.357899 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:48.420082 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3061d58-a6a4-492c-9ad9-7cb59f479b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:48.420777 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3061d58-a6a4-492c-9ad9-7cb59f479b7c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:48.421050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3061d58-a6a4-492c-9ad9-7cb59f479b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:48.421329 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3061d58-a6a4-492c-9ad9-7cb59f479b7c None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:48.422023 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3061d58-a6a4-492c-9ad9-7cb59f479b7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:48.422444 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3061d58-a6a4-492c-9ad9-7cb59f479b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:48.423951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3061d58-a6a4-492c-9ad9-7cb59f479b7c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:48.434738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 185/371] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:48.435596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3061d58-a6a4-492c-9ad9-7cb59f479b7c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:48.469481 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51420f4-446e-4bac-8e62-8e3c1edaf88e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:48.511611 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0c9a8-3a25-48cc-b9f8-f4920a446e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:48.512403 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0c9a8-3a25-48cc-b9f8-f4920a446e6a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:48.512606 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0c9a8-3a25-48cc-b9f8-f4920a446e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:48.512934 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0c9a8-3a25-48cc-b9f8-f4920a446e6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:48.513685 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0c9a8-3a25-48cc-b9f8-f4920a446e6a None admin] RBAC: Adding query filter params (group.id=31d32a6489ef4c96bee919dc004b9b98, role.id=dbb1f67486534e8dbbc250bfe0978e6c, scope.project.id=131c2da412c94e35868fe9dc21137199) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:48.514001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0c9a8-3a25-48cc-b9f8-f4920a446e6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:48.515467 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0c9a8-3a25-48cc-b9f8-f4920a446e6a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:48.522683 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 187/372] 10.222.0.96 () {56 vars in 1376 bytes} [Wed Aug 24 04:17:48 2022] GET /identity/v3/role_assignments?group.id=31d32a6489ef4c96bee919dc004b9b98&scope.project.id=131c2da412c94e35868fe9dc21137199&role.id=dbb1f67486534e8dbbc250bfe0978e6c => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:48.523498 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0c9a8-3a25-48cc-b9f8-f4920a446e6a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:48.572180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3061d58-a6a4-492c-9ad9-7cb59f479b7c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:48.616021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:48.620262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc8f99-cef1-471b-8678-e0b7278edf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:48.620954 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc8f99-cef1-471b-8678-e0b7278edf16 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:48.621407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc8f99-cef1-471b-8678-e0b7278edf16 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:48.621698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc8f99-cef1-471b-8678-e0b7278edf16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:48.701782 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:48.705143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0c9a8-3a25-48cc-b9f8-f4920a446e6a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:48.750164 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac3a86-4abb-413d-8fdb-f5de54b1fd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:48.750819 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac3a86-4abb-413d-8fdb-f5de54b1fd90 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:48.751104 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac3a86-4abb-413d-8fdb-f5de54b1fd90 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:48.751383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac3a86-4abb-413d-8fdb-f5de54b1fd90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:48.815254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc8f99-cef1-471b-8678-e0b7278edf16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:48.819575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc8f99-cef1-471b-8678-e0b7278edf16 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:48.844713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac3a86-4abb-413d-8fdb-f5de54b1fd90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:48.846212 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac3a86-4abb-413d-8fdb-f5de54b1fd90 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:48.981846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 186/373] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:48.988113 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc8f99-cef1-471b-8678-e0b7278edf16 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:49.034385 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:49.049076 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:49.083574 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 188/374] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:49.089650 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac3a86-4abb-413d-8fdb-f5de54b1fd90 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:49.117230 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc8f99-cef1-471b-8678-e0b7278edf16 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:49.157943 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb7c51-6b07-4f5b-b3aa-e1eff81bbaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:49.158590 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb7c51-6b07-4f5b-b3aa-e1eff81bbaf9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:49.158866 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb7c51-6b07-4f5b-b3aa-e1eff81bbaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:49.159140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb7c51-6b07-4f5b-b3aa-e1eff81bbaf9 None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:49.161779 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb7c51-6b07-4f5b-b3aa-e1eff81bbaf9 None admin] RBAC: Authorizing `identity:get_project(project_id=131c2da412c94e35868fe9dc21137199)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:49.163315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb7c51-6b07-4f5b-b3aa-e1eff81bbaf9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:49.165157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 187/375] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:48 2022] GET /identity/v3/projects/131c2da412c94e35868fe9dc21137199 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:49.171402 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb7c51-6b07-4f5b-b3aa-e1eff81bbaf9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:49.284486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:49.292532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb7c51-6b07-4f5b-b3aa-e1eff81bbaf9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:49.309971 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac3a86-4abb-413d-8fdb-f5de54b1fd90 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:49.338939 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16446ad-00be-4347-b1bb-31e3be674834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:49.339178 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16446ad-00be-4347-b1bb-31e3be674834 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:49.339347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16446ad-00be-4347-b1bb-31e3be674834 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:49.339592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16446ad-00be-4347-b1bb-31e3be674834 None admin] PATH_INFO: `/v3/groups/31d32a6489ef4c96bee919dc004b9b98` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:49.340997 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16446ad-00be-4347-b1bb-31e3be674834 None admin] RBAC: Authorizing `identity:get_group(group_id=31d32a6489ef4c96bee919dc004b9b98)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:49.343171 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16446ad-00be-4347-b1bb-31e3be674834 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:49.345618 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 188/376] 10.222.0.96 () {56 vars in 1180 bytes} [Wed Aug 24 04:17:49 2022] GET /identity/v3/groups/31d32a6489ef4c96bee919dc004b9b98 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:49.347495 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db046f55-c02a-4e2e-a440-28e1b21eb27a None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:49.347779 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db046f55-c02a-4e2e-a440-28e1b21eb27a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:49.348051 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db046f55-c02a-4e2e-a440-28e1b21eb27a None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:49.353573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 189/377] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:49.355534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db046f55-c02a-4e2e-a440-28e1b21eb27a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:49.361957 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463299b6-4e1e-4f85-9519-e0b24b575251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:49.362608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463299b6-4e1e-4f85-9519-e0b24b575251 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:49.362891 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463299b6-4e1e-4f85-9519-e0b24b575251 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:49.363166 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463299b6-4e1e-4f85-9519-e0b24b575251 None admin] PATH_INFO: `/v3/projects/cc9d6801b4c048408ddddff5c9f8e743` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:49.364606 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463299b6-4e1e-4f85-9519-e0b24b575251 None admin] RBAC: Authorizing `identity:get_project(project_id=cc9d6801b4c048408ddddff5c9f8e743)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:49.366120 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463299b6-4e1e-4f85-9519-e0b24b575251 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:49.367811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 189/378] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:49 2022] GET /identity/v3/projects/cc9d6801b4c048408ddddff5c9f8e743 => generated 344 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:49.369182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed11ffe-e8ac-4ff9-b278-36d14a7fb1e7 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:49.369520 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed11ffe-e8ac-4ff9-b278-36d14a7fb1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:49.369797 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed11ffe-e8ac-4ff9-b278-36d14a7fb1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:49.390808 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-eed11ffe-e8ac-4ff9-b278-36d14a7fb1e7 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:49.392034 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-eed11ffe-e8ac-4ff9-b278-36d14a7fb1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:49.454793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:49.475209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 190/379] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:49.476298 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed11ffe-e8ac-4ff9-b278-36d14a7fb1e7 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:49.496669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db046f55-c02a-4e2e-a440-28e1b21eb27a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:49.541720 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6c01f-79ec-4339-9339-744aae3e44fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:49.541949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6c01f-79ec-4339-9339-744aae3e44fb None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:49.542313 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6c01f-79ec-4339-9339-744aae3e44fb None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:49.542431 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6c01f-79ec-4339-9339-744aae3e44fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:49.543166 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6c01f-79ec-4339-9339-744aae3e44fb None admin] RBAC: Adding query filter params (group.id=31d32a6489ef4c96bee919dc004b9b98, role.id=b78ed83a66fe4531900cc02bb745f80f, scope.project.id=131c2da412c94e35868fe9dc21137199) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:49.543483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6c01f-79ec-4339-9339-744aae3e44fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:49.546998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6c01f-79ec-4339-9339-744aae3e44fb None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:49.562732 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 190/380] 10.222.0.96 () {56 vars in 1376 bytes} [Wed Aug 24 04:17:49 2022] GET /identity/v3/role_assignments?group.id=31d32a6489ef4c96bee919dc004b9b98&scope.project.id=131c2da412c94e35868fe9dc21137199&role.id=b78ed83a66fe4531900cc02bb745f80f => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:49.611920 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed11ffe-e8ac-4ff9-b278-36d14a7fb1e7 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:49.655197 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d5d41-1c99-4357-bd2f-97d818d23199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:49.655860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d5d41-1c99-4357-bd2f-97d818d23199 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:49.656136 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d5d41-1c99-4357-bd2f-97d818d23199 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:49.656404 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d5d41-1c99-4357-bd2f-97d818d23199 None admin] PATH_INFO: `/v3/groups/109cf1dd8c684ad4b440393c5ceca526` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:49.664410 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d5d41-1c99-4357-bd2f-97d818d23199 None admin] RBAC: Authorizing `identity:get_group(group_id=109cf1dd8c684ad4b440393c5ceca526)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:49.665931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d5d41-1c99-4357-bd2f-97d818d23199 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:49.667956 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 191/381] 10.222.0.96 () {56 vars in 1180 bytes} [Wed Aug 24 04:17:49 2022] GET /identity/v3/groups/109cf1dd8c684ad4b440393c5ceca526 => generated 229 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:49.675121 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6c01f-79ec-4339-9339-744aae3e44fb None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:49.727590 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:49.826027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6c01f-79ec-4339-9339-744aae3e44fb None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:49.869926 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5e8f9-b92a-4453-be9a-ba97b38281a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:49.870483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5e8f9-b92a-4453-be9a-ba97b38281a8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:49.870764 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5e8f9-b92a-4453-be9a-ba97b38281a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:49.871040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5e8f9-b92a-4453-be9a-ba97b38281a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:49.871797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5e8f9-b92a-4453-be9a-ba97b38281a8 None admin] RBAC: Adding query filter params (group.id=109cf1dd8c684ad4b440393c5ceca526, role.id=059d2bf5bb8e42939f5f826bfdad6a21, scope.project.id=cc9d6801b4c048408ddddff5c9f8e743) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:49.872108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5e8f9-b92a-4453-be9a-ba97b38281a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:49.873606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5e8f9-b92a-4453-be9a-ba97b38281a8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:49.880170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d5d41-1c99-4357-bd2f-97d818d23199 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:49.882330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 191/382] 10.222.0.96 () {56 vars in 1376 bytes} [Wed Aug 24 04:17:49 2022] GET /identity/v3/role_assignments?group.id=109cf1dd8c684ad4b440393c5ceca526&scope.project.id=cc9d6801b4c048408ddddff5c9f8e743&role.id=059d2bf5bb8e42939f5f826bfdad6a21 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:49.976358 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:50.056796 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d5d41-1c99-4357-bd2f-97d818d23199 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:50.095708 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c0ed9-b1c8-47ca-b252-679a8f147b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:50.096751 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c0ed9-b1c8-47ca-b252-679a8f147b4f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:50.097251 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c0ed9-b1c8-47ca-b252-679a8f147b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:50.097726 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c0ed9-b1c8-47ca-b252-679a8f147b4f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:50.109608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c0ed9-b1c8-47ca-b252-679a8f147b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:50.115338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-ee5c0ed9-b1c8-47ca-b252-679a8f147b4f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:50.115338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:50.115338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:50.115338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:50.115338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:50.115338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:50.115338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:50.115338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:50.115338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:50.115338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:50.115338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:50.115338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:50.115338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:50.115338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:50.115338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:50.115338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:50.116235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:50.116235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:50.116235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:50.116235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:50.116235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:50.116235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:50.116235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:50.116235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:50.116235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:50.116235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:50.116235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:50.116235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:50.116235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:50.116235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:50.116235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:50.116235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:50.117377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:50.117377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:50.117377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:50.117377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:50.117377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:50.117377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:50.117377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:50.117377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:50.117377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:50.117377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:50.117377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:50.117377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:50.119840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 192/383] 10.222.0.96 () {56 vars in 1114 bytes} [Wed Aug 24 04:17:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:17:50.125683 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5e8f9-b92a-4453-be9a-ba97b38281a8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:50.147076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb648390-31b6-4112-baa0-1bc9e6fe231e None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:50.147688 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb648390-31b6-4112-baa0-1bc9e6fe231e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:50.148164 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb648390-31b6-4112-baa0-1bc9e6fe231e None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:50.150037 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 193/384] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:50.155501 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5161f8-cf1b-4028-9d14-2025d4cda7a9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:50.156035 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5161f8-cf1b-4028-9d14-2025d4cda7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:50.156503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5161f8-cf1b-4028-9d14-2025d4cda7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:50.182838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-5c5161f8-cf1b-4028-9d14-2025d4cda7a9 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:50.184436 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5c5161f8-cf1b-4028-9d14-2025d4cda7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:50.242362 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:50.252956 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5e8f9-b92a-4453-be9a-ba97b38281a8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:50.280959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 194/385] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:17:50.310807 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87158af-1c07-40c7-8b48-5e5304931d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:50.311420 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87158af-1c07-40c7-8b48-5e5304931d47 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:50.311701 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87158af-1c07-40c7-8b48-5e5304931d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:50.312023 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87158af-1c07-40c7-8b48-5e5304931d47 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:50.312711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87158af-1c07-40c7-8b48-5e5304931d47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:50.313022 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87158af-1c07-40c7-8b48-5e5304931d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:50.314457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87158af-1c07-40c7-8b48-5e5304931d47 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:50.327651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 192/386] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:17:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:50.332470 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5161f8-cf1b-4028-9d14-2025d4cda7a9 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:50.388066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:50.469944 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5161f8-cf1b-4028-9d14-2025d4cda7a9 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:50.511442 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac3945-35bf-4523-833d-0a555310371b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:50.512089 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac3945-35bf-4523-833d-0a555310371b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:50.512369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac3945-35bf-4523-833d-0a555310371b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:50.512643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac3945-35bf-4523-833d-0a555310371b None admin] PATH_INFO: `/v3/groups/31d32a6489ef4c96bee919dc004b9b98` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:50.513963 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac3945-35bf-4523-833d-0a555310371b None admin] RBAC: Authorizing `identity:get_group(group_id=31d32a6489ef4c96bee919dc004b9b98)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:50.515463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac3945-35bf-4523-833d-0a555310371b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:50.517393 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 195/387] 10.222.0.96 () {56 vars in 1180 bytes} [Wed Aug 24 04:17:50 2022] GET /identity/v3/groups/31d32a6489ef4c96bee919dc004b9b98 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:50.522638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87158af-1c07-40c7-8b48-5e5304931d47 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:50.692965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87158af-1c07-40c7-8b48-5e5304931d47 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:50.746036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac3945-35bf-4523-833d-0a555310371b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:50.748964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f24831-17a4-4e52-8381-6b74388f0c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:50.749514 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f24831-17a4-4e52-8381-6b74388f0c84 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:50.749794 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f24831-17a4-4e52-8381-6b74388f0c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:50.750070 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f24831-17a4-4e52-8381-6b74388f0c84 None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:50.751225 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f24831-17a4-4e52-8381-6b74388f0c84 None admin] RBAC: Authorizing `identity:get_project(project_id=96630a4e703341619588eb5481011618)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:50.752672 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f24831-17a4-4e52-8381-6b74388f0c84 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:50.754870 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 193/388] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:50 2022] GET /identity/v3/projects/96630a4e703341619588eb5481011618 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:50.760479 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f24831-17a4-4e52-8381-6b74388f0c84 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:50.815414 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:50.928716 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f24831-17a4-4e52-8381-6b74388f0c84 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:50.971920 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bf0c5-413b-47ce-9394-56e418b48f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:50.972589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bf0c5-413b-47ce-9394-56e418b48f57 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:50.972908 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bf0c5-413b-47ce-9394-56e418b48f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:50.973904 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bf0c5-413b-47ce-9394-56e418b48f57 None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618/groups/31d32a6489ef4c96bee919dc004b9b98/roles/b78ed83a66fe4531900cc02bb745f80f` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:50.976167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07bf0c5-413b-47ce-9394-56e418b48f57 None admin] RBAC: Authorizing `identity:create_grant(project_id=96630a4e703341619588eb5481011618, group_id=31d32a6489ef4c96bee919dc004b9b98, role_id=b78ed83a66fe4531900cc02bb745f80f)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:50.977855 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07bf0c5-413b-47ce-9394-56e418b48f57 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:50.995002 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac3945-35bf-4523-833d-0a555310371b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:50.999486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 194/389] 10.222.0.96 () {58 vars in 1442 bytes} [Wed Aug 24 04:17:50 2022] PUT /identity/v3/projects/96630a4e703341619588eb5481011618/groups/31d32a6489ef4c96bee919dc004b9b98/roles/b78ed83a66fe4531900cc02bb745f80f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:17:51.019309 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:51.052194 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ee79a-1f3c-47f7-8dab-0994ce99d0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:51.052607 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ee79a-1f3c-47f7-8dab-0994ce99d0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:51.052850 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ee79a-1f3c-47f7-8dab-0994ce99d0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:51.053122 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ee79a-1f3c-47f7-8dab-0994ce99d0f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:51.067463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ee79a-1f3c-47f7-8dab-0994ce99d0f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:51.073349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-e83ee79a-1f3c-47f7-8dab-0994ce99d0f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:51.073349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:51.073349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:51.073349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:51.073349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:51.073349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:51.073349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:51.073349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:51.073349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:51.073349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:51.073349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:51.073349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:51.073349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:51.073349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:51.073349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:51.073349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:51.075016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:51.075016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:51.075016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:51.075016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:51.075016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:51.075016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:51.075016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:51.075016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:51.075016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:51.075016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:51.075016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:51.075016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:51.075016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:51.075016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:51.075016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:51.075016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:51.076937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:51.076937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:51.076937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:51.076937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:51.076937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:51.076937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:51.076937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:51.076937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:51.076937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:51.076937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:51.076937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:51.076937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:51.076937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 196/390] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:51.085982 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bf0c5-413b-47ce-9394-56e418b48f57 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:51.162559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed83907-3eda-474d-9464-a832ad9686fc None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:51.162988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed83907-3eda-474d-9464-a832ad9686fc None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:51.163397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed83907-3eda-474d-9464-a832ad9686fc None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:51.165948 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 197/391] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:17:51.172257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d8ed8-4862-4f96-895f-704cc3940171 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:51.172257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d8ed8-4862-4f96-895f-704cc3940171 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:51.172674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d8ed8-4862-4f96-895f-704cc3940171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:51.195991 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:51.225891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bf0c5-413b-47ce-9394-56e418b48f57 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:51.226328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-5f3d8ed8-4862-4f96-895f-704cc3940171 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:51.228160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5f3d8ed8-4862-4f96-895f-704cc3940171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:51.272319 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ce8d6-ac83-4a78-a7bf-ec2c5e76606d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:51.273689 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ce8d6-ac83-4a78-a7bf-ec2c5e76606d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:51.274182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ce8d6-ac83-4a78-a7bf-ec2c5e76606d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:51.274658 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ce8d6-ac83-4a78-a7bf-ec2c5e76606d None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:51.275569 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ce8d6-ac83-4a78-a7bf-ec2c5e76606d None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:51.276101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ce8d6-ac83-4a78-a7bf-ec2c5e76606d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:51.277936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ce8d6-ac83-4a78-a7bf-ec2c5e76606d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:51.290592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 195/392] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:51.299346 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ce8d6-ac83-4a78-a7bf-ec2c5e76606d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:51.374348 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 198/393] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:17:51.480844 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ce8d6-ac83-4a78-a7bf-ec2c5e76606d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:51.523966 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52695d16-34ee-4daf-aade-af703e36d26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:51.524614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52695d16-34ee-4daf-aade-af703e36d26d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:51.524920 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52695d16-34ee-4daf-aade-af703e36d26d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:51.525190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52695d16-34ee-4daf-aade-af703e36d26d None admin] PATH_INFO: `/v3/groups/31d32a6489ef4c96bee919dc004b9b98` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:51.529373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52695d16-34ee-4daf-aade-af703e36d26d None admin] RBAC: Authorizing `identity:get_group(group_id=31d32a6489ef4c96bee919dc004b9b98)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:51.530851 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52695d16-34ee-4daf-aade-af703e36d26d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:51.532526 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 196/394] 10.222.0.96 () {56 vars in 1180 bytes} [Wed Aug 24 04:17:51 2022] GET /identity/v3/groups/31d32a6489ef4c96bee919dc004b9b98 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:51.540547 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d8ed8-4862-4f96-895f-704cc3940171 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:51.685039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:51.689594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d8ed8-4862-4f96-895f-704cc3940171 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:51.726492 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52695d16-34ee-4daf-aade-af703e36d26d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:51.739518 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1587a-d5b4-4e19-94bd-38044e95e44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:51.740679 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1587a-d5b4-4e19-94bd-38044e95e44a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:51.741214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1587a-d5b4-4e19-94bd-38044e95e44a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:51.741683 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1587a-d5b4-4e19-94bd-38044e95e44a None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:51.743147 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1587a-d5b4-4e19-94bd-38044e95e44a None admin] RBAC: Authorizing `identity:get_project(project_id=96630a4e703341619588eb5481011618)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:51.744960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1587a-d5b4-4e19-94bd-38044e95e44a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:51.747158 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 199/395] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:51 2022] GET /identity/v3/projects/96630a4e703341619588eb5481011618 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:51.752672 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:51.756244 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1587a-d5b4-4e19-94bd-38044e95e44a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:51.925120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52695d16-34ee-4daf-aade-af703e36d26d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:51.947936 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1587a-d5b4-4e19-94bd-38044e95e44a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:51.990665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833eb766-4030-4692-ba76-82cdb587400b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:51.991253 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eb766-4030-4692-ba76-82cdb587400b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:51.991545 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eb766-4030-4692-ba76-82cdb587400b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:51.991824 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eb766-4030-4692-ba76-82cdb587400b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:52.007349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701acb1a-8afa-4129-aaff-c5683525f099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:52.008523 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701acb1a-8afa-4129-aaff-c5683525f099 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:52.008978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701acb1a-8afa-4129-aaff-c5683525f099 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:52.009456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701acb1a-8afa-4129-aaff-c5683525f099 None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618/groups/31d32a6489ef4c96bee919dc004b9b98/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:52.010766 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833eb766-4030-4692-ba76-82cdb587400b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:52.012380 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701acb1a-8afa-4129-aaff-c5683525f099 None admin] RBAC: Authorizing `identity:create_grant(project_id=96630a4e703341619588eb5481011618, group_id=31d32a6489ef4c96bee919dc004b9b98, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:52.014855 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701acb1a-8afa-4129-aaff-c5683525f099 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:52.016194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-833eb766-4030-4692-ba76-82cdb587400b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:52.016194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:52.016194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:52.016194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:52.016194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:52.016194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:52.016194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:52.016194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:52.016194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:52.016194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:52.016194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:52.016194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:52.016194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:52.016194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:52.016194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:52.016194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:52.017073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:52.017073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:52.017073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:52.017073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:52.017073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:52.017073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:52.017073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:52.017073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:52.017073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:52.017073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:52.017073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:52.017073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:52.017073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:52.017073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:52.017073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:52.017073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:52.017868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:52.017868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:52.017868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:52.017868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:52.017868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:52.017868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:52.017868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:52.017868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:52.017868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:52.017868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:52.017868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:52.017868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:52.017868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 197/396] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:17:52.025054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833eb766-4030-4692-ba76-82cdb587400b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:52.053607 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 200/397] 10.222.0.96 () {58 vars in 1442 bytes} [Wed Aug 24 04:17:51 2022] PUT /identity/v3/projects/96630a4e703341619588eb5481011618/groups/31d32a6489ef4c96bee919dc004b9b98/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:17:52.120757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:52.171901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833eb766-4030-4692-ba76-82cdb587400b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:52.238318 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77452e-94f8-4772-af7d-d5c4f4cd1d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:52.239813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77452e-94f8-4772-af7d-d5c4f4cd1d4c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:52.240236 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77452e-94f8-4772-af7d-d5c4f4cd1d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:52.240645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77452e-94f8-4772-af7d-d5c4f4cd1d4c None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:52.241834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77452e-94f8-4772-af7d-d5c4f4cd1d4c None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:52.242239 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77452e-94f8-4772-af7d-d5c4f4cd1d4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:52.244586 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77452e-94f8-4772-af7d-d5c4f4cd1d4c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:52.259566 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 198/398] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:52.265245 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701acb1a-8afa-4129-aaff-c5683525f099 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:52.306018 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:52.403578 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701acb1a-8afa-4129-aaff-c5683525f099 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:52.455264 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01886b-63e0-4dd3-8407-d0c6005f53f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:52.455940 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01886b-63e0-4dd3-8407-d0c6005f53f6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:52.456227 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01886b-63e0-4dd3-8407-d0c6005f53f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:52.456502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01886b-63e0-4dd3-8407-d0c6005f53f6 None admin] PATH_INFO: `/v3/groups/31d32a6489ef4c96bee919dc004b9b98` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:52.457767 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01886b-63e0-4dd3-8407-d0c6005f53f6 None admin] RBAC: Authorizing `identity:get_group(group_id=31d32a6489ef4c96bee919dc004b9b98)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:52.459312 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01886b-63e0-4dd3-8407-d0c6005f53f6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:52.461364 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 201/399] 10.222.0.96 () {56 vars in 1180 bytes} [Wed Aug 24 04:17:52 2022] GET /identity/v3/groups/31d32a6489ef4c96bee919dc004b9b98 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:52.467523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77452e-94f8-4772-af7d-d5c4f4cd1d4c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:52.510219 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06786bac-42d6-4250-be4e-d110f3cca3b2 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:52.510800 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06786bac-42d6-4250-be4e-d110f3cca3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:52.511257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06786bac-42d6-4250-be4e-d110f3cca3b2 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:52.513102 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 202/400] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:52.527649 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c6d9e-56fe-4d6e-813f-a54be590835b None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:52.528078 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c6d9e-56fe-4d6e-813f-a54be590835b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:52.528494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c6d9e-56fe-4d6e-813f-a54be590835b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:52.580896 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-c99c6d9e-56fe-4d6e-813f-a54be590835b None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:52.583221 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c99c6d9e-56fe-4d6e-813f-a54be590835b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:52.712922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77452e-94f8-4772-af7d-d5c4f4cd1d4c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:52.731768 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 203/401] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:52.752897 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:52.766078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9700af-2c5f-4cb3-8a82-90789c78ac25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:52.766660 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9700af-2c5f-4cb3-8a82-90789c78ac25 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:52.766942 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9700af-2c5f-4cb3-8a82-90789c78ac25 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:52.767216 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9700af-2c5f-4cb3-8a82-90789c78ac25 None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:52.768376 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9700af-2c5f-4cb3-8a82-90789c78ac25 None admin] RBAC: Authorizing `identity:get_project(project_id=131c2da412c94e35868fe9dc21137199)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:52.769847 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9700af-2c5f-4cb3-8a82-90789c78ac25 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:52.772735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 199/402] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:52 2022] GET /identity/v3/projects/131c2da412c94e35868fe9dc21137199 => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:52.778337 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c6d9e-56fe-4d6e-813f-a54be590835b None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:52.823416 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:52.870693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe149ef-60fa-4bfe-8c99-c5838980a5b4 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:52.871130 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe149ef-60fa-4bfe-8c99-c5838980a5b4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:52.871411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe149ef-60fa-4bfe-8c99-c5838980a5b4 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:52.873551 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 200/403] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:17:52.883754 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af9ab6-44fe-41de-9132-d87c78b6e616 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:52.884041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af9ab6-44fe-41de-9132-d87c78b6e616 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:52.884319 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af9ab6-44fe-41de-9132-d87c78b6e616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:52.916124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-79af9ab6-44fe-41de-9132-d87c78b6e616 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:52.917358 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-79af9ab6-44fe-41de-9132-d87c78b6e616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:52.950473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c6d9e-56fe-4d6e-813f-a54be590835b None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:53.018316 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ef92d-f9d2-4bc1-b13e-ac90c0d87f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:53.018967 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ef92d-f9d2-4bc1-b13e-ac90c0d87f39 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:53.019256 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ef92d-f9d2-4bc1-b13e-ac90c0d87f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:53.019532 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ef92d-f9d2-4bc1-b13e-ac90c0d87f39 None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199/groups/31d32a6489ef4c96bee919dc004b9b98/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:53.023857 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ef92d-f9d2-4bc1-b13e-ac90c0d87f39 None admin] RBAC: Authorizing `identity:create_grant(project_id=131c2da412c94e35868fe9dc21137199, group_id=31d32a6489ef4c96bee919dc004b9b98, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:53.025375 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ef92d-f9d2-4bc1-b13e-ac90c0d87f39 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:53.041369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 204/404] 10.222.0.96 () {58 vars in 1442 bytes} [Wed Aug 24 04:17:52 2022] PUT /identity/v3/projects/131c2da412c94e35868fe9dc21137199/groups/31d32a6489ef4c96bee919dc004b9b98/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:17:53.042021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ef92d-f9d2-4bc1-b13e-ac90c0d87f39 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:53.049491 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 201/405] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:17:53.150790 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:53.168985 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ef92d-f9d2-4bc1-b13e-ac90c0d87f39 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:53.211903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ff95e-c0d3-42be-98fa-6bce013edbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:53.212621 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ff95e-c0d3-42be-98fa-6bce013edbe5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:53.212940 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ff95e-c0d3-42be-98fa-6bce013edbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:53.213216 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ff95e-c0d3-42be-98fa-6bce013edbe5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:53.225337 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ff95e-c0d3-42be-98fa-6bce013edbe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:53.230379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-5e9ff95e-c0d3-42be-98fa-6bce013edbe5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:53.230379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:53.230379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:53.230379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:53.230379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:53.230379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:53.230379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:53.230379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:53.230379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:53.230379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:53.230379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:53.230379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:53.230379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:53.230379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:53.230379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:53.230379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:53.231272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:53.231272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:53.231272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:53.231272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:53.231272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:53.231272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:53.231272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:53.231272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:53.231272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:53.231272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:53.231272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:53.231272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:53.231272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:53.231272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:53.231272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:53.231272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:53.232066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:53.232066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:53.232066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:53.232066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:53.232066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:53.232066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:53.232066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:53.232066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:53.232066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:53.232066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:53.232066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:53.232066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:53.232066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 205/406] 10.222.0.96 () {56 vars in 1114 bytes} [Wed Aug 24 04:17:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:53.237606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af9ab6-44fe-41de-9132-d87c78b6e616 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:53.398951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af9ab6-44fe-41de-9132-d87c78b6e616 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:53.441504 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:53.450657 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe943143-f9b3-4942-be78-dbdc4b63e5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:53.451280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe943143-f9b3-4942-be78-dbdc4b63e5f8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:53.451560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe943143-f9b3-4942-be78-dbdc4b63e5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:53.451884 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe943143-f9b3-4942-be78-dbdc4b63e5f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:53.452568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe943143-f9b3-4942-be78-dbdc4b63e5f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:53.452997 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe943143-f9b3-4942-be78-dbdc4b63e5f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:53.458321 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe943143-f9b3-4942-be78-dbdc4b63e5f8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:53.472117 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 202/407] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:17:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:53.477694 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe943143-f9b3-4942-be78-dbdc4b63e5f8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:53.477927 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ff95e-c0d3-42be-98fa-6bce013edbe5 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:53.593732 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe943143-f9b3-4942-be78-dbdc4b63e5f8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:53.630628 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d3689-711b-4439-80b2-a5bc7fc7dc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:53.631646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d3689-711b-4439-80b2-a5bc7fc7dc40 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:53.632165 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d3689-711b-4439-80b2-a5bc7fc7dc40 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:53.632763 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d3689-711b-4439-80b2-a5bc7fc7dc40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:53.643925 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d3689-711b-4439-80b2-a5bc7fc7dc40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:53.649788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-687d3689-711b-4439-80b2-a5bc7fc7dc40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:17:53.649788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:53.649788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:53.649788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:53.649788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:53.649788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:53.649788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:53.649788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:53.649788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:53.649788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:53.649788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:53.649788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:53.649788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:53.649788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:53.649788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:53.649788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:53.650676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:53.650676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:53.650676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:53.650676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:53.650676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:53.650676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:53.650676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:53.650676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:53.650676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:53.650676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:53.650676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:53.650676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:53.650676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:53.650676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:53.650676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:53.650676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:53.651459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:53.651459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:53.651459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:53.651459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:53.651459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:53.651459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:53.651459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:53.651459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:53.651459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:53.651459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:53.651459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:17:53.651459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:53.654104 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 203/408] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:17:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:53.659919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d3689-711b-4439-80b2-a5bc7fc7dc40 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:53.701043 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ff95e-c0d3-42be-98fa-6bce013edbe5 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:53.717117 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:53.741477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31ec44-f3a4-4934-b3dc-9d36e7d134cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:53.742405 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31ec44-f3a4-4934-b3dc-9d36e7d134cb None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:53.742856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31ec44-f3a4-4934-b3dc-9d36e7d134cb None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:53.743390 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31ec44-f3a4-4934-b3dc-9d36e7d134cb None admin] PATH_INFO: `/v3/groups/31d32a6489ef4c96bee919dc004b9b98` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:53.744722 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31ec44-f3a4-4934-b3dc-9d36e7d134cb None admin] RBAC: Authorizing `identity:get_group(group_id=31d32a6489ef4c96bee919dc004b9b98)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:53.746469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31ec44-f3a4-4934-b3dc-9d36e7d134cb None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:53.748649 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 206/409] 10.222.0.96 () {56 vars in 1180 bytes} [Wed Aug 24 04:17:53 2022] GET /identity/v3/groups/31d32a6489ef4c96bee919dc004b9b98 => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:53.750104 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f253e-f58f-48b0-bbca-2f20e6ef6a42 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:53.750539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f253e-f58f-48b0-bbca-2f20e6ef6a42 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:53.751056 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f253e-f58f-48b0-bbca-2f20e6ef6a42 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:53.757426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 207/410] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:53.758542 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f253e-f58f-48b0-bbca-2f20e6ef6a42 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:53.772246 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d3689-711b-4439-80b2-a5bc7fc7dc40 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:53.776759 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:53.808967 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f9c22-edaa-49f9-a09e-996167792ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:53.809755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f9c22-edaa-49f9-a09e-996167792ebe None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:53.810136 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f9c22-edaa-49f9-a09e-996167792ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:53.810788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f9c22-edaa-49f9-a09e-996167792ebe None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:53.811272 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f9c22-edaa-49f9-a09e-996167792ebe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:53.811681 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f9c22-edaa-49f9-a09e-996167792ebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:53.813276 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f9c22-edaa-49f9-a09e-996167792ebe None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:53.827855 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 204/411] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:53.830850 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bcfc3-7252-4c4f-a98c-f753f1e6efa9 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:53.830850 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bcfc3-7252-4c4f-a98c-f753f1e6efa9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:53.830850 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bcfc3-7252-4c4f-a98c-f753f1e6efa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:53.849758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c39bcfc3-7252-4c4f-a98c-f753f1e6efa9 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:53.851131 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c39bcfc3-7252-4c4f-a98c-f753f1e6efa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:53.892135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f253e-f58f-48b0-bbca-2f20e6ef6a42 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:53.923978 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 205/412] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:53.928936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bcfc3-7252-4c4f-a98c-f753f1e6efa9 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:53.969178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da284d-35f7-4071-b018-334e4daa9a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:53.970188 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da284d-35f7-4071-b018-334e4daa9a93 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:53.970634 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da284d-35f7-4071-b018-334e4daa9a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:53.971061 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da284d-35f7-4071-b018-334e4daa9a93 None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:53.972426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da284d-35f7-4071-b018-334e4daa9a93 None admin] RBAC: Authorizing `identity:get_project(project_id=131c2da412c94e35868fe9dc21137199)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:53.974117 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da284d-35f7-4071-b018-334e4daa9a93 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:53.975013 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:53.977816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 208/413] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:53 2022] GET /identity/v3/projects/131c2da412c94e35868fe9dc21137199 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:53.985659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da284d-35f7-4071-b018-334e4daa9a93 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:54.035830 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bcfc3-7252-4c4f-a98c-f753f1e6efa9 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:54.074434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230b1f4-f2c7-477e-bcf3-2b4ec06e5120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:54.075251 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230b1f4-f2c7-477e-bcf3-2b4ec06e5120 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:54.075633 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230b1f4-f2c7-477e-bcf3-2b4ec06e5120 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:54.076008 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230b1f4-f2c7-477e-bcf3-2b4ec06e5120 None admin] PATH_INFO: `/v3/groups/109cf1dd8c684ad4b440393c5ceca526` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:54.077794 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230b1f4-f2c7-477e-bcf3-2b4ec06e5120 None admin] RBAC: Authorizing `identity:get_group(group_id=109cf1dd8c684ad4b440393c5ceca526)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:54.079354 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230b1f4-f2c7-477e-bcf3-2b4ec06e5120 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:54.081088 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 206/414] 10.222.0.96 () {56 vars in 1180 bytes} [Wed Aug 24 04:17:53 2022] GET /identity/v3/groups/109cf1dd8c684ad4b440393c5ceca526 => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:54.087184 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230b1f4-f2c7-477e-bcf3-2b4ec06e5120 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:54.199696 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230b1f4-f2c7-477e-bcf3-2b4ec06e5120 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:54.222543 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:54.239516 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71053dee-cbac-4a0e-b3f1-dc8c2b11b5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:54.240431 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71053dee-cbac-4a0e-b3f1-dc8c2b11b5ba None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:54.240855 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71053dee-cbac-4a0e-b3f1-dc8c2b11b5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:54.241232 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71053dee-cbac-4a0e-b3f1-dc8c2b11b5ba None admin] PATH_INFO: `/v3/projects/cc9d6801b4c048408ddddff5c9f8e743` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:54.242512 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71053dee-cbac-4a0e-b3f1-dc8c2b11b5ba None admin] RBAC: Authorizing `identity:get_project(project_id=cc9d6801b4c048408ddddff5c9f8e743)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:54.244064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71053dee-cbac-4a0e-b3f1-dc8c2b11b5ba None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:54.245861 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 207/415] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:54 2022] GET /identity/v3/projects/cc9d6801b4c048408ddddff5c9f8e743 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:54.251705 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71053dee-cbac-4a0e-b3f1-dc8c2b11b5ba None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:54.262608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:54.287185 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da284d-35f7-4071-b018-334e4daa9a93 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:54.326775 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d58a70-bfb0-40c3-9d10-09b4fcf37caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:54.327696 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d58a70-bfb0-40c3-9d10-09b4fcf37caa None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:54.328145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d58a70-bfb0-40c3-9d10-09b4fcf37caa None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:54.328675 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d58a70-bfb0-40c3-9d10-09b4fcf37caa None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199/groups/31d32a6489ef4c96bee919dc004b9b98/roles/b78ed83a66fe4531900cc02bb745f80f` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:54.331202 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d58a70-bfb0-40c3-9d10-09b4fcf37caa None admin] RBAC: Authorizing `identity:create_grant(project_id=131c2da412c94e35868fe9dc21137199, group_id=31d32a6489ef4c96bee919dc004b9b98, role_id=b78ed83a66fe4531900cc02bb745f80f)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:54.333105 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d58a70-bfb0-40c3-9d10-09b4fcf37caa None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:54.356104 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 209/416] 10.222.0.96 () {58 vars in 1442 bytes} [Wed Aug 24 04:17:53 2022] PUT /identity/v3/projects/131c2da412c94e35868fe9dc21137199/groups/31d32a6489ef4c96bee919dc004b9b98/roles/b78ed83a66fe4531900cc02bb745f80f => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:17:54.357214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d58a70-bfb0-40c3-9d10-09b4fcf37caa None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:54.377675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71053dee-cbac-4a0e-b3f1-dc8c2b11b5ba None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:54.432641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d516d4-79ce-483b-97ef-85bb16e17dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:54.433663 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d516d4-79ce-483b-97ef-85bb16e17dfc None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:54.434672 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d516d4-79ce-483b-97ef-85bb16e17dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:54.435057 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d516d4-79ce-483b-97ef-85bb16e17dfc None admin] PATH_INFO: `/v3/projects/cc9d6801b4c048408ddddff5c9f8e743/groups/109cf1dd8c684ad4b440393c5ceca526/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:54.437923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d516d4-79ce-483b-97ef-85bb16e17dfc None admin] RBAC: Authorizing `identity:create_grant(project_id=cc9d6801b4c048408ddddff5c9f8e743, group_id=109cf1dd8c684ad4b440393c5ceca526, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:54.440369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d516d4-79ce-483b-97ef-85bb16e17dfc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:54.472121 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 208/417] 10.222.0.96 () {58 vars in 1442 bytes} [Wed Aug 24 04:17:54 2022] PUT /identity/v3/projects/cc9d6801b4c048408ddddff5c9f8e743/groups/109cf1dd8c684ad4b440393c5ceca526/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:17:54.506000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d58a70-bfb0-40c3-9d10-09b4fcf37caa None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:54.550888 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceda044-8f4c-489c-a609-e5ac45db3bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:54.551959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceda044-8f4c-489c-a609-e5ac45db3bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:54.552443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceda044-8f4c-489c-a609-e5ac45db3bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:54.552895 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceda044-8f4c-489c-a609-e5ac45db3bc7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:54.563327 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:54.569551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceda044-8f4c-489c-a609-e5ac45db3bc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:54.575340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-0ceda044-8f4c-489c-a609-e5ac45db3bc7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:54.575340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:54.575340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:54.575340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:54.575340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:54.575340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:54.575340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:54.575340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:54.575340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:54.575340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:54.575340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:54.575340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:54.575340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:54.575340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:54.575340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:54.575340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:54.576540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:54.576540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:54.576540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:54.576540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:54.576540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:54.576540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:54.576540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:54.576540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:54.576540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:54.576540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:54.576540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:54.576540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:54.576540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:54.576540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:54.576540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:54.576540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:54.577594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:54.577594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:54.577594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:54.577594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:54.577594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:54.577594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:54.577594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:54.577594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:54.577594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:54.577594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:54.577594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:54.577594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:54.579550 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 210/418] 10.222.0.96 () {56 vars in 1114 bytes} [Wed Aug 24 04:17:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:54.586940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d516d4-79ce-483b-97ef-85bb16e17dfc None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:54.647572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:54.653947 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b425586-d17b-4b87-aa52-a4d8e4f1bcfe None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:54.654269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b425586-d17b-4b87-aa52-a4d8e4f1bcfe None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:54.654549 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b425586-d17b-4b87-aa52-a4d8e4f1bcfe None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:54.656402 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 211/419] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:54.662305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1777ae4-8a58-4e68-9692-233822798a2c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:54.663361 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1777ae4-8a58-4e68-9692-233822798a2c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:54.663645 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1777ae4-8a58-4e68-9692-233822798a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:54.687312 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d1777ae4-8a58-4e68-9692-233822798a2c None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:54.688534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d1777ae4-8a58-4e68-9692-233822798a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:54.739723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d516d4-79ce-483b-97ef-85bb16e17dfc None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:54.783729 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 212/420] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:17:54.792251 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329b53c-27c1-48b1-8cd0-282998c22cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:54.792903 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329b53c-27c1-48b1-8cd0-282998c22cbc None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:54.793190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329b53c-27c1-48b1-8cd0-282998c22cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:54.793538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329b53c-27c1-48b1-8cd0-282998c22cbc None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:54.794219 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329b53c-27c1-48b1-8cd0-282998c22cbc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:54.794521 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329b53c-27c1-48b1-8cd0-282998c22cbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:54.795896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329b53c-27c1-48b1-8cd0-282998c22cbc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:54.809129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 209/421] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:17:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:54.814617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1777ae4-8a58-4e68-9692-233822798a2c None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:54.975035 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1777ae4-8a58-4e68-9692-233822798a2c None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:55.032002 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:55.042582 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e965f66-f09b-4dba-980d-980aaba4e661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:55.043458 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e965f66-f09b-4dba-980d-980aaba4e661 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:55.043901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e965f66-f09b-4dba-980d-980aaba4e661 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:55.044321 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e965f66-f09b-4dba-980d-980aaba4e661 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:55.133031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329b53c-27c1-48b1-8cd0-282998c22cbc None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:55.198278 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e965f66-f09b-4dba-980d-980aaba4e661 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:55.200258 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e965f66-f09b-4dba-980d-980aaba4e661 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:55.321296 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329b53c-27c1-48b1-8cd0-282998c22cbc None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:55.329031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:55.395088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 213/422] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:17:55.399939 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60b87d-7fa0-4c18-b1f0-76fba6c9cc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:55.401489 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60b87d-7fa0-4c18-b1f0-76fba6c9cc80 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:55.401895 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60b87d-7fa0-4c18-b1f0-76fba6c9cc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:55.402294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60b87d-7fa0-4c18-b1f0-76fba6c9cc80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:55.404409 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e965f66-f09b-4dba-980d-980aaba4e661 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:55.436467 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60b87d-7fa0-4c18-b1f0-76fba6c9cc80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:55.448079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-2b60b87d-7fa0-4c18-b1f0-76fba6c9cc80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:55.448079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:55.448079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:55.448079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:55.448079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:55.448079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:55.448079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:55.448079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:55.448079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:55.448079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:55.448079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:55.448079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:55.448079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:55.448079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:55.448079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:55.448079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:55.449083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:55.449083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:55.449083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:55.449083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:55.449083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:55.449083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:55.449083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:55.449083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:55.449083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:55.449083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:55.449083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:55.449083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:55.449083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:55.449083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:55.449083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:55.449083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:55.449880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:55.449880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:55.449880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:55.449880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:55.449880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:55.449880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:55.449880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:55.449880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:55.449880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:55.449880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:55.449880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:55.449880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:55.449880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 210/423] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:17:55.456496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60b87d-7fa0-4c18-b1f0-76fba6c9cc80 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:55.479123 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:55.594204 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e965f66-f09b-4dba-980d-980aaba4e661 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:55.601334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60b87d-7fa0-4c18-b1f0-76fba6c9cc80 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:55.643904 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738af71f-09c9-404f-b0be-874e4dcb2944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:55.644825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738af71f-09c9-404f-b0be-874e4dcb2944 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:55.645292 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738af71f-09c9-404f-b0be-874e4dcb2944 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:55.645714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738af71f-09c9-404f-b0be-874e4dcb2944 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:55.646528 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738af71f-09c9-404f-b0be-874e4dcb2944 None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:55.646876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba84c9-05bd-4558-b42b-e3b758e30d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:55.647215 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738af71f-09c9-404f-b0be-874e4dcb2944 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:55.647823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba84c9-05bd-4558-b42b-e3b758e30d63 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:55.648250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba84c9-05bd-4558-b42b-e3b758e30d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:55.648666 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba84c9-05bd-4558-b42b-e3b758e30d63 None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:55.649223 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738af71f-09c9-404f-b0be-874e4dcb2944 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:55.650399 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba84c9-05bd-4558-b42b-e3b758e30d63 None admin] RBAC: Authorizing `identity:get_project(project_id=96630a4e703341619588eb5481011618)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:55.652738 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba84c9-05bd-4558-b42b-e3b758e30d63 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:55.659772 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 214/424] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:55 2022] GET /identity/v3/projects/96630a4e703341619588eb5481011618 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:55.659772 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d28927-3fef-47b1-ba7b-f1e2d254fc9f None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:55.659772 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d28927-3fef-47b1-ba7b-f1e2d254fc9f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:55.659772 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d28927-3fef-47b1-ba7b-f1e2d254fc9f None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:55.660121 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 215/425] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:17:55.661216 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d28927-3fef-47b1-ba7b-f1e2d254fc9f None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:55.664070 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 211/426] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:55.668945 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9373397-db6f-48a9-8195-36cc7ebf8df4 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:55.669418 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9373397-db6f-48a9-8195-36cc7ebf8df4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:55.669836 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9373397-db6f-48a9-8195-36cc7ebf8df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:55.697612 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a9373397-db6f-48a9-8195-36cc7ebf8df4 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:55.699366 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a9373397-db6f-48a9-8195-36cc7ebf8df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:55.727645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:55.784903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:55.791835 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d28927-3fef-47b1-ba7b-f1e2d254fc9f None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:55.811823 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 212/427] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:17:55.812520 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9373397-db6f-48a9-8195-36cc7ebf8df4 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:55.868101 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecee40-fe40-494e-ad6f-d2fa8278b82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:55.868672 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecee40-fe40-494e-ad6f-d2fa8278b82b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:55.868987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecee40-fe40-494e-ad6f-d2fa8278b82b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:55.869266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecee40-fe40-494e-ad6f-d2fa8278b82b None admin] PATH_INFO: `/v3/groups/31d32a6489ef4c96bee919dc004b9b98` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:55.873831 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecee40-fe40-494e-ad6f-d2fa8278b82b None admin] RBAC: Authorizing `identity:get_group(group_id=31d32a6489ef4c96bee919dc004b9b98)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:55.875484 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecee40-fe40-494e-ad6f-d2fa8278b82b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:55.877354 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 216/428] 10.222.0.96 () {56 vars in 1180 bytes} [Wed Aug 24 04:17:55 2022] GET /identity/v3/groups/31d32a6489ef4c96bee919dc004b9b98 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:55.884058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecee40-fe40-494e-ad6f-d2fa8278b82b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:55.922430 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9373397-db6f-48a9-8195-36cc7ebf8df4 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:55.962047 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545fabd-dabe-4d94-b0f7-46ec409e6a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:55.962667 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545fabd-dabe-4d94-b0f7-46ec409e6a1a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:55.962938 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545fabd-dabe-4d94-b0f7-46ec409e6a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:55.963213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545fabd-dabe-4d94-b0f7-46ec409e6a1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:55.991285 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:56.039626 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545fabd-dabe-4d94-b0f7-46ec409e6a1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:56.041468 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545fabd-dabe-4d94-b0f7-46ec409e6a1a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:56.142792 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecee40-fe40-494e-ad6f-d2fa8278b82b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:56.146556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 213/429] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:56.153918 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545fabd-dabe-4d94-b0f7-46ec409e6a1a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:56.216419 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922852c2-400f-41b4-a0cf-1a987aa3d540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:56.217928 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922852c2-400f-41b4-a0cf-1a987aa3d540 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:56.218687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922852c2-400f-41b4-a0cf-1a987aa3d540 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:56.219273 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922852c2-400f-41b4-a0cf-1a987aa3d540 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:56.229581 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:56.231709 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922852c2-400f-41b4-a0cf-1a987aa3d540 None admin] RBAC: Adding query filter params (group.id=31d32a6489ef4c96bee919dc004b9b98, role.id=b78ed83a66fe4531900cc02bb745f80f, scope.project.id=96630a4e703341619588eb5481011618) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:56.232393 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922852c2-400f-41b4-a0cf-1a987aa3d540 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:56.234915 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922852c2-400f-41b4-a0cf-1a987aa3d540 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:56.251927 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 217/430] 10.222.0.96 () {56 vars in 1376 bytes} [Wed Aug 24 04:17:55 2022] GET /identity/v3/role_assignments?group.id=31d32a6489ef4c96bee919dc004b9b98&scope.project.id=96630a4e703341619588eb5481011618&role.id=b78ed83a66fe4531900cc02bb745f80f => generated 611 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:56.275824 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545fabd-dabe-4d94-b0f7-46ec409e6a1a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:56.317137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c19969-64d1-4f20-9afb-cbdf4933e42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:56.318145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c19969-64d1-4f20-9afb-cbdf4933e42a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:56.318441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c19969-64d1-4f20-9afb-cbdf4933e42a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:56.318717 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c19969-64d1-4f20-9afb-cbdf4933e42a None admin] PATH_INFO: `/v3/projects/96630a4e703341619588eb5481011618` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:56.319888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c19969-64d1-4f20-9afb-cbdf4933e42a None admin] RBAC: Authorizing `identity:get_project(project_id=96630a4e703341619588eb5481011618)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:56.321657 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c19969-64d1-4f20-9afb-cbdf4933e42a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:56.323664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 214/431] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:56 2022] GET /identity/v3/projects/96630a4e703341619588eb5481011618 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:56.329124 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922852c2-400f-41b4-a0cf-1a987aa3d540 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:56.365669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:56.397937 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c19969-64d1-4f20-9afb-cbdf4933e42a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:56.494388 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922852c2-400f-41b4-a0cf-1a987aa3d540 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:56.556444 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a000c-0979-4fca-bc7a-ae9b9796f019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:56.557866 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a000c-0979-4fca-bc7a-ae9b9796f019 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:56.559215 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a000c-0979-4fca-bc7a-ae9b9796f019 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:56.559923 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a000c-0979-4fca-bc7a-ae9b9796f019 None admin] PATH_INFO: `/v3/groups/31d32a6489ef4c96bee919dc004b9b98` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:56.562587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a000c-0979-4fca-bc7a-ae9b9796f019 None admin] RBAC: Authorizing `identity:get_group(group_id=31d32a6489ef4c96bee919dc004b9b98)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:56.566953 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a000c-0979-4fca-bc7a-ae9b9796f019 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:56.571616 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 218/432] 10.222.0.96 () {56 vars in 1180 bytes} [Wed Aug 24 04:17:56 2022] GET /identity/v3/groups/31d32a6489ef4c96bee919dc004b9b98 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:56.577907 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a000c-0979-4fca-bc7a-ae9b9796f019 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:56.578878 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c19969-64d1-4f20-9afb-cbdf4933e42a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:56.609363 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:56.626457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cab72-ca22-4986-b773-d35f20a16697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:56.627099 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cab72-ca22-4986-b773-d35f20a16697 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:56.627381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cab72-ca22-4986-b773-d35f20a16697 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:56.627660 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cab72-ca22-4986-b773-d35f20a16697 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:56.649186 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96cab72-ca22-4986-b773-d35f20a16697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:56.654004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-e96cab72-ca22-4986-b773-d35f20a16697 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:56.654004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:56.654004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:56.654004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:56.654004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:56.654004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:56.654004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:56.654004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:56.654004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:56.654004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:56.654004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:56.654004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:56.654004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:56.654004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:56.654004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:56.654004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:56.655428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:56.655428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:56.655428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:56.655428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:56.655428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:56.655428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:56.655428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:56.655428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:56.655428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:56.655428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:56.655428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:56.655428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:56.655428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:56.655428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:56.655428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:56.655428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:56.657320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:56.657320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:56.657320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:56.657320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:56.657320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:56.657320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:56.657320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:56.657320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:56.657320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:56.657320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:56.657320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:17:56.657320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:17:56.657320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 215/433] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:56.661467 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cab72-ca22-4986-b773-d35f20a16697 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:56.800504 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:56.811495 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a000c-0979-4fca-bc7a-ae9b9796f019 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:56.815180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cab72-ca22-4986-b773-d35f20a16697 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:56.866012 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39d350-0d6d-4e0d-a38a-559a17c9f0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:56.866911 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39d350-0d6d-4e0d-a38a-559a17c9f0af None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:56.867356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39d350-0d6d-4e0d-a38a-559a17c9f0af None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:56.867796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39d350-0d6d-4e0d-a38a-559a17c9f0af None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:56.868619 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39d350-0d6d-4e0d-a38a-559a17c9f0af None admin] RBAC: Adding query filter params (name=member) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:56.869211 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39d350-0d6d-4e0d-a38a-559a17c9f0af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:56.870744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39d350-0d6d-4e0d-a38a-559a17c9f0af None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:56.881049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 216/434] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:17:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:56.892873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca7bc7-4b86-4a40-9620-fc60eeebbb2f None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:56.893222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca7bc7-4b86-4a40-9620-fc60eeebbb2f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:56.893560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca7bc7-4b86-4a40-9620-fc60eeebbb2f None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:56.894664 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc510d-a289-4a44-9db9-5da309cffeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:56.895707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 217/435] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:17:56.896356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca7bc7-4b86-4a40-9620-fc60eeebbb2f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:56.900224 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc510d-a289-4a44-9db9-5da309cffeab None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:56.900457 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc510d-a289-4a44-9db9-5da309cffeab None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:56.901033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc510d-a289-4a44-9db9-5da309cffeab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:56.901661 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc510d-a289-4a44-9db9-5da309cffeab None admin] RBAC: Adding query filter params (group.id=31d32a6489ef4c96bee919dc004b9b98, role.id=dbb1f67486534e8dbbc250bfe0978e6c, scope.project.id=96630a4e703341619588eb5481011618) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:56.901985 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc510d-a289-4a44-9db9-5da309cffeab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:56.903457 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc510d-a289-4a44-9db9-5da309cffeab None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:56.909974 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 219/436] 10.222.0.96 () {56 vars in 1376 bytes} [Wed Aug 24 04:17:56 2022] GET /identity/v3/role_assignments?group.id=31d32a6489ef4c96bee919dc004b9b98&scope.project.id=96630a4e703341619588eb5481011618&role.id=dbb1f67486534e8dbbc250bfe0978e6c => generated 611 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:56.911169 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb215529-ca0e-4344-bca7-9a82a66e27ab None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:56.911460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb215529-ca0e-4344-bca7-9a82a66e27ab None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:56.911745 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb215529-ca0e-4344-bca7-9a82a66e27ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:56.931569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-fb215529-ca0e-4344-bca7-9a82a66e27ab None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:56.932868 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-fb215529-ca0e-4344-bca7-9a82a66e27ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:56.982618 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:57.014985 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 220/437] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:57.084326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca7bc7-4b86-4a40-9620-fc60eeebbb2f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:57.114588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cefa82-3364-4fac-9d4d-f619220c3be3 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:57.115005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cefa82-3364-4fac-9d4d-f619220c3be3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:57.115147 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cefa82-3364-4fac-9d4d-f619220c3be3 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:57.116445 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 221/438] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:17:57.122415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009617f-51f5-44a1-9806-52cbdcab41b0 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:57.122724 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009617f-51f5-44a1-9806-52cbdcab41b0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:57.122967 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009617f-51f5-44a1-9806-52cbdcab41b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:57.138697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd66e6-7e2e-464f-abe5-05f4b4a11a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:57.139314 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd66e6-7e2e-464f-abe5-05f4b4a11a10 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:57.139595 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd66e6-7e2e-464f-abe5-05f4b4a11a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:57.139866 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd66e6-7e2e-464f-abe5-05f4b4a11a10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:57.156877 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6009617f-51f5-44a1-9806-52cbdcab41b0 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:17:57.159451 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6009617f-51f5-44a1-9806-52cbdcab41b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:17:57.243904 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd66e6-7e2e-464f-abe5-05f4b4a11a10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:57.245570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd66e6-7e2e-464f-abe5-05f4b4a11a10 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:57.271199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 222/439] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:17:57.299736 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009617f-51f5-44a1-9806-52cbdcab41b0 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:57.305673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:57.345163 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:57.379272 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 218/440] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:57.389080 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd66e6-7e2e-464f-abe5-05f4b4a11a10 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:57.467669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009617f-51f5-44a1-9806-52cbdcab41b0 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:57.530006 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb48e5-1b8d-4caa-8815-d636cc2c7e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:57.530823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb48e5-1b8d-4caa-8815-d636cc2c7e6a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:57.531112 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb48e5-1b8d-4caa-8815-d636cc2c7e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:57.531388 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb48e5-1b8d-4caa-8815-d636cc2c7e6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:57.541102 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd66e6-7e2e-464f-abe5-05f4b4a11a10 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:57.544559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb48e5-1b8d-4caa-8815-d636cc2c7e6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:57.552747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-b9fb48e5-1b8d-4caa-8815-d636cc2c7e6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:57.552747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:57.552747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:57.552747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:57.552747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:57.552747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:57.552747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:57.552747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:57.552747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:57.552747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:57.552747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:57.552747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:57.552747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:57.552747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:57.552747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:57.552747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:57.553860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:57.553860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:57.553860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:57.553860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:57.553860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:57.553860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:57.553860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:57.553860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:57.553860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:57.553860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:57.553860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:57.553860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:57.553860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:57.553860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:57.553860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:57.553860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:57.554879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:57.554879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:57.554879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:57.554879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:57.554879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:57.554879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:57.554879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:57.554879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:57.554879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:57.554879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:57.554879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:17:57.554879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:57.554879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 223/441] 10.222.0.96 () {56 vars in 1114 bytes} [Wed Aug 24 04:17:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:57.554879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb48e5-1b8d-4caa-8815-d636cc2c7e6a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:57.596676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1593b78-7430-42d8-9c95-bcb817b1cbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:57.597350 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1593b78-7430-42d8-9c95-bcb817b1cbbb None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:57.597634 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1593b78-7430-42d8-9c95-bcb817b1cbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:57.597911 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1593b78-7430-42d8-9c95-bcb817b1cbbb None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:57.599684 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1593b78-7430-42d8-9c95-bcb817b1cbbb None admin] RBAC: Authorizing `identity:get_project(project_id=131c2da412c94e35868fe9dc21137199)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:57.601176 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1593b78-7430-42d8-9c95-bcb817b1cbbb None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:57.602844 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 219/442] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:57 2022] GET /identity/v3/projects/131c2da412c94e35868fe9dc21137199 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:57.605603 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1593b78-7430-42d8-9c95-bcb817b1cbbb None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:57.623310 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:57.664021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:57.683870 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb48e5-1b8d-4caa-8815-d636cc2c7e6a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:57.719481 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dce6d-e29e-448b-8837-de2787fed92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:57.720062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dce6d-e29e-448b-8837-de2787fed92b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:57.720346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dce6d-e29e-448b-8837-de2787fed92b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:57.720620 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dce6d-e29e-448b-8837-de2787fed92b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:57.727769 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1593b78-7430-42d8-9c95-bcb817b1cbbb None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:57.731518 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2dce6d-e29e-448b-8837-de2787fed92b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:17:57.736415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-0e2dce6d-e29e-448b-8837-de2787fed92b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:17:57.736415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:17:57.736415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:17:57.736415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:17:57.736415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:17:57.736415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:17:57.736415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:17:57.736415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:17:57.736415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:17:57.736415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:17:57.736415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:17:57.736415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:17:57.736415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:17:57.736415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:17:57.736415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:17:57.736415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:17:57.737319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:17:57.737319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:17:57.737319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:17:57.737319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:17:57.737319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:17:57.737319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:17:57.737319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:17:57.737319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:17:57.737319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:17:57.737319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:17:57.737319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:17:57.737319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:17:57.737319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:17:57.737319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:17:57.737319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:17:57.737319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:17:57.738150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:17:57.738150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:17:57.738150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:17:57.738150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:17:57.738150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:17:57.738150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:17:57.738150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:17:57.738150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:17:57.738150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:17:57.738150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:17:57.738150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:17:57.738150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:17:57.738150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 224/443] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:17:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:17:57.739528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dce6d-e29e-448b-8837-de2787fed92b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:57.767412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddfa79-9e12-4b90-9f1b-0277e4f5b7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:57.768011 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddfa79-9e12-4b90-9f1b-0277e4f5b7d8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:57.768294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddfa79-9e12-4b90-9f1b-0277e4f5b7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:57.768574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddfa79-9e12-4b90-9f1b-0277e4f5b7d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:57.769280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddfa79-9e12-4b90-9f1b-0277e4f5b7d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:57.769593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddfa79-9e12-4b90-9f1b-0277e4f5b7d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:57.771526 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddfa79-9e12-4b90-9f1b-0277e4f5b7d8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:57.779597 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 220/444] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:17:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:57.780402 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddfa79-9e12-4b90-9f1b-0277e4f5b7d8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:57.862078 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dce6d-e29e-448b-8837-de2787fed92b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:57.866096 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:57.892351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddfa79-9e12-4b90-9f1b-0277e4f5b7d8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:57.899900 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10494454-4e57-4345-862e-cb18a703e671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:57.900547 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10494454-4e57-4345-862e-cb18a703e671 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:57.900867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10494454-4e57-4345-862e-cb18a703e671 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:57.901145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10494454-4e57-4345-862e-cb18a703e671 None admin] PATH_INFO: `/v3/groups/31d32a6489ef4c96bee919dc004b9b98` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:57.902281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10494454-4e57-4345-862e-cb18a703e671 None admin] RBAC: Authorizing `identity:get_group(group_id=31d32a6489ef4c96bee919dc004b9b98)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:57.903757 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10494454-4e57-4345-862e-cb18a703e671 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:57.905358 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 225/445] 10.222.0.96 () {56 vars in 1180 bytes} [Wed Aug 24 04:17:57 2022] GET /identity/v3/groups/31d32a6489ef4c96bee919dc004b9b98 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:57.906133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10494454-4e57-4345-862e-cb18a703e671 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:57.919414 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:57.937223 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7cfa51-679b-488b-b1dc-64bae28285fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:57.937843 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cfa51-679b-488b-b1dc-64bae28285fb None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:57.938139 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cfa51-679b-488b-b1dc-64bae28285fb None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:57.938406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cfa51-679b-488b-b1dc-64bae28285fb None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:57.939078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7cfa51-679b-488b-b1dc-64bae28285fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:57.939389 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7cfa51-679b-488b-b1dc-64bae28285fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:57.940787 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7cfa51-679b-488b-b1dc-64bae28285fb None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:57.949748 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 221/446] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:17:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:57.950547 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7cfa51-679b-488b-b1dc-64bae28285fb None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:58.013653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10494454-4e57-4345-862e-cb18a703e671 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:58.050519 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5c54c-f598-4c4b-9cf3-51b8bfbf9c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:58.051278 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5c54c-f598-4c4b-9cf3-51b8bfbf9c7c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:58.051678 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5c54c-f598-4c4b-9cf3-51b8bfbf9c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:58.052154 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5c54c-f598-4c4b-9cf3-51b8bfbf9c7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:58.058849 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7cfa51-679b-488b-b1dc-64bae28285fb None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:58.093458 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8f8b7-cb0f-4db8-bb2e-faa8d1851230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:58.094063 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8f8b7-cb0f-4db8-bb2e-faa8d1851230 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:58.094345 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8f8b7-cb0f-4db8-bb2e-faa8d1851230 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:58.094621 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8f8b7-cb0f-4db8-bb2e-faa8d1851230 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:58.095356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8f8b7-cb0f-4db8-bb2e-faa8d1851230 None admin] RBAC: Adding query filter params (group.id=31d32a6489ef4c96bee919dc004b9b98, role.id=dbb1f67486534e8dbbc250bfe0978e6c, scope.project.id=131c2da412c94e35868fe9dc21137199) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:58.095670 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8f8b7-cb0f-4db8-bb2e-faa8d1851230 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:58.097173 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8f8b7-cb0f-4db8-bb2e-faa8d1851230 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:58.100861 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:58.113339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 222/447] 10.222.0.96 () {56 vars in 1376 bytes} [Wed Aug 24 04:17:57 2022] GET /identity/v3/role_assignments?group.id=31d32a6489ef4c96bee919dc004b9b98&scope.project.id=131c2da412c94e35868fe9dc21137199&role.id=dbb1f67486534e8dbbc250bfe0978e6c => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:58.114985 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8f8b7-cb0f-4db8-bb2e-faa8d1851230 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:58.130422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5c54c-f598-4c4b-9cf3-51b8bfbf9c7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:58.132127 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5c54c-f598-4c4b-9cf3-51b8bfbf9c7c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:58.146314 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:58.253803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 226/448] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:58.260835 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5c54c-f598-4c4b-9cf3-51b8bfbf9c7c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:58.270032 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8f8b7-cb0f-4db8-bb2e-faa8d1851230 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:58.314070 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735242c5-4ab2-4730-98ce-c64880219780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:58.314688 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735242c5-4ab2-4730-98ce-c64880219780 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:58.317954 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735242c5-4ab2-4730-98ce-c64880219780 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:58.317954 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735242c5-4ab2-4730-98ce-c64880219780 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:58.407075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:58.409408 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735242c5-4ab2-4730-98ce-c64880219780 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:58.411373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735242c5-4ab2-4730-98ce-c64880219780 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:58.412455 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5c54c-f598-4c4b-9cf3-51b8bfbf9c7c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:58.432004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:58.467075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40788e-4187-4252-8cac-2d1e730a1318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:58.467714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40788e-4187-4252-8cac-2d1e730a1318 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:58.468021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40788e-4187-4252-8cac-2d1e730a1318 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:58.468271 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40788e-4187-4252-8cac-2d1e730a1318 None admin] PATH_INFO: `/v3/projects/131c2da412c94e35868fe9dc21137199` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:58.469460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40788e-4187-4252-8cac-2d1e730a1318 None admin] RBAC: Authorizing `identity:get_project(project_id=131c2da412c94e35868fe9dc21137199)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:58.470905 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40788e-4187-4252-8cac-2d1e730a1318 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:58.476727 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 227/449] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:58 2022] GET /identity/v3/projects/131c2da412c94e35868fe9dc21137199 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:58.478824 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40788e-4187-4252-8cac-2d1e730a1318 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:58.536320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 223/450] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:17:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:17:58.542305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735242c5-4ab2-4730-98ce-c64880219780 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:58.584189 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40788e-4187-4252-8cac-2d1e730a1318 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:58.619961 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634b0dd-4e0a-4974-ba29-6cde4375a07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:58.620635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634b0dd-4e0a-4974-ba29-6cde4375a07a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:58.620960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634b0dd-4e0a-4974-ba29-6cde4375a07a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:58.621238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634b0dd-4e0a-4974-ba29-6cde4375a07a None admin] PATH_INFO: `/v3/groups/31d32a6489ef4c96bee919dc004b9b98` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:58.622514 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634b0dd-4e0a-4974-ba29-6cde4375a07a None admin] RBAC: Authorizing `identity:get_group(group_id=31d32a6489ef4c96bee919dc004b9b98)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:58.623990 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634b0dd-4e0a-4974-ba29-6cde4375a07a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:58.625641 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 228/451] 10.222.0.96 () {56 vars in 1180 bytes} [Wed Aug 24 04:17:58 2022] GET /identity/v3/groups/31d32a6489ef4c96bee919dc004b9b98 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:17:58.632095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634b0dd-4e0a-4974-ba29-6cde4375a07a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:58.644384 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:58.647672 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735242c5-4ab2-4730-98ce-c64880219780 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:58.680210 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:58.683269 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2b6c8-9cd2-49ac-aada-1af622e0f412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:58.683918 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2b6c8-9cd2-49ac-aada-1af622e0f412 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:58.684198 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2b6c8-9cd2-49ac-aada-1af622e0f412 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:58.684483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2b6c8-9cd2-49ac-aada-1af622e0f412 None admin] PATH_INFO: `/v3/projects/cc9d6801b4c048408ddddff5c9f8e743` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:58.685663 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2b6c8-9cd2-49ac-aada-1af622e0f412 None admin] RBAC: Authorizing `identity:get_project(project_id=cc9d6801b4c048408ddddff5c9f8e743)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:58.687134 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2b6c8-9cd2-49ac-aada-1af622e0f412 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:58.688856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 224/452] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:17:58 2022] GET /identity/v3/projects/cc9d6801b4c048408ddddff5c9f8e743 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:58.694567 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2b6c8-9cd2-49ac-aada-1af622e0f412 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:58.740026 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634b0dd-4e0a-4974-ba29-6cde4375a07a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:58.781193 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe76b14-9628-46ec-887c-f0b1e5a8d3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:58.781825 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe76b14-9628-46ec-887c-f0b1e5a8d3ee None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:58.782111 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe76b14-9628-46ec-887c-f0b1e5a8d3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:58.782636 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe76b14-9628-46ec-887c-f0b1e5a8d3ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:58.783508 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe76b14-9628-46ec-887c-f0b1e5a8d3ee None admin] RBAC: Adding query filter params (group.id=31d32a6489ef4c96bee919dc004b9b98, role.id=b78ed83a66fe4531900cc02bb745f80f, scope.project.id=131c2da412c94e35868fe9dc21137199) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:58.783826 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe76b14-9628-46ec-887c-f0b1e5a8d3ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:58.785322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe76b14-9628-46ec-887c-f0b1e5a8d3ee None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:58.793359 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 229/453] 10.222.0.96 () {56 vars in 1376 bytes} [Wed Aug 24 04:17:58 2022] GET /identity/v3/role_assignments?group.id=31d32a6489ef4c96bee919dc004b9b98&scope.project.id=131c2da412c94e35868fe9dc21137199&role.id=b78ed83a66fe4531900cc02bb745f80f => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:58.828485 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2b6c8-9cd2-49ac-aada-1af622e0f412 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:58.868858 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9091d57-f92e-44ed-9bf2-1fac689aa201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:58.869533 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9091d57-f92e-44ed-9bf2-1fac689aa201 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:58.869779 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9091d57-f92e-44ed-9bf2-1fac689aa201 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:58.870050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9091d57-f92e-44ed-9bf2-1fac689aa201 None admin] PATH_INFO: `/v3/groups/109cf1dd8c684ad4b440393c5ceca526` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:58.871240 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9091d57-f92e-44ed-9bf2-1fac689aa201 None admin] RBAC: Authorizing `identity:get_group(group_id=109cf1dd8c684ad4b440393c5ceca526)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:58.872736 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9091d57-f92e-44ed-9bf2-1fac689aa201 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:58.874393 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 225/454] 10.222.0.96 () {56 vars in 1180 bytes} [Wed Aug 24 04:17:58 2022] GET /identity/v3/groups/109cf1dd8c684ad4b440393c5ceca526 => generated 229 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:17:58.881314 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe76b14-9628-46ec-887c-f0b1e5a8d3ee None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:58.990354 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe76b14-9628-46ec-887c-f0b1e5a8d3ee None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:59.001692 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:59.027246 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41d7a4-bdfd-4506-bf75-f1f413173af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:59.027862 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41d7a4-bdfd-4506-bf75-f1f413173af4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:59.028139 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41d7a4-bdfd-4506-bf75-f1f413173af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:59.028411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41d7a4-bdfd-4506-bf75-f1f413173af4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:59.029192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41d7a4-bdfd-4506-bf75-f1f413173af4 None admin] RBAC: Adding query filter params (group.id=109cf1dd8c684ad4b440393c5ceca526, role.id=059d2bf5bb8e42939f5f826bfdad6a21, scope.project.id=cc9d6801b4c048408ddddff5c9f8e743) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:17:59.029506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41d7a4-bdfd-4506-bf75-f1f413173af4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:59.031003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41d7a4-bdfd-4506-bf75-f1f413173af4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:59.037338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 230/455] 10.222.0.96 () {56 vars in 1376 bytes} [Wed Aug 24 04:17:58 2022] GET /identity/v3/role_assignments?group.id=109cf1dd8c684ad4b440393c5ceca526&scope.project.id=cc9d6801b4c048408ddddff5c9f8e743&role.id=059d2bf5bb8e42939f5f826bfdad6a21 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:01.521219 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792dd5b-f15a-489d-80ea-8ceb44f655a7 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:01.521772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792dd5b-f15a-489d-80ea-8ceb44f655a7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:01.521772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792dd5b-f15a-489d-80ea-8ceb44f655a7 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:01.523471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 226/456] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:01.530293 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130c29b-67e2-4401-90c1-5ebc73e763cc None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:01.530725 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130c29b-67e2-4401-90c1-5ebc73e763cc None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:01.530939 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130c29b-67e2-4401-90c1-5ebc73e763cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:01.557686 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6130c29b-67e2-4401-90c1-5ebc73e763cc None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:01.558906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6130c29b-67e2-4401-90c1-5ebc73e763cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:01.657398 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 231/457] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:18:01.782746 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa358cdc-c0cf-4d50-a712-7faf0b72db0e None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:01.782932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa358cdc-c0cf-4d50-a712-7faf0b72db0e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:01.783213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa358cdc-c0cf-4d50-a712-7faf0b72db0e None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:01.784570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 227/458] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:01.790432 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c51d3-d849-4072-83e1-541a7f2f0a86 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:01.790715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c51d3-d849-4072-83e1-541a7f2f0a86 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:01.790998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c51d3-d849-4072-83e1-541a7f2f0a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:01.796846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c78420-3361-4103-b11a-585b5aed08f7 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:01.797122 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c78420-3361-4103-b11a-585b5aed08f7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:01.797398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c78420-3361-4103-b11a-585b5aed08f7 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:01.798883 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 228/459] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:18:01.804518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c861c-04cc-414f-8487-0e0745ee0cdb None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:01.804833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c861c-04cc-414f-8487-0e0745ee0cdb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:01.805114 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c861c-04cc-414f-8487-0e0745ee0cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:01.831406 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9c3c51d3-d849-4072-83e1-541a7f2f0a86 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:01.833123 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9c3c51d3-d849-4072-83e1-541a7f2f0a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:01.836089 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0e8c861c-04cc-414f-8487-0e0745ee0cdb None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:01.837754 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0e8c861c-04cc-414f-8487-0e0745ee0cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:01.890204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:01.952983 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 229/460] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:18:01.957822 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c861c-04cc-414f-8487-0e0745ee0cdb None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:01.978598 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 232/461] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:02.090771 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c861c-04cc-414f-8487-0e0745ee0cdb None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:02.132361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec4585-6ae4-4566-b1d9-43bb7fda67e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:02.133024 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec4585-6ae4-4566-b1d9-43bb7fda67e3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:02.133303 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec4585-6ae4-4566-b1d9-43bb7fda67e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:02.133580 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec4585-6ae4-4566-b1d9-43bb7fda67e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:02.143883 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec4585-6ae4-4566-b1d9-43bb7fda67e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:02.145538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec4585-6ae4-4566-b1d9-43bb7fda67e3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:02.165164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-1cec4585-6ae4-4566-b1d9-43bb7fda67e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:02.165164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:02.165164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:02.165164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:02.165164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:02.165164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:02.165164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:02.165164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:02.165164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:02.165164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:02.165164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:02.165164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:02.165164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:02.165164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:02.165164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:02.165164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:02.166115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:02.166115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:02.166115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:02.166115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:02.166115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:02.166115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:02.166115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:02.166115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:02.166115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:02.166115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:02.166115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:02.166115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:02.166115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:02.166115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:02.166115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:02.166115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:02.166115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:02.166966 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:02.166966 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:02.166966 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:02.166966 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 230/462] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:18:02.173312 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c51d3-d849-4072-83e1-541a7f2f0a86 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:02.222990 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:02.274493 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d15b76-21c5-493e-9a8e-4cff4830b677 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:02.274776 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d15b76-21c5-493e-9a8e-4cff4830b677 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:02.275054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d15b76-21c5-493e-9a8e-4cff4830b677 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:02.276642 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 231/463] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:18:02.283416 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad2020-572d-428c-8523-5b8a1efa23c7 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:02.283704 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad2020-572d-428c-8523-5b8a1efa23c7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:02.283982 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad2020-572d-428c-8523-5b8a1efa23c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:02.306089 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c51d3-d849-4072-83e1-541a7f2f0a86 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:02.318951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-97ad2020-572d-428c-8523-5b8a1efa23c7 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:02.320591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-97ad2020-572d-428c-8523-5b8a1efa23c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:02.340092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:02.363472 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b90dd-2185-4e02-a9ba-b98fd4971341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:02.365318 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b90dd-2185-4e02-a9ba-b98fd4971341 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:02.365788 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b90dd-2185-4e02-a9ba-b98fd4971341 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:02.366246 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b90dd-2185-4e02-a9ba-b98fd4971341 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:02.367091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b90dd-2185-4e02-a9ba-b98fd4971341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:02.367574 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b90dd-2185-4e02-a9ba-b98fd4971341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:02.369304 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b90dd-2185-4e02-a9ba-b98fd4971341 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:02.385589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 233/464] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:02.387273 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b90dd-2185-4e02-a9ba-b98fd4971341 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:02.397369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 232/465] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:18:02.398187 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad2020-572d-428c-8523-5b8a1efa23c7 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:02.515347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:02.517016 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad2020-572d-428c-8523-5b8a1efa23c7 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:02.525376 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b90dd-2185-4e02-a9ba-b98fd4971341 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:02.563061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f32347-ca66-4722-8db6-a883711f31ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:02.563590 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a1cd58-ae5d-4b39-8a6f-0372f1a31bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:02.564040 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1cd58-ae5d-4b39-8a6f-0372f1a31bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:02.564040 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1cd58-ae5d-4b39-8a6f-0372f1a31bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:02.564269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1cd58-ae5d-4b39-8a6f-0372f1a31bc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:02.565253 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f32347-ca66-4722-8db6-a883711f31ed None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:02.565679 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f32347-ca66-4722-8db6-a883711f31ed None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:02.566092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f32347-ca66-4722-8db6-a883711f31ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:02.577388 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a1cd58-ae5d-4b39-8a6f-0372f1a31bc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:02.578912 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a1cd58-ae5d-4b39-8a6f-0372f1a31bc4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:02.579821 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f32347-ca66-4722-8db6-a883711f31ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:02.582093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f32347-ca66-4722-8db6-a883711f31ed None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:02.593014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:02.597713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-e0a1cd58-ae5d-4b39-8a6f-0372f1a31bc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:02.597713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:02.597713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:02.597713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:02.597713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:02.597713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:02.597713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:02.597713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:02.597713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:02.597713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:02.597713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:02.597713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:02.597713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:02.597713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:02.597713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:02.597713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:02.599284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:02.599284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:02.599284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:02.599284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:02.599284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:02.599284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:02.599284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:02.599284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:02.599284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:02.599284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:02.599284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:02.599284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:02.599284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:02.599284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:02.599284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:02.599284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:02.599284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:02.600377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:02.600377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:02.600377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:02.601938 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 234/466] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:02.602910 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a1cd58-ae5d-4b39-8a6f-0372f1a31bc4 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:02.603254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-72f32347-ca66-4722-8db6-a883711f31ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:02.603254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:02.603254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:02.603254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:02.603254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:02.603254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:02.603254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:02.603254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:02.603254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:02.603254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:02.603254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:02.603254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:02.603254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:02.603254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:02.603254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:02.603254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:02.604250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:02.604250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:02.604250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:02.604250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:02.604250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:02.604250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:02.604250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:02.604250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:02.604250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:02.604250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:02.604250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:02.604250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:02.604250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:02.604250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:02.604250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:02.604250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:02.604250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:02.605354 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:02.605354 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:02.605354 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:02.607033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 233/467] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:02.607991 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f32347-ca66-4722-8db6-a883711f31ed None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:02.723246 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f32347-ca66-4722-8db6-a883711f31ed None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:02.733852 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a1cd58-ae5d-4b39-8a6f-0372f1a31bc4 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:02.758121 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850805d-ead1-47e7-bf2d-7c247729b4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:02.758737 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850805d-ead1-47e7-bf2d-7c247729b4e3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:02.759239 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850805d-ead1-47e7-bf2d-7c247729b4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:02.759586 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850805d-ead1-47e7-bf2d-7c247729b4e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:02.760483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850805d-ead1-47e7-bf2d-7c247729b4e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:02.760747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850805d-ead1-47e7-bf2d-7c247729b4e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:02.762542 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850805d-ead1-47e7-bf2d-7c247729b4e3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:02.776462 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 234/468] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:02.777338 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850805d-ead1-47e7-bf2d-7c247729b4e3 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:02.783276 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94623e69-d99b-48bd-9252-bc087a983c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:02.783960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94623e69-d99b-48bd-9252-bc087a983c81 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:02.784364 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94623e69-d99b-48bd-9252-bc087a983c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:02.784644 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94623e69-d99b-48bd-9252-bc087a983c81 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:02.785452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94623e69-d99b-48bd-9252-bc087a983c81 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:02.786960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94623e69-d99b-48bd-9252-bc087a983c81 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:02.820720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 235/469] 10.222.0.96 () {60 vars in 1132 bytes} [Wed Aug 24 04:18:02 2022] POST /identity/v3/users => generated 246 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:18:02.820720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94623e69-d99b-48bd-9252-bc087a983c81 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:02.820720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:02.890875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:02.941236 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850805d-ead1-47e7-bf2d-7c247729b4e3 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:02.957031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94623e69-d99b-48bd-9252-bc087a983c81 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:02.986827 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9d665-fbd5-48d6-86bb-b37a4296dc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:02.987373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9d665-fbd5-48d6-86bb-b37a4296dc85 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:02.987661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9d665-fbd5-48d6-86bb-b37a4296dc85 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:02.987929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9d665-fbd5-48d6-86bb-b37a4296dc85 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:02.989228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9d665-fbd5-48d6-86bb-b37a4296dc85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:02.989690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9d665-fbd5-48d6-86bb-b37a4296dc85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:02.991095 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9d665-fbd5-48d6-86bb-b37a4296dc85 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:02.997387 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c429a-ebf0-4137-b37e-ccda2c22df8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:02.998029 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c429a-ebf0-4137-b37e-ccda2c22df8b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:02.998314 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c429a-ebf0-4137-b37e-ccda2c22df8b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:02.998592 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c429a-ebf0-4137-b37e-ccda2c22df8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:03.008970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 235/470] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:03.010062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9d665-fbd5-48d6-86bb-b37a4296dc85 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:03.010903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c429a-ebf0-4137-b37e-ccda2c22df8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:03.012369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c429a-ebf0-4137-b37e-ccda2c22df8b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:03.026969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-219c429a-ebf0-4137-b37e-ccda2c22df8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:03.026969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:03.026969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:03.026969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:03.026969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:03.026969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:03.026969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:03.026969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:03.026969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:03.026969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:03.026969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:03.026969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:03.026969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:03.026969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:03.026969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:03.026969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:03.027904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:03.027904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:03.027904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:03.027904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:03.027904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:03.027904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:03.027904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:03.027904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:03.027904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:03.027904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:03.027904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:03.027904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:03.027904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:03.027904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:03.027904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:03.027904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:03.027904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:03.028993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:03.028993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:03.028993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:03.028993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 236/471] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:03.029439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e644602-1907-4695-ba2c-4cabd9b04370 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:03.029990 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e644602-1907-4695-ba2c-4cabd9b04370 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:03.029990 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e644602-1907-4695-ba2c-4cabd9b04370 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:03.031192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 237/472] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:03.031935 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e644602-1907-4695-ba2c-4cabd9b04370 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:03.101670 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:03.127153 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9d665-fbd5-48d6-86bb-b37a4296dc85 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:03.150169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:03.153925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e644602-1907-4695-ba2c-4cabd9b04370 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:03.169913 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7a0bc-7b81-40b8-afff-89d4cc0ff4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:03.169913 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7a0bc-7b81-40b8-afff-89d4cc0ff4a6 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:03.169913 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7a0bc-7b81-40b8-afff-89d4cc0ff4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:03.169913 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7a0bc-7b81-40b8-afff-89d4cc0ff4a6 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:03.170342 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7a0bc-7b81-40b8-afff-89d4cc0ff4a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:03.171179 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7a0bc-7b81-40b8-afff-89d4cc0ff4a6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:03.194796 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb2ecb-0d55-4d3a-9ea1-a56c605a168b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:03.195579 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb2ecb-0d55-4d3a-9ea1-a56c605a168b None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:03.196166 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb2ecb-0d55-4d3a-9ea1-a56c605a168b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:03.196451 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb2ecb-0d55-4d3a-9ea1-a56c605a168b None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:03.197167 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb2ecb-0d55-4d3a-9ea1-a56c605a168b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:03.198645 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb2ecb-0d55-4d3a-9ea1-a56c605a168b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:03.207754 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 236/473] 10.222.0.96 () {60 vars in 1132 bytes} [Wed Aug 24 04:18:03 2022] POST /identity/v3/users => generated 248 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:18:03.209435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7a0bc-7b81-40b8-afff-89d4cc0ff4a6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:03.231469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 238/474] 10.222.0.96 () {60 vars in 1132 bytes} [Wed Aug 24 04:18:03 2022] POST /identity/v3/users => generated 248 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:18:03.231469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cc194-16c7-43b2-a555-07a7c21e1ba3 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:03.231469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cc194-16c7-43b2-a555-07a7c21e1ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:03.231469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cc194-16c7-43b2-a555-07a7c21e1ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:03.275403 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-8c3cc194-16c7-43b2-a555-07a7c21e1ba3 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:03.276747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8c3cc194-16c7-43b2-a555-07a7c21e1ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:03.414426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 239/475] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:03.426910 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7a0bc-7b81-40b8-afff-89d4cc0ff4a6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:03.463356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f8c85-33fb-461b-9371-db81f458f55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:03.464282 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f8c85-33fb-461b-9371-db81f458f55d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:03.464731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f8c85-33fb-461b-9371-db81f458f55d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:03.465166 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f8c85-33fb-461b-9371-db81f458f55d None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:03.465957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f8c85-33fb-461b-9371-db81f458f55d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:03.466431 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f8c85-33fb-461b-9371-db81f458f55d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:03.468023 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f8c85-33fb-461b-9371-db81f458f55d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:03.483045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 237/476] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:03.490327 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3cc194-16c7-43b2-a555-07a7c21e1ba3 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:03.542863 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:03.620181 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3cc194-16c7-43b2-a555-07a7c21e1ba3 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:03.672965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad22c47-dc0d-46c6-b5e6-c3ba5f51947a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:03.673587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad22c47-dc0d-46c6-b5e6-c3ba5f51947a None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:03.673872 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad22c47-dc0d-46c6-b5e6-c3ba5f51947a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:03.674149 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad22c47-dc0d-46c6-b5e6-c3ba5f51947a None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:03.674800 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad22c47-dc0d-46c6-b5e6-c3ba5f51947a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:03.676868 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad22c47-dc0d-46c6-b5e6-c3ba5f51947a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:03.705621 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f8c85-33fb-461b-9371-db81f458f55d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:03.715926 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 240/477] 10.222.0.96 () {60 vars in 1132 bytes} [Wed Aug 24 04:18:03 2022] POST /identity/v3/users => generated 249 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:18:03.748524 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:03.823799 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f8c85-33fb-461b-9371-db81f458f55d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:03.863154 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ed9d0-710f-4da7-88ba-8f6c5c48e482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:03.863944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ed9d0-710f-4da7-88ba-8f6c5c48e482 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:03.864467 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ed9d0-710f-4da7-88ba-8f6c5c48e482 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:03.864777 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ed9d0-710f-4da7-88ba-8f6c5c48e482 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:03.865484 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ed9d0-710f-4da7-88ba-8f6c5c48e482 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:03.866873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ed9d0-710f-4da7-88ba-8f6c5c48e482 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:03.880815 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.sql.core [None req-6b5ed9d0-710f-4da7-88ba-8f6c5c48e482 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 04:18:03.880815 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 04:18:03.880815 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [parameters: {'id': '8288617f501544a1991cda37da9b4555', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 04:18:03.880815 dv-cinder-854263-1-smb devstack@keystone.service[81517]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81517) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 04:18:03.898513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-6b5ed9d0-710f-4da7-88ba-8f6c5c48e482 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 04:18:03.898513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:03.898513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:18:03.898513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:18:03.898513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:18:03.898513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:18:03.898513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:18:03.898513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:18:03.898513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:18:03.898513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:18:03.898513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:18:03.898513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:18:03.898513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:18:03.898513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application result.read() Aug 24 04:18:03.898513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:18:03.899455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:18:03.899455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:18:03.899455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:18:03.899455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:18:03.899455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:18:03.899455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:18:03.899455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:18:03.899455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 04:18:03.899455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:03.899455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 04:18:03.899455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:03.899455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:03.899455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 04:18:03.899455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 04:18:03.899455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 04:18:03.899455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 04:18:03.899455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:18:03.899455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:18:03.900373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 04:18:03.900373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application yield resource Aug 24 04:18:03.900373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:18:03.900373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:18:03.900373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 04:18:03.900373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 04:18:03.900373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 04:18:03.900373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 04:18:03.900373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 04:18:03.900373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise self.value Aug 24 04:18:03.900373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 04:18:03.900373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 04:18:03.900373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 04:18:03.900373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application session.commit() Aug 24 04:18:03.900373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 04:18:03.900373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 04:18:03.900373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 04:18:03.901280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 04:18:03.901280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 04:18:03.901280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self.session.flush() Aug 24 04:18:03.901280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 04:18:03.901280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 04:18:03.901280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 04:18:03.901280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 04:18:03.901280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 04:18:03.901280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application compat.raise_( Aug 24 04:18:03.901280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:18:03.901280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception Aug 24 04:18:03.901280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 04:18:03.901280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 04:18:03.901280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 04:18:03.901280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 04:18:03.901280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 04:18:03.901280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 04:18:03.902157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 04:18:03.902157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 04:18:03.902157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 04:18:03.902157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 04:18:03.902157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 04:18:03.902157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 04:18:03.902157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 04:18:03.902157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 04:18:03.902157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 04:18:03.902157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 04:18:03.902157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 04:18:03.902157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 04:18:03.902157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 04:18:03.902157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 04:18:03.902157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:18:03.902157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception Aug 24 04:18:03.902999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:18:03.902999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:18:03.902999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:18:03.902999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:18:03.902999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:18:03.902999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:18:03.902999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:18:03.902999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:18:03.902999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:18:03.902999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:18:03.902999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:18:03.902999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application result.read() Aug 24 04:18:03.902999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:18:03.902999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:18:03.902999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:18:03.902999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:18:03.903809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:18:03.903809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:18:03.903809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:18:03.903809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:18:03.903809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 04:18:03.903809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 04:18:03.903809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [parameters: {'id': '8288617f501544a1991cda37da9b4555', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 04:18:03.903809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 04:18:03.903809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:03.903809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:18:03.903809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:03.903809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:03.903809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:03.903809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:03.903809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:03.903809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:03.904646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:03.904646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:03.904646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:03.904646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:03.904646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:03.904646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:03.904646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 04:18:03.904646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 04:18:03.904646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:03.904646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:03.904646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 04:18:03.904646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 04:18:03.904646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 04:18:03.904646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 04:18:03.904646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 04:18:03.904646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:03.909472 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 238/478] 10.222.0.96 () {60 vars in 1131 bytes} [Wed Aug 24 04:18:03 2022] POST /identity/v3/roles => generated 144 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:03.909615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad22c47-dc0d-46c6-b5e6-c3ba5f51947a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:04.044766 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:04.051554 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad22c47-dc0d-46c6-b5e6-c3ba5f51947a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:04.091307 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c8c2f-e86d-4af0-9105-80d38f61094e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:04.091933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c8c2f-e86d-4af0-9105-80d38f61094e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:04.092222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c8c2f-e86d-4af0-9105-80d38f61094e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:04.092501 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c8c2f-e86d-4af0-9105-80d38f61094e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:04.104499 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c8c2f-e86d-4af0-9105-80d38f61094e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:04.109897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-101c8c2f-e86d-4af0-9105-80d38f61094e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:18:04.109897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:04.109897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:04.109897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:04.109897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:04.109897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:04.109897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:04.109897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:04.109897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:04.109897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:04.109897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:04.109897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:04.109897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:04.109897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:04.109897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:04.109897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:04.110754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:04.110754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:04.110754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:04.110754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:04.110754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:04.110754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:04.110754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:04.110754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:04.110754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:04.110754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:04.110754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:04.110754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:04.110754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:04.110754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:04.110754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:04.110754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:04.111557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:04.111557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:04.111557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:04.111557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:04.111557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:04.111557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:04.111557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:04.111557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:04.111557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:04.111557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:04.111557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:18:04.111557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:04.111557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 241/479] 10.222.0.96 () {56 vars in 1114 bytes} [Wed Aug 24 04:18:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:04.116946 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ed9d0-710f-4da7-88ba-8f6c5c48e482 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:04.226242 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:04.229612 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ed9d0-710f-4da7-88ba-8f6c5c48e482 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:04.266710 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763a67d-182b-4939-88b5-5f056c538a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:04.267329 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763a67d-182b-4939-88b5-5f056c538a2e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:04.267724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763a67d-182b-4939-88b5-5f056c538a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:04.268026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763a67d-182b-4939-88b5-5f056c538a2e None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:04.268783 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763a67d-182b-4939-88b5-5f056c538a2e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:04.269098 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763a67d-182b-4939-88b5-5f056c538a2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:04.271171 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763a67d-182b-4939-88b5-5f056c538a2e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:04.281764 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 239/480] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:04.984065 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620442dc-c77f-482f-8343-ee3a2b3b8de4 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:04.984617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620442dc-c77f-482f-8343-ee3a2b3b8de4 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:04.984617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620442dc-c77f-482f-8343-ee3a2b3b8de4 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:04.986297 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 242/481] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:04.991975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bcc05-4a80-4b7d-a0b6-97d86b42818b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:04.992402 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bcc05-4a80-4b7d-a0b6-97d86b42818b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:04.992575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bcc05-4a80-4b7d-a0b6-97d86b42818b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:05.021699 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ff4bcc05-4a80-4b7d-a0b6-97d86b42818b None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:05.022914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ff4bcc05-4a80-4b7d-a0b6-97d86b42818b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:05.114906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 240/482] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:18:05.458127 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620442dc-c77f-482f-8343-ee3a2b3b8de4 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:05.573038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620442dc-c77f-482f-8343-ee3a2b3b8de4 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:05.608372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b8cc6-c866-4ac7-8852-07aea2e1be36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:05.609042 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b8cc6-c866-4ac7-8852-07aea2e1be36 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:05.609330 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b8cc6-c866-4ac7-8852-07aea2e1be36 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:05.609606 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b8cc6-c866-4ac7-8852-07aea2e1be36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:05.621281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b8cc6-c866-4ac7-8852-07aea2e1be36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:05.626050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-f27b8cc6-c866-4ac7-8852-07aea2e1be36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:05.626050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:05.626050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:05.626050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:05.626050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:05.626050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:05.626050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:05.626050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:05.626050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:05.626050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:05.626050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:05.626050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:05.626050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:05.626050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:05.626050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:05.626050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:05.627031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:05.627031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:05.627031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:05.627031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:05.627031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:05.627031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:05.627031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:05.627031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:05.627031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:05.627031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:05.627031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:05.627031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:05.627031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:05.627031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:05.627031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:05.627031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:05.627841 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:05.627841 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:05.627841 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:05.627841 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:05.627841 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:05.627841 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:05.627841 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:05.627841 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:05.627841 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:05.627841 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:05.627841 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:05.627841 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:05.627841 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 243/483] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:18:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:05.634319 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bcc05-4a80-4b7d-a0b6-97d86b42818b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:05.769215 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:05.774984 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bcc05-4a80-4b7d-a0b6-97d86b42818b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:05.810914 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d165756-295b-43a6-af20-aaec5c4f2e4f None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:05.811217 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d165756-295b-43a6-af20-aaec5c4f2e4f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:05.811583 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d165756-295b-43a6-af20-aaec5c4f2e4f None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:05.813106 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 244/484] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:18:05.818640 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775ecbe-8927-4c18-8784-377f9c64ef49 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:05.818929 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775ecbe-8927-4c18-8784-377f9c64ef49 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:05.819212 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775ecbe-8927-4c18-8784-377f9c64ef49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:05.820004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c120f7-1be2-46e2-a52e-3a633259ff46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:05.820627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c120f7-1be2-46e2-a52e-3a633259ff46 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:05.821194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c120f7-1be2-46e2-a52e-3a633259ff46 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:05.821468 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c120f7-1be2-46e2-a52e-3a633259ff46 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:05.822243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c120f7-1be2-46e2-a52e-3a633259ff46 None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:05.822555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c120f7-1be2-46e2-a52e-3a633259ff46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:05.823938 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c120f7-1be2-46e2-a52e-3a633259ff46 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:05.839430 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 241/485] 10.222.0.96 () {56 vars in 1103 bytes} [Wed Aug 24 04:18:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:05.839430 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c120f7-1be2-46e2-a52e-3a633259ff46 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:05.849961 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-7775ecbe-8927-4c18-8784-377f9c64ef49 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:05.851753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7775ecbe-8927-4c18-8784-377f9c64ef49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:05.866900 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:05.952714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 245/486] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:05.952714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4a4f6-43aa-4520-9af6-450d978b72f2 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:05.952714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4a4f6-43aa-4520-9af6-450d978b72f2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:05.952714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4a4f6-43aa-4520-9af6-450d978b72f2 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:05.952714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 246/487] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:05.958630 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcc45e-f2ad-4863-b0ce-7d0c38878e6f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:05.959238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcc45e-f2ad-4863-b0ce-7d0c38878e6f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:05.959508 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcc45e-f2ad-4863-b0ce-7d0c38878e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:05.974607 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c120f7-1be2-46e2-a52e-3a633259ff46 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:05.979335 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-7ebcc45e-f2ad-4863-b0ce-7d0c38878e6f None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:05.980711 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7ebcc45e-f2ad-4863-b0ce-7d0c38878e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:06.043186 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1593bd-89dc-4264-b7c6-a22878ebafcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:06.044410 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1593bd-89dc-4264-b7c6-a22878ebafcf None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:06.045032 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1593bd-89dc-4264-b7c6-a22878ebafcf None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:06.045531 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1593bd-89dc-4264-b7c6-a22878ebafcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:06.061224 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 247/488] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:06.069826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1593bd-89dc-4264-b7c6-a22878ebafcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:06.071576 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1593bd-89dc-4264-b7c6-a22878ebafcf None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:06.092561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-dc1593bd-89dc-4264-b7c6-a22878ebafcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:06.092561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:06.092561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:06.092561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:06.092561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:06.092561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:06.092561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:06.092561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:06.092561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:06.092561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:06.092561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:06.092561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:06.092561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:06.092561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:06.092561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:06.092561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:06.093508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:06.093508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:06.093508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:06.093508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:06.093508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:06.093508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:06.093508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:06.093508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:06.093508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:06.093508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:06.093508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:06.093508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:06.093508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:06.093508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:06.093508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:06.093508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:06.093508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:06.094370 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:06.094370 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:06.094370 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:06.094370 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 242/489] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:06.101319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcc45e-f2ad-4863-b0ce-7d0c38878e6f None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:06.246819 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:06.283488 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcc45e-f2ad-4863-b0ce-7d0c38878e6f None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:06.309724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1593bd-89dc-4264-b7c6-a22878ebafcf None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:06.324738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:06.336454 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2d1ab-546b-4cc9-91ee-f91420ed85c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:06.337104 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2d1ab-546b-4cc9-91ee-f91420ed85c6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:06.337392 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2d1ab-546b-4cc9-91ee-f91420ed85c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:06.337672 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2d1ab-546b-4cc9-91ee-f91420ed85c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:06.338334 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2d1ab-546b-4cc9-91ee-f91420ed85c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:06.338645 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2d1ab-546b-4cc9-91ee-f91420ed85c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:06.340051 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2d1ab-546b-4cc9-91ee-f91420ed85c6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:06.364589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 248/490] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:06.368459 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2d1ab-546b-4cc9-91ee-f91420ed85c6 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:06.465278 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1593bd-89dc-4264-b7c6-a22878ebafcf None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:06.505082 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1dadf6-0baa-48a2-8f7a-1b8f5405129f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:06.505724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1dadf6-0baa-48a2-8f7a-1b8f5405129f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:06.506007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1dadf6-0baa-48a2-8f7a-1b8f5405129f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:06.506277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1dadf6-0baa-48a2-8f7a-1b8f5405129f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:06.506370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2d1ab-546b-4cc9-91ee-f91420ed85c6 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:06.517652 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1dadf6-0baa-48a2-8f7a-1b8f5405129f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:06.523513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-be1dadf6-0baa-48a2-8f7a-1b8f5405129f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:06.523513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:06.523513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:06.523513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:06.523513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:06.523513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:06.523513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:06.523513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:06.523513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:06.523513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:06.523513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:06.523513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:06.523513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:06.523513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:06.523513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:06.523513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:06.524409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:06.524409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:06.524409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:06.524409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:06.524409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:06.524409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:06.524409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:06.524409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:06.524409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:06.524409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:06.524409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:06.524409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:06.524409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:06.524409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:06.524409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:06.524409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:06.525268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:06.525268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:06.525268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:06.525268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:06.525268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:06.525268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:06.525268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:06.525268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:06.525268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:06.525268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:06.525268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:06.525268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:06.525268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 243/491] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:18:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:06.525970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1dadf6-0baa-48a2-8f7a-1b8f5405129f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:06.548063 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e33003-5525-4692-916e-c8ef1c016aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:06.548708 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e33003-5525-4692-916e-c8ef1c016aab None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:06.549004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e33003-5525-4692-916e-c8ef1c016aab None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:06.549277 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e33003-5525-4692-916e-c8ef1c016aab None admin] PATH_INFO: `/v3/users/nova` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:06.553472 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:06.559452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e33003-5525-4692-916e-c8ef1c016aab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:06.561088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e33003-5525-4692-916e-c8ef1c016aab None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:06.574922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-75e33003-5525-4692-916e-c8ef1c016aab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:18:06.574922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:06.574922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:06.574922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:06.574922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:06.574922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:06.574922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:06.574922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:06.574922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:06.574922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:06.574922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:06.574922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:06.574922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:06.574922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:06.574922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:06.574922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:06.575898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:06.575898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:06.575898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:06.575898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:06.575898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:06.575898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:06.575898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:06.575898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:06.575898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:06.575898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:06.575898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:06.575898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:06.575898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:06.575898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:06.575898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:06.575898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:06.575898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:06.575898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:06.577643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:06.577643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:06.577643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:06.577643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:06.577643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:06.577643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:06.577643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:06.577643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:06.577643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:18:06.577643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:06.577643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 249/492] 10.222.0.96 () {56 vars in 1093 bytes} [Wed Aug 24 04:18:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:06.577643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43f28f-0566-43c3-a958-9e2b2e66d788 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:06.577643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43f28f-0566-43c3-a958-9e2b2e66d788 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:06.578310 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43f28f-0566-43c3-a958-9e2b2e66d788 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:06.584035 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 250/493] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:06.584839 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43f28f-0566-43c3-a958-9e2b2e66d788 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:06.600541 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:06.638585 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1dadf6-0baa-48a2-8f7a-1b8f5405129f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:06.674568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512046dd-d43b-4fad-a335-f4c6b13d050d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:06.675202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512046dd-d43b-4fad-a335-f4c6b13d050d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:06.675491 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512046dd-d43b-4fad-a335-f4c6b13d050d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:06.675758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512046dd-d43b-4fad-a335-f4c6b13d050d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:06.686722 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512046dd-d43b-4fad-a335-f4c6b13d050d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:06.692409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-512046dd-d43b-4fad-a335-f4c6b13d050d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:06.692409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:06.692409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:06.692409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:06.692409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:06.692409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:06.692409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:06.692409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:06.692409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:06.692409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:06.692409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:06.692409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:06.692409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:06.692409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:06.692409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:06.692409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:06.693441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:06.693441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:06.693441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:06.693441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:06.693441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:06.693441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:06.693441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:06.693441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:06.693441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:06.693441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:06.693441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:06.693441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:06.693441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:06.693441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:06.693441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:06.693441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:06.694434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:06.694434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:06.694434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:06.694434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:06.694434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:06.694434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:06.694434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:06.694434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:06.694434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:06.694434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:06.694434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:06.694434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:06.698478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 244/494] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:18:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:06.699547 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512046dd-d43b-4fad-a335-f4c6b13d050d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:06.704084 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43f28f-0566-43c3-a958-9e2b2e66d788 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:06.741173 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461212c-e179-4248-9354-656237563471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:06.741786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461212c-e179-4248-9354-656237563471 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:06.742076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461212c-e179-4248-9354-656237563471 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:06.742356 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461212c-e179-4248-9354-656237563471 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:06.743024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461212c-e179-4248-9354-656237563471 None admin] RBAC: Adding query filter params (name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:06.743330 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461212c-e179-4248-9354-656237563471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:06.744749 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461212c-e179-4248-9354-656237563471 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:06.752974 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 251/495] 10.222.0.96 () {56 vars in 1103 bytes} [Wed Aug 24 04:18:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:06.754165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1896e7-ae93-42fa-a22b-3f407d059db3 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:06.755185 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1896e7-ae93-42fa-a22b-3f407d059db3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:06.755546 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1896e7-ae93-42fa-a22b-3f407d059db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:06.773532 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ff1896e7-ae93-42fa-a22b-3f407d059db3 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:06.774732 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ff1896e7-ae93-42fa-a22b-3f407d059db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:06.814508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512046dd-d43b-4fad-a335-f4c6b13d050d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:06.844332 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:06.854563 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:06.864729 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 252/496] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:06.864729 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1896e7-ae93-42fa-a22b-3f407d059db3 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:06.875732 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc087bdc-1bcd-49df-9be0-cd059e535bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:06.876351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc087bdc-1bcd-49df-9be0-cd059e535bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:06.876636 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc087bdc-1bcd-49df-9be0-cd059e535bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:06.876933 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc087bdc-1bcd-49df-9be0-cd059e535bd1 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:06.877668 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc087bdc-1bcd-49df-9be0-cd059e535bd1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:06.877979 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc087bdc-1bcd-49df-9be0-cd059e535bd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:06.880183 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc087bdc-1bcd-49df-9be0-cd059e535bd1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:06.918148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 245/497] 10.222.0.96 () {56 vars in 1133 bytes} [Wed Aug 24 04:18:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:06.919303 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc087bdc-1bcd-49df-9be0-cd059e535bd1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:06.979443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1896e7-ae93-42fa-a22b-3f407d059db3 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:07.017762 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd902bc3-ba55-43b3-a64e-e2d7c8bd3219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:07.018402 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd902bc3-ba55-43b3-a64e-e2d7c8bd3219 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:07.018688 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd902bc3-ba55-43b3-a64e-e2d7c8bd3219 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:07.018964 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd902bc3-ba55-43b3-a64e-e2d7c8bd3219 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:07.019638 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd902bc3-ba55-43b3-a64e-e2d7c8bd3219 None admin] RBAC: Adding query filter params (name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:07.019995 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd902bc3-ba55-43b3-a64e-e2d7c8bd3219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:07.021681 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd902bc3-ba55-43b3-a64e-e2d7c8bd3219 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:07.029672 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 253/498] 10.222.0.96 () {56 vars in 1103 bytes} [Wed Aug 24 04:18:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:07.030830 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340eea3-5aad-438e-98f1-6b5ffb7acbe8 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:07.031075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc087bdc-1bcd-49df-9be0-cd059e535bd1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:07.031175 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340eea3-5aad-438e-98f1-6b5ffb7acbe8 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:07.031377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340eea3-5aad-438e-98f1-6b5ffb7acbe8 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:07.032566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 254/499] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:07.033285 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340eea3-5aad-438e-98f1-6b5ffb7acbe8 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:07.075653 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053441db-709b-495a-b80e-17bb20dd98ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:07.076888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053441db-709b-495a-b80e-17bb20dd98ef None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:07.077449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053441db-709b-495a-b80e-17bb20dd98ef None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:07.077735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053441db-709b-495a-b80e-17bb20dd98ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:07.087472 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:07.088491 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053441db-709b-495a-b80e-17bb20dd98ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:07.089995 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053441db-709b-495a-b80e-17bb20dd98ef None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:07.104857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-053441db-709b-495a-b80e-17bb20dd98ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:07.104857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:07.104857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:07.104857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:07.104857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:07.104857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:07.104857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:07.104857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:07.104857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:07.104857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:07.104857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:07.104857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:07.104857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:07.104857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:07.104857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:07.104857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:07.105789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:07.105789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:07.105789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:07.105789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:07.105789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:07.105789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:07.105789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:07.105789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:07.105789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:07.105789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:07.105789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:07.105789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:07.105789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:07.105789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:07.105789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:07.105789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:07.105789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:07.106644 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:07.106644 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:07.106644 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:07.106644 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 246/500] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:07.106869 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053441db-709b-495a-b80e-17bb20dd98ef None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:07.143281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:07.149494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340eea3-5aad-438e-98f1-6b5ffb7acbe8 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:07.184100 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f402c-8e6b-4f8d-ae8c-60e57147e11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:07.184771 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f402c-8e6b-4f8d-ae8c-60e57147e11c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:07.185055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f402c-8e6b-4f8d-ae8c-60e57147e11c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:07.185331 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f402c-8e6b-4f8d-ae8c-60e57147e11c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:07.212613 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053441db-709b-495a-b80e-17bb20dd98ef None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:07.246795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b64019-6db3-43de-8337-4980277893b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:07.247427 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b64019-6db3-43de-8337-4980277893b6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:07.247706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b64019-6db3-43de-8337-4980277893b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:07.247976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b64019-6db3-43de-8337-4980277893b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:07.254813 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f402c-8e6b-4f8d-ae8c-60e57147e11c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:07.256277 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f402c-8e6b-4f8d-ae8c-60e57147e11c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:07.262518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b64019-6db3-43de-8337-4980277893b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:07.265093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b64019-6db3-43de-8337-4980277893b6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:07.280651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-45b64019-6db3-43de-8337-4980277893b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:07.280651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:07.280651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:07.280651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:07.280651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:07.280651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:07.280651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:07.280651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:07.280651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:07.280651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:07.280651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:07.280651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:07.280651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:07.280651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:07.280651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:07.280651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:07.281715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:07.281715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:07.281715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:07.281715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:07.281715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:07.281715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:07.281715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:07.281715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:07.281715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:07.281715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:07.281715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:07.281715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:07.281715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:07.281715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:07.281715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:07.281715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:07.281715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:07.282553 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:07.282553 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:07.282553 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:07.284834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 247/501] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:07.286861 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c358c1-9e7d-45ef-bb92-5174b6abad74 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:07.287348 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c358c1-9e7d-45ef-bb92-5174b6abad74 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:07.287625 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c358c1-9e7d-45ef-bb92-5174b6abad74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:07.305935 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d7c358c1-9e7d-45ef-bb92-5174b6abad74 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:07.307152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d7c358c1-9e7d-45ef-bb92-5174b6abad74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:07.308992 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:07.362312 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 255/502] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:18:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:07.363153 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f402c-8e6b-4f8d-ae8c-60e57147e11c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:07.376806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 248/503] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:07.381635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c358c1-9e7d-45ef-bb92-5174b6abad74 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:07.402108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:07.474298 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f402c-8e6b-4f8d-ae8c-60e57147e11c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:07.487545 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c358c1-9e7d-45ef-bb92-5174b6abad74 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:07.510445 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d36398-ce58-498e-9b2c-ada0ce8696f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:07.511050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d36398-ce58-498e-9b2c-ada0ce8696f9 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:07.511330 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d36398-ce58-498e-9b2c-ada0ce8696f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:07.511604 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d36398-ce58-498e-9b2c-ada0ce8696f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:07.512310 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d36398-ce58-498e-9b2c-ada0ce8696f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:07.512895 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d36398-ce58-498e-9b2c-ada0ce8696f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:07.514029 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d36398-ce58-498e-9b2c-ada0ce8696f9 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:07.524276 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267be2e4-5db0-4760-a57e-17f6ea65aba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:07.524949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267be2e4-5db0-4760-a57e-17f6ea65aba2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:07.525231 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267be2e4-5db0-4760-a57e-17f6ea65aba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:07.525504 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267be2e4-5db0-4760-a57e-17f6ea65aba2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:07.530956 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 256/504] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:07.530956 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d36398-ce58-498e-9b2c-ada0ce8696f9 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:07.541657 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267be2e4-5db0-4760-a57e-17f6ea65aba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:07.542946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:07.546544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-267be2e4-5db0-4760-a57e-17f6ea65aba2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:07.546544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:07.546544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:07.546544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:07.546544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:07.546544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:07.546544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:07.546544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:07.546544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:07.546544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:07.546544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:07.546544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:07.546544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:07.546544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:07.546544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:07.546544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:07.547449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:07.547449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:07.547449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:07.547449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:07.547449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:07.547449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:07.547449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:07.547449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:07.547449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:07.547449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:07.547449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:07.547449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:07.547449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:07.547449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:07.547449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:07.547449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:07.548248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:07.548248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:07.548248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:07.548248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:07.548248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:07.548248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:07.548248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:07.548248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:07.548248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:07.548248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:07.548248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:07.548248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:07.548248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 249/505] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:18:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:07.549488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267be2e4-5db0-4760-a57e-17f6ea65aba2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:07.638896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:07.647078 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d36398-ce58-498e-9b2c-ada0ce8696f9 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:07.667502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267be2e4-5db0-4760-a57e-17f6ea65aba2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:07.682287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60939196-088b-4025-9270-ba29d8c82fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:07.682891 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60939196-088b-4025-9270-ba29d8c82fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:07.683172 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60939196-088b-4025-9270-ba29d8c82fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:07.683444 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60939196-088b-4025-9270-ba29d8c82fe9 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:07.684082 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60939196-088b-4025-9270-ba29d8c82fe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:07.684384 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60939196-088b-4025-9270-ba29d8c82fe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:07.685779 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60939196-088b-4025-9270-ba29d8c82fe9 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:07.697716 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 257/506] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:07.698504 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60939196-088b-4025-9270-ba29d8c82fe9 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:07.704159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2623e-0014-4b55-8ce9-e8bdbfc20fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:07.704811 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2623e-0014-4b55-8ce9-e8bdbfc20fdb None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:07.705093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2623e-0014-4b55-8ce9-e8bdbfc20fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:07.705388 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2623e-0014-4b55-8ce9-e8bdbfc20fdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:07.716323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2623e-0014-4b55-8ce9-e8bdbfc20fdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:07.717827 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2623e-0014-4b55-8ce9-e8bdbfc20fdb None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:07.733049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-d3e2623e-0014-4b55-8ce9-e8bdbfc20fdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:07.733049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:07.733049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:07.733049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:07.733049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:07.733049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:07.733049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:07.733049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:07.733049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:07.733049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:07.733049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:07.733049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:07.733049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:07.733049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:07.733049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:07.733049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:07.734084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:07.734084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:07.734084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:07.734084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:07.734084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:07.734084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:07.734084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:07.734084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:07.734084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:07.734084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:07.734084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:07.734084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:07.734084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:07.734084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:07.734084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:07.734084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:07.734084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:07.735303 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:07.735303 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:07.735303 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:07.735303 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 250/507] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:07.735303 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2623e-0014-4b55-8ce9-e8bdbfc20fdb None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:07.771270 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:07.803923 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60939196-088b-4025-9270-ba29d8c82fe9 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:07.840085 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2623e-0014-4b55-8ce9-e8bdbfc20fdb None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:07.841442 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fd44e-4f32-489b-af75-d2d28bd6cce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:07.842095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fd44e-4f32-489b-af75-d2d28bd6cce2 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:07.842366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fd44e-4f32-489b-af75-d2d28bd6cce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:07.842645 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fd44e-4f32-489b-af75-d2d28bd6cce2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:07.850632 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fd44e-4f32-489b-af75-d2d28bd6cce2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:07.852066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fd44e-4f32-489b-af75-d2d28bd6cce2 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:07.864191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-530fd44e-4f32-489b-af75-d2d28bd6cce2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:18:07.864191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:07.864191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:07.864191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:07.864191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:07.864191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:07.864191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:07.864191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:07.864191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:07.864191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:07.864191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:07.864191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:07.864191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:07.864191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:07.864191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:07.864191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:07.865162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:07.865162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:07.865162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:07.865162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:07.865162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:07.865162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:07.865162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:07.865162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:07.865162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:07.865162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:07.865162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:07.865162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:07.865162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:07.865162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:07.865162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:07.865162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:07.865162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:07.865162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:07.866052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:07.866052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:07.866052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:07.866052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:07.866052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:07.866052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:07.866052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:07.866052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:07.866052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:18:07.866052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:07.866052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 258/508] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:18:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:07.866052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fd44e-4f32-489b-af75-d2d28bd6cce2 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:07.873379 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:07.880511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb21bd-efcc-4fcf-82c7-4842a880ee64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:07.881177 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb21bd-efcc-4fcf-82c7-4842a880ee64 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:07.881453 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb21bd-efcc-4fcf-82c7-4842a880ee64 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:07.881723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb21bd-efcc-4fcf-82c7-4842a880ee64 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:07.882381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb21bd-efcc-4fcf-82c7-4842a880ee64 None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:07.882685 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb21bd-efcc-4fcf-82c7-4842a880ee64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:07.884045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb21bd-efcc-4fcf-82c7-4842a880ee64 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:07.892437 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 251/509] 10.222.0.96 () {56 vars in 1103 bytes} [Wed Aug 24 04:18:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:07.892983 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb21bd-efcc-4fcf-82c7-4842a880ee64 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:07.971575 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fd44e-4f32-489b-af75-d2d28bd6cce2 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:07.993374 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb21bd-efcc-4fcf-82c7-4842a880ee64 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:08.001209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:08.008810 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f98ea-746b-40ab-a167-aa362d054537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:08.009446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f98ea-746b-40ab-a167-aa362d054537 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:08.009728 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f98ea-746b-40ab-a167-aa362d054537 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:08.010003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f98ea-746b-40ab-a167-aa362d054537 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:08.021334 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f98ea-746b-40ab-a167-aa362d054537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:08.022807 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f98ea-746b-40ab-a167-aa362d054537 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:08.027927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d9254-e05a-4e44-8f47-0fef6d3343ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:08.028553 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d9254-e05a-4e44-8f47-0fef6d3343ae None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:08.028869 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d9254-e05a-4e44-8f47-0fef6d3343ae None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:08.029149 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d9254-e05a-4e44-8f47-0fef6d3343ae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:08.036780 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d9254-e05a-4e44-8f47-0fef6d3343ae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:08.037196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-151f98ea-746b-40ab-a167-aa362d054537 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:08.037196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:08.037196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:08.037196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:08.037196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:08.037196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:08.037196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:08.037196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:08.037196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:08.037196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:08.037196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:08.037196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:08.037196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:08.037196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:08.037196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:08.037196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:08.038238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:08.038238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:08.038238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:08.038238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:08.038238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:08.038238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:08.038238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:08.038238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:08.038238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:08.038238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:08.038238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:08.038238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:08.038238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:08.038238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:08.038238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:08.038238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:08.038238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:08.039275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:08.039275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:08.039275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:08.039468 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d9254-e05a-4e44-8f47-0fef6d3343ae None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:08.041044 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 259/510] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:08.041780 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f98ea-746b-40ab-a167-aa362d054537 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:08.051271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-541d9254-e05a-4e44-8f47-0fef6d3343ae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:18:08.051271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:08.051271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:08.051271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:08.051271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:08.051271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:08.051271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:08.051271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:08.051271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:08.051271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:08.051271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:08.051271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:08.051271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:08.051271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:08.051271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:08.051271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:08.052209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:08.052209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:08.052209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:08.052209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:08.052209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:08.052209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:08.052209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:08.052209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:08.052209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:08.052209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:08.052209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:08.052209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:08.052209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:08.052209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:08.052209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:08.052209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:08.052209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:08.052209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:08.053664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:08.053664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:08.053664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:08.053664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:08.053664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:08.053664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:08.053664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:08.053664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:08.053664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:18:08.053664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:08.053664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 252/511] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:18:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:08.053664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d9254-e05a-4e44-8f47-0fef6d3343ae None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:08.106392 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:08.148648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f98ea-746b-40ab-a167-aa362d054537 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:08.154047 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d9254-e05a-4e44-8f47-0fef6d3343ae None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:08.182445 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301aa9c7-cf13-4189-929d-446c36a24734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:08.183052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301aa9c7-cf13-4189-929d-446c36a24734 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:08.183334 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301aa9c7-cf13-4189-929d-446c36a24734 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:08.183611 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301aa9c7-cf13-4189-929d-446c36a24734 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:08.184251 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301aa9c7-cf13-4189-929d-446c36a24734 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:08.184558 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301aa9c7-cf13-4189-929d-446c36a24734 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:08.185990 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301aa9c7-cf13-4189-929d-446c36a24734 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:08.187247 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee117fc-d518-4992-8392-c2b96ea1d2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:08.187857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee117fc-d518-4992-8392-c2b96ea1d2ab None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:08.188147 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee117fc-d518-4992-8392-c2b96ea1d2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:08.188442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee117fc-d518-4992-8392-c2b96ea1d2ab None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:08.189207 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee117fc-d518-4992-8392-c2b96ea1d2ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:08.189521 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee117fc-d518-4992-8392-c2b96ea1d2ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:08.190955 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee117fc-d518-4992-8392-c2b96ea1d2ab None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:08.198637 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 260/512] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:08.199443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301aa9c7-cf13-4189-929d-446c36a24734 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:08.215596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 253/513] 10.222.0.96 () {56 vars in 1137 bytes} [Wed Aug 24 04:18:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:08.216542 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee117fc-d518-4992-8392-c2b96ea1d2ab None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:08.249073 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:08.307000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301aa9c7-cf13-4189-929d-446c36a24734 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:08.318369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee117fc-d518-4992-8392-c2b96ea1d2ab None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:08.329403 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:08.344926 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5104b-aeea-4551-b338-f79ef39661fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:08.345554 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5104b-aeea-4551-b338-f79ef39661fe None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:08.345833 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5104b-aeea-4551-b338-f79ef39661fe None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:08.346106 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5104b-aeea-4551-b338-f79ef39661fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:08.353521 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8ee06-f6af-4e5e-94b1-6ab3dba5f0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:08.354122 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8ee06-f6af-4e5e-94b1-6ab3dba5f0ef None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:08.354400 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8ee06-f6af-4e5e-94b1-6ab3dba5f0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:08.354669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8ee06-f6af-4e5e-94b1-6ab3dba5f0ef None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:08.355301 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8ee06-f6af-4e5e-94b1-6ab3dba5f0ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:08.355606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8ee06-f6af-4e5e-94b1-6ab3dba5f0ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:08.356046 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5104b-aeea-4551-b338-f79ef39661fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:08.356996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8ee06-f6af-4e5e-94b1-6ab3dba5f0ef None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:08.357520 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5104b-aeea-4551-b338-f79ef39661fe None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:08.368511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 254/514] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:08.369326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8ee06-f6af-4e5e-94b1-6ab3dba5f0ef None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:08.372840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-fec5104b-aeea-4551-b338-f79ef39661fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:08.372840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:08.372840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:08.372840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:08.372840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:08.372840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:08.372840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:08.372840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:08.372840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:08.372840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:08.372840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:08.372840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:08.372840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:08.372840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:08.372840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:08.372840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:08.373801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:08.373801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:08.373801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:08.373801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:08.373801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:08.373801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:08.373801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:08.373801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:08.373801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:08.373801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:08.373801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:08.373801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:08.373801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:08.373801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:08.373801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:08.373801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:08.373801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:08.374668 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:08.374668 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:08.374668 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:08.374668 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 261/515] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:08.375214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5104b-aeea-4551-b338-f79ef39661fe None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:08.477067 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:08.480564 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8ee06-f6af-4e5e-94b1-6ab3dba5f0ef None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:08.484472 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5104b-aeea-4551-b338-f79ef39661fe None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:08.517334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535766ea-5d52-4dbd-bbaa-8470ee14b52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:08.517963 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535766ea-5d52-4dbd-bbaa-8470ee14b52d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:08.518251 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535766ea-5d52-4dbd-bbaa-8470ee14b52d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:08.518529 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535766ea-5d52-4dbd-bbaa-8470ee14b52d None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:08.519281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535766ea-5d52-4dbd-bbaa-8470ee14b52d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:08.519592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535766ea-5d52-4dbd-bbaa-8470ee14b52d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:08.520896 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f2c57-ac33-494a-82c8-50cffc9870e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:08.521170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535766ea-5d52-4dbd-bbaa-8470ee14b52d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:08.521542 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f2c57-ac33-494a-82c8-50cffc9870e0 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:08.521849 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f2c57-ac33-494a-82c8-50cffc9870e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:08.522121 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f2c57-ac33-494a-82c8-50cffc9870e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:08.529313 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f2c57-ac33-494a-82c8-50cffc9870e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:08.530820 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f2c57-ac33-494a-82c8-50cffc9870e0 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:08.539901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 255/516] 10.222.0.96 () {56 vars in 1137 bytes} [Wed Aug 24 04:18:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:08.540673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535766ea-5d52-4dbd-bbaa-8470ee14b52d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:08.544097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-9a1f2c57-ac33-494a-82c8-50cffc9870e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:08.544097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:08.544097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:08.544097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:08.544097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:08.544097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:08.544097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:08.544097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:08.544097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:08.544097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:08.544097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:08.544097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:08.544097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:08.544097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:08.544097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:08.544993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:08.544993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:08.544993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:08.544993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:08.544993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:08.544993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:08.544993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:08.544993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:08.544993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:08.544993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:08.544993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:08.544993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:08.544993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:08.544993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:08.544993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:08.544993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:08.544993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:08.545846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:08.545846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:08.545846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:08.545846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:08.545846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:08.545846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:08.545846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:08.545846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:08.545846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 262/517] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:08.546324 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f2c57-ac33-494a-82c8-50cffc9870e0 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:08.572390 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:08.645729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535766ea-5d52-4dbd-bbaa-8470ee14b52d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:08.648972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f2c57-ac33-494a-82c8-50cffc9870e0 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:08.680665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a52dc-c68b-40ad-9a1f-28606a9fc431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:08.681308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a52dc-c68b-40ad-9a1f-28606a9fc431 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:08.681595 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a52dc-c68b-40ad-9a1f-28606a9fc431 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:08.681873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a52dc-c68b-40ad-9a1f-28606a9fc431 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:08.683504 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c8952-9980-47a1-952a-f97513af274d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:08.684105 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c8952-9980-47a1-952a-f97513af274d None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:08.684387 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c8952-9980-47a1-952a-f97513af274d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:08.684659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c8952-9980-47a1-952a-f97513af274d None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:08.685327 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c8952-9980-47a1-952a-f97513af274d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:08.686765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c8952-9980-47a1-952a-f97513af274d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:08.709040 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 263/518] 10.222.0.96 () {60 vars in 1132 bytes} [Wed Aug 24 04:18:08 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:18:08.709860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c8952-9980-47a1-952a-f97513af274d None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:08.725034 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:08.758491 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a52dc-c68b-40ad-9a1f-28606a9fc431 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:08.760020 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a52dc-c68b-40ad-9a1f-28606a9fc431 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:08.791890 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:08.844490 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c8952-9980-47a1-952a-f97513af274d None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:08.892764 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 256/519] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:18:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:08.892764 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a52dc-c68b-40ad-9a1f-28606a9fc431 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:08.903396 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b1bf6-d035-4e92-8dd3-3537e657d139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:08.904655 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b1bf6-d035-4e92-8dd3-3537e657d139 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:08.904992 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b1bf6-d035-4e92-8dd3-3537e657d139 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:08.905269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b1bf6-d035-4e92-8dd3-3537e657d139 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:08.905923 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b1bf6-d035-4e92-8dd3-3537e657d139 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:08.906239 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b1bf6-d035-4e92-8dd3-3537e657d139 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:08.908125 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b1bf6-d035-4e92-8dd3-3537e657d139 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:08.929356 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 264/520] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:08.930741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b1bf6-d035-4e92-8dd3-3537e657d139 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:09.026913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:09.030527 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a52dc-c68b-40ad-9a1f-28606a9fc431 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:09.061058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b1bf6-d035-4e92-8dd3-3537e657d139 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:09.061539 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:09.070397 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9815ae-543a-4516-9c99-28a585598190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:09.071277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9815ae-543a-4516-9c99-28a585598190 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:09.071544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9815ae-543a-4516-9c99-28a585598190 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:09.071812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9815ae-543a-4516-9c99-28a585598190 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:09.099196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73f6b0-b7f7-4dd6-9e62-aef3368e9466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:09.099823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73f6b0-b7f7-4dd6-9e62-aef3368e9466 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:09.100103 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73f6b0-b7f7-4dd6-9e62-aef3368e9466 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:09.100375 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73f6b0-b7f7-4dd6-9e62-aef3368e9466 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:09.101090 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73f6b0-b7f7-4dd6-9e62-aef3368e9466 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:09.101398 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73f6b0-b7f7-4dd6-9e62-aef3368e9466 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:09.102843 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73f6b0-b7f7-4dd6-9e62-aef3368e9466 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:09.121251 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 265/521] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:09.121902 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73f6b0-b7f7-4dd6-9e62-aef3368e9466 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:09.151648 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9815ae-543a-4516-9c99-28a585598190 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:09.153723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9815ae-543a-4516-9c99-28a585598190 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:09.229135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73f6b0-b7f7-4dd6-9e62-aef3368e9466 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:09.262339 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:09.264734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 257/522] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:18:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:09.265729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9815ae-543a-4516-9c99-28a585598190 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:09.270947 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434a577-21da-420f-863b-df031a112139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:09.271591 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434a577-21da-420f-863b-df031a112139 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:09.271873 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434a577-21da-420f-863b-df031a112139 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:09.272147 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434a577-21da-420f-863b-df031a112139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:09.283941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434a577-21da-420f-863b-df031a112139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:09.285382 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434a577-21da-420f-863b-df031a112139 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:09.298482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:09.301822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-e434a577-21da-420f-863b-df031a112139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:09.301822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:09.301822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:09.301822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:09.301822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:09.301822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:09.301822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:09.301822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:09.301822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:09.301822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:09.301822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:09.301822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:09.301822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:09.301822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:09.301822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:09.301822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:09.302714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:09.302714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:09.302714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:09.302714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:09.302714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:09.302714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:09.302714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:09.302714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:09.302714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:09.302714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:09.302714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:09.302714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:09.302714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:09.302714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:09.302714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:09.302714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:09.302714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:09.303557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:09.303557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:09.303557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:09.307651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 266/523] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:09.308432 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434a577-21da-420f-863b-df031a112139 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:09.380574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9815ae-543a-4516-9c99-28a585598190 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:09.411091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434a577-21da-420f-863b-df031a112139 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:09.417154 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7e372-3358-4998-9836-12bc0af64cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:09.417787 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7e372-3358-4998-9836-12bc0af64cac None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:09.418100 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7e372-3358-4998-9836-12bc0af64cac None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:09.418452 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7e372-3358-4998-9836-12bc0af64cac None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:09.426015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7e372-3358-4998-9836-12bc0af64cac None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:09.427514 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7e372-3358-4998-9836-12bc0af64cac None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:09.440004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-3bd7e372-3358-4998-9836-12bc0af64cac None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:18:09.440004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:09.440004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:09.440004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:09.440004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:09.440004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:09.440004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:09.440004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:09.440004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:09.440004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:09.440004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:09.440004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:09.440004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:09.440004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:09.440004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:09.440004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:09.440999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:09.440999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:09.440999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:09.440999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:09.440999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:09.440999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:09.440999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:09.440999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:09.440999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:09.440999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:09.440999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:09.440999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:09.440999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:09.440999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:09.440999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:09.440999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:09.440999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:09.440999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:09.443463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:09.443463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:09.443463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:09.443463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:09.443463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:09.443463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:09.443463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:09.443463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:09.443463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:18:09.443463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:09.443463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 258/524] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:18:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:09.443463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7e372-3358-4998-9836-12bc0af64cac None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:09.451215 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6017b-0f9d-44d3-916b-19818cf93ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:09.451821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6017b-0f9d-44d3-916b-19818cf93ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:09.452104 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6017b-0f9d-44d3-916b-19818cf93ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:09.452415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6017b-0f9d-44d3-916b-19818cf93ed7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:09.453187 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6017b-0f9d-44d3-916b-19818cf93ed7 None admin] RBAC: Adding query filter params (role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=3539784b4e91472eb20addc6707dc30d) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:09.453497 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6017b-0f9d-44d3-916b-19818cf93ed7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:09.454941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6017b-0f9d-44d3-916b-19818cf93ed7 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:09.461189 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 267/525] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:18:09 2022] GET /identity/v3/role_assignments?user.id=3539784b4e91472eb20addc6707dc30d&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:09.461816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6017b-0f9d-44d3-916b-19818cf93ed7 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:09.531851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:09.562305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:09.583636 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7e372-3358-4998-9836-12bc0af64cac None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:09.607920 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6017b-0f9d-44d3-916b-19818cf93ed7 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:09.627651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bed58-0976-404c-bd96-3dceead3e8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:09.628289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bed58-0976-404c-bd96-3dceead3e8c9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:09.628572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bed58-0976-404c-bd96-3dceead3e8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:09.628875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bed58-0976-404c-bd96-3dceead3e8c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:09.640712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bed58-0976-404c-bd96-3dceead3e8c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:09.642148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bed58-0976-404c-bd96-3dceead3e8c9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:09.654649 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9137a-5b8c-4999-80eb-5982365b2c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:09.655524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9137a-5b8c-4999-80eb-5982365b2c1b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:09.655950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9137a-5b8c-4999-80eb-5982365b2c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:09.656419 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9137a-5b8c-4999-80eb-5982365b2c1b None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:09.657239 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9137a-5b8c-4999-80eb-5982365b2c1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:09.657774 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9137a-5b8c-4999-80eb-5982365b2c1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:09.658129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-ec4bed58-0976-404c-bd96-3dceead3e8c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:09.658129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:09.658129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:09.658129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:09.658129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:09.658129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:09.658129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:09.658129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:09.658129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:09.658129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:09.658129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:09.658129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:09.658129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:09.658129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:09.658129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:09.658129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:09.659289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:09.659289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:09.659289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:09.659289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:09.659289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:09.659289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:09.659289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:09.659289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:09.659289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:09.659289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:09.659289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:09.659289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:09.659289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:09.659289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:09.659289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:09.659289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:09.659289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:09.660311 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:09.660311 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:09.660311 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:09.660311 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 259/526] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:09.660311 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bed58-0976-404c-bd96-3dceead3e8c9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:09.662079 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9137a-5b8c-4999-80eb-5982365b2c1b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:09.680347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 268/527] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:09.684813 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9137a-5b8c-4999-80eb-5982365b2c1b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:09.803835 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bed58-0976-404c-bd96-3dceead3e8c9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:09.804037 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9137a-5b8c-4999-80eb-5982365b2c1b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:09.813335 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:09.850577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a39975-a30e-45a2-b2df-2696975bed81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:09.851389 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a39975-a30e-45a2-b2df-2696975bed81 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:09.851685 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ae151-41e7-4abc-aafe-99c53c2e2832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:09.852009 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a39975-a30e-45a2-b2df-2696975bed81 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:09.852292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ae151-41e7-4abc-aafe-99c53c2e2832 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:09.852573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ae151-41e7-4abc-aafe-99c53c2e2832 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:09.852737 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a39975-a30e-45a2-b2df-2696975bed81 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:09.852868 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ae151-41e7-4abc-aafe-99c53c2e2832 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:09.853505 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ae151-41e7-4abc-aafe-99c53c2e2832 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:09.853807 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ae151-41e7-4abc-aafe-99c53c2e2832 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:09.854020 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a39975-a30e-45a2-b2df-2696975bed81 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:09.854522 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a39975-a30e-45a2-b2df-2696975bed81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:09.855225 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ae151-41e7-4abc-aafe-99c53c2e2832 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:09.856277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a39975-a30e-45a2-b2df-2696975bed81 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:09.868163 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:09.871840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 269/528] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:09.876336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ae151-41e7-4abc-aafe-99c53c2e2832 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:09.884667 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 260/529] 10.222.0.96 () {56 vars in 1139 bytes} [Wed Aug 24 04:18:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:09.884667 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a39975-a30e-45a2-b2df-2696975bed81 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:09.997640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a39975-a30e-45a2-b2df-2696975bed81 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:10.022941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ae151-41e7-4abc-aafe-99c53c2e2832 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:10.042234 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1b67c-0846-45ec-b0fe-08993130ba46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:10.043076 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1b67c-0846-45ec-b0fe-08993130ba46 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:10.043520 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1b67c-0846-45ec-b0fe-08993130ba46 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:10.043932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1b67c-0846-45ec-b0fe-08993130ba46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:10.054085 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1b67c-0846-45ec-b0fe-08993130ba46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:10.056337 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1b67c-0846-45ec-b0fe-08993130ba46 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:10.061170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dea1b8-bdf3-492a-96d6-23dd2697049d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:10.061905 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dea1b8-bdf3-492a-96d6-23dd2697049d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:10.062288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dea1b8-bdf3-492a-96d6-23dd2697049d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:10.062666 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dea1b8-bdf3-492a-96d6-23dd2697049d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:10.070359 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dea1b8-bdf3-492a-96d6-23dd2697049d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:10.072031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-c3d1b67c-0846-45ec-b0fe-08993130ba46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:10.072031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:10.072031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:10.072031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:10.072031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:10.072031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:10.072031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:10.072031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:10.072031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:10.072031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:10.072031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:10.072031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:10.072031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:10.072031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:10.072031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:10.073056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:10.073056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:10.073056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:10.073056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:10.073056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:10.073056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:10.073056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:10.073056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:10.073056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:10.073056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:10.073056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:10.073056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:10.073056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:10.073056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:10.073056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:10.073056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:10.073056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:10.074108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:10.074108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:10.074108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:10.074108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:10.074108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:10.074108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:10.074108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:10.074108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:10.074614 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dea1b8-bdf3-492a-96d6-23dd2697049d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:10.080787 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 261/530] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:10.080787 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1b67c-0846-45ec-b0fe-08993130ba46 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:10.091113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-84dea1b8-bdf3-492a-96d6-23dd2697049d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:10.091113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:10.091113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:10.091113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:10.091113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:10.091113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:10.091113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:10.091113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:10.091113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:10.091113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:10.091113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:10.091113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:10.091113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:10.091113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:10.091113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:10.092012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:10.092012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:10.092012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:10.092012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:10.092012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:10.092012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:10.092012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:10.092012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:10.092012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:10.092012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:10.092012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:10.092012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:10.092012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:10.092012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:10.092012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:10.092012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:10.092012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:10.092906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:10.092906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:10.092906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:10.092906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:10.092906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:10.092906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:10.092906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:10.092906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:10.092906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 270/531] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:10.093378 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dea1b8-bdf3-492a-96d6-23dd2697049d None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:10.123071 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:10.150509 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:10.204188 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dea1b8-bdf3-492a-96d6-23dd2697049d None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:10.210275 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1b67c-0846-45ec-b0fe-08993130ba46 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:10.243629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c057e74-f00c-4e42-8829-c5aabe1b31ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:10.244280 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c057e74-f00c-4e42-8829-c5aabe1b31ac None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:10.244565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c057e74-f00c-4e42-8829-c5aabe1b31ac None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:10.244909 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c057e74-f00c-4e42-8829-c5aabe1b31ac None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:10.245680 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c057e74-f00c-4e42-8829-c5aabe1b31ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:10.245996 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c057e74-f00c-4e42-8829-c5aabe1b31ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:10.247440 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c057e74-f00c-4e42-8829-c5aabe1b31ac None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:10.252711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5acfd-bbf4-4647-a0b8-a1ff9b9750f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:10.253554 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5acfd-bbf4-4647-a0b8-a1ff9b9750f8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:10.254031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5acfd-bbf4-4647-a0b8-a1ff9b9750f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:10.254724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5acfd-bbf4-4647-a0b8-a1ff9b9750f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:10.266667 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 271/532] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:10.266667 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c057e74-f00c-4e42-8829-c5aabe1b31ac None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:10.332177 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5acfd-bbf4-4647-a0b8-a1ff9b9750f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:10.334221 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5acfd-bbf4-4647-a0b8-a1ff9b9750f8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:10.356081 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:10.374217 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c057e74-f00c-4e42-8829-c5aabe1b31ac None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:10.395304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:10.412648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b28d48-974c-4f6a-8f01-717886ab6042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:10.413351 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b28d48-974c-4f6a-8f01-717886ab6042 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:10.413641 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b28d48-974c-4f6a-8f01-717886ab6042 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:10.413923 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b28d48-974c-4f6a-8f01-717886ab6042 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:10.414622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b28d48-974c-4f6a-8f01-717886ab6042 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:10.414937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b28d48-974c-4f6a-8f01-717886ab6042 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:10.416703 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b28d48-974c-4f6a-8f01-717886ab6042 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:10.430074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 272/533] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:10.430883 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b28d48-974c-4f6a-8f01-717886ab6042 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:10.448990 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 262/534] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:18:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:10.450206 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5acfd-bbf4-4647-a0b8-a1ff9b9750f8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:10.544097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b28d48-974c-4f6a-8f01-717886ab6042 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:10.555068 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5acfd-bbf4-4647-a0b8-a1ff9b9750f8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:10.583386 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90db69-386c-46cf-9c3f-7bdcf8b290b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:10.584023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90db69-386c-46cf-9c3f-7bdcf8b290b1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:10.584309 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90db69-386c-46cf-9c3f-7bdcf8b290b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:10.584588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90db69-386c-46cf-9c3f-7bdcf8b290b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:10.585497 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90db69-386c-46cf-9c3f-7bdcf8b290b1 None admin] RBAC: Adding query filter params (role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=b182bf0bbbcf4a808626443c6c2a7a6a) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:10.585839 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90db69-386c-46cf-9c3f-7bdcf8b290b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:10.587420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90db69-386c-46cf-9c3f-7bdcf8b290b1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:10.599876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 273/535] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:18:10 2022] GET /identity/v3/role_assignments?user.id=b182bf0bbbcf4a808626443c6c2a7a6a&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:10.599876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90db69-386c-46cf-9c3f-7bdcf8b290b1 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:10.602516 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387397cb-7e70-46cc-aea9-b6596b071c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:10.603370 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387397cb-7e70-46cc-aea9-b6596b071c28 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:10.603889 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387397cb-7e70-46cc-aea9-b6596b071c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:10.604355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387397cb-7e70-46cc-aea9-b6596b071c28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:10.605320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387397cb-7e70-46cc-aea9-b6596b071c28 None admin] RBAC: Adding query filter params (role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=6106a46199b74f649cd29a0d02610049) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:10.605829 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387397cb-7e70-46cc-aea9-b6596b071c28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:10.607453 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387397cb-7e70-46cc-aea9-b6596b071c28 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:10.612666 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:10.623515 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 263/536] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:18:10 2022] GET /identity/v3/role_assignments?user.id=6106a46199b74f649cd29a0d02610049&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:10.732236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90db69-386c-46cf-9c3f-7bdcf8b290b1 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:10.749750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769f1ac-1dc8-4cc4-85e8-dc2270890864 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:10.750058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769f1ac-1dc8-4cc4-85e8-dc2270890864 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:10.750319 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9769f1ac-1dc8-4cc4-85e8-dc2270890864 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:10.751937 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 264/537] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:10.758391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af78a4-b1ee-443e-bed1-3ade17d89778 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:10.758680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af78a4-b1ee-443e-bed1-3ade17d89778 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:10.758958 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af78a4-b1ee-443e-bed1-3ade17d89778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:10.787524 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a8af78a4-b1ee-443e-bed1-3ade17d89778 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:10.788809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a8af78a4-b1ee-443e-bed1-3ade17d89778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:10.789450 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17dcc0a-5de2-49be-ae8f-6b51eff7708e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:10.790106 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dcc0a-5de2-49be-ae8f-6b51eff7708e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:10.790392 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dcc0a-5de2-49be-ae8f-6b51eff7708e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:10.790666 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dcc0a-5de2-49be-ae8f-6b51eff7708e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:10.816659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17dcc0a-5de2-49be-ae8f-6b51eff7708e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:10.818881 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17dcc0a-5de2-49be-ae8f-6b51eff7708e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:10.825443 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:10.844534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-d17dcc0a-5de2-49be-ae8f-6b51eff7708e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:10.844534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:10.844534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:10.844534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:10.844534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:10.844534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:10.844534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:10.844534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:10.844534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:10.844534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:10.844534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:10.844534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:10.844534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:10.844534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:10.844534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:10.844534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:10.845502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:10.845502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:10.845502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:10.845502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:10.845502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:10.845502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:10.845502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:10.845502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:10.845502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:10.845502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:10.845502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:10.845502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:10.845502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:10.845502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:10.845502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:10.845502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:10.845502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:10.847012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:10.847012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:10.847012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:10.847012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 274/538] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:10.852462 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17dcc0a-5de2-49be-ae8f-6b51eff7708e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:10.913553 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 265/539] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:18:10.937119 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:10.987897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17dcc0a-5de2-49be-ae8f-6b51eff7708e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:11.023527 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3401419-ddf0-4235-9bb8-b4341ccb38a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:11.024138 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3401419-ddf0-4235-9bb8-b4341ccb38a9 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:11.024417 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3401419-ddf0-4235-9bb8-b4341ccb38a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:11.024707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3401419-ddf0-4235-9bb8-b4341ccb38a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:11.025411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3401419-ddf0-4235-9bb8-b4341ccb38a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:11.025716 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3401419-ddf0-4235-9bb8-b4341ccb38a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:11.027130 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3401419-ddf0-4235-9bb8-b4341ccb38a9 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:11.040442 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 275/540] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:11.045929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af78a4-b1ee-443e-bed1-3ade17d89778 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:11.154801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af78a4-b1ee-443e-bed1-3ade17d89778 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:11.193466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12141d-2ad1-4fa0-94be-208f40e6f8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:11.194108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12141d-2ad1-4fa0-94be-208f40e6f8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:11.194390 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12141d-2ad1-4fa0-94be-208f40e6f8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:11.194660 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12141d-2ad1-4fa0-94be-208f40e6f8d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:11.202206 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b12141d-2ad1-4fa0-94be-208f40e6f8d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:11.203671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b12141d-2ad1-4fa0-94be-208f40e6f8d1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:11.217129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-1b12141d-2ad1-4fa0-94be-208f40e6f8d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:11.217129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:11.217129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:11.217129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:11.217129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:11.217129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:11.217129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:11.217129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:11.217129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:11.217129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:11.217129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:11.217129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:11.217129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:11.217129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:11.217129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:11.218474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:11.218474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:11.218474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:11.218474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:11.218474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:11.218474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:11.218474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:11.218474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:11.218474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:11.218474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:11.218474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:11.218474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:11.218474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:11.218474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:11.218474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:11.218474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:11.218474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:11.219924 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:11.219924 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:11.219924 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:11.219924 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:11.219924 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:11.219924 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:11.219924 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:11.219924 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:11.219924 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 266/541] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:18:11.225308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3401419-ddf0-4235-9bb8-b4341ccb38a9 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:11.340109 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3401419-ddf0-4235-9bb8-b4341ccb38a9 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:11.365551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:11.387062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34053880-5883-4331-86a9-9ba00b180582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:11.387680 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34053880-5883-4331-86a9-9ba00b180582 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:11.387962 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34053880-5883-4331-86a9-9ba00b180582 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:11.388270 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34053880-5883-4331-86a9-9ba00b180582 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:11.389005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34053880-5883-4331-86a9-9ba00b180582 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:11.389315 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34053880-5883-4331-86a9-9ba00b180582 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:11.390749 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34053880-5883-4331-86a9-9ba00b180582 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:11.396165 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12141d-2ad1-4fa0-94be-208f40e6f8d1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:11.406428 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 276/542] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:11.412950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34053880-5883-4331-86a9-9ba00b180582 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:11.431526 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:11.550740 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34053880-5883-4331-86a9-9ba00b180582 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:11.588767 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4827c4-5bf9-4587-9d17-019dfc49b024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:11.589906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4827c4-5bf9-4587-9d17-019dfc49b024 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:11.590254 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4827c4-5bf9-4587-9d17-019dfc49b024 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:11.590798 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4827c4-5bf9-4587-9d17-019dfc49b024 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:11.591544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4827c4-5bf9-4587-9d17-019dfc49b024 None admin] RBAC: Adding query filter params (role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=50358dbf699a41188dae93496161709d) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:11.591858 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4827c4-5bf9-4587-9d17-019dfc49b024 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:11.593342 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4827c4-5bf9-4587-9d17-019dfc49b024 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:11.600910 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 277/543] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:18:11 2022] GET /identity/v3/role_assignments?user.id=50358dbf699a41188dae93496161709d&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:18:11.627304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12141d-2ad1-4fa0-94be-208f40e6f8d1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:11.668189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574670c-1574-41fd-9d51-43f396190828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:11.668771 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574670c-1574-41fd-9d51-43f396190828 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:11.669055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574670c-1574-41fd-9d51-43f396190828 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:11.669328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574670c-1574-41fd-9d51-43f396190828 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:11.681539 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574670c-1574-41fd-9d51-43f396190828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:11.686331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-a574670c-1574-41fd-9d51-43f396190828 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:11.686331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:11.686331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:11.686331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:11.686331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:11.686331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:11.686331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:11.686331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:11.686331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:11.686331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:11.686331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:11.686331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:11.686331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:11.686331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:11.686331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:11.686331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:11.687190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:11.687190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:11.687190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:11.687190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:11.687190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:11.687190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:11.687190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:11.687190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:11.687190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:11.687190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:11.687190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:11.687190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:11.687190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:11.687190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:11.687190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:11.687190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:11.687963 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:11.687963 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:11.687963 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:11.687963 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:11.687963 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:11.687963 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:11.687963 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:11.687963 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:11.687963 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:11.687963 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:11.687963 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:11.687963 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:11.687963 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 267/544] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:18:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:18:11.697910 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4827c4-5bf9-4587-9d17-019dfc49b024 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:11.703055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b202b8-7ff1-4b89-a503-f5a65db77f96 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:11.703620 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b202b8-7ff1-4b89-a503-f5a65db77f96 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:11.704163 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b202b8-7ff1-4b89-a503-f5a65db77f96 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:11.706035 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 268/545] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:18:11.711767 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ca800-f748-47b3-8e43-fa74f4d08c5b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:11.712396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ca800-f748-47b3-8e43-fa74f4d08c5b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:11.713169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ca800-f748-47b3-8e43-fa74f4d08c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:11.735581 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e93ca800-f748-47b3-8e43-fa74f4d08c5b None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:11.738269 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e93ca800-f748-47b3-8e43-fa74f4d08c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:11.780924 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:11.855063 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 269/546] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:18:11.904503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4827c4-5bf9-4587-9d17-019dfc49b024 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:11.945817 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d12e9-2225-4f51-86e7-0e12dd5fb703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:11.947033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d12e9-2225-4f51-86e7-0e12dd5fb703 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:11.947526 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d12e9-2225-4f51-86e7-0e12dd5fb703 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:11.947995 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d12e9-2225-4f51-86e7-0e12dd5fb703 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:11.948888 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d12e9-2225-4f51-86e7-0e12dd5fb703 None admin] RBAC: Adding query filter params (name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:11.949394 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d12e9-2225-4f51-86e7-0e12dd5fb703 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:11.951002 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d12e9-2225-4f51-86e7-0e12dd5fb703 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:11.960544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 278/547] 10.222.0.96 () {56 vars in 1103 bytes} [Wed Aug 24 04:18:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:11.965836 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ca800-f748-47b3-8e43-fa74f4d08c5b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:11.968661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:12.130827 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ca800-f748-47b3-8e43-fa74f4d08c5b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:12.175777 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ab821-9c08-4352-b3d9-4a2df94dd634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:12.177340 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ab821-9c08-4352-b3d9-4a2df94dd634 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:12.177828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ab821-9c08-4352-b3d9-4a2df94dd634 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:12.178317 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ab821-9c08-4352-b3d9-4a2df94dd634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:12.193719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ab821-9c08-4352-b3d9-4a2df94dd634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:12.195477 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ab821-9c08-4352-b3d9-4a2df94dd634 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:12.215064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-456ab821-9c08-4352-b3d9-4a2df94dd634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:12.215064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:12.215064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:12.215064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:12.215064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:12.215064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:12.215064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:12.215064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:12.215064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:12.215064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:12.215064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:12.215064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:12.215064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:12.215064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:12.215064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:12.215064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:12.215957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:12.215957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:12.215957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:12.215957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:12.215957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:12.215957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:12.215957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:12.215957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:12.215957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:12.215957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:12.215957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:12.215957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:12.215957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:12.215957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:12.215957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:12.215957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:12.215957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:12.216858 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:12.216858 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:12.216858 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:12.218589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 270/548] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:12.224940 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d12e9-2225-4f51-86e7-0e12dd5fb703 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:12.262095 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ab821-9c08-4352-b3d9-4a2df94dd634 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:12.373604 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:12.416615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d12e9-2225-4f51-86e7-0e12dd5fb703 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:12.434110 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:12.463030 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ab821-9c08-4352-b3d9-4a2df94dd634 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:12.490232 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e83a1-a89e-4a83-84f6-99a53f6ffe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:12.490767 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e83a1-a89e-4a83-84f6-99a53f6ffe44 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:12.491045 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e83a1-a89e-4a83-84f6-99a53f6ffe44 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:12.491315 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e83a1-a89e-4a83-84f6-99a53f6ffe44 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:12.491971 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e83a1-a89e-4a83-84f6-99a53f6ffe44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:12.492275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e83a1-a89e-4a83-84f6-99a53f6ffe44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:12.493750 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e83a1-a89e-4a83-84f6-99a53f6ffe44 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:12.516031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 279/549] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:12.519681 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e83a1-a89e-4a83-84f6-99a53f6ffe44 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:12.526233 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b42c0b-82f8-4f10-bf4f-97e93cc8c791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:12.529958 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b42c0b-82f8-4f10-bf4f-97e93cc8c791 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:12.529958 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b42c0b-82f8-4f10-bf4f-97e93cc8c791 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:12.529958 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b42c0b-82f8-4f10-bf4f-97e93cc8c791 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:12.553907 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b42c0b-82f8-4f10-bf4f-97e93cc8c791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:12.560263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-95b42c0b-82f8-4f10-bf4f-97e93cc8c791 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:12.560263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:12.560263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:12.560263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:12.560263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:12.560263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:12.560263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:12.560263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:12.560263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:12.560263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:12.560263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:12.560263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:12.560263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:12.560263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:12.560263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:12.560263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:12.561975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:12.561975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:12.561975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:12.561975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:12.561975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:12.561975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:12.561975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:12.561975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:12.561975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:12.561975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:12.561975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:12.561975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:12.561975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:12.561975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:12.561975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:12.561975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:12.563204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:12.563204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:12.563204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:12.563204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:12.563204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:12.563204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:12.563204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:12.563204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:12.563204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:12.563204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:12.563204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:12.563204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:12.563204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 271/550] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:18:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:12.567582 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b42c0b-82f8-4f10-bf4f-97e93cc8c791 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:12.730711 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e83a1-a89e-4a83-84f6-99a53f6ffe44 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:12.753932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b42c0b-82f8-4f10-bf4f-97e93cc8c791 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:12.790346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab92df-ed17-40f8-b132-ae1eadf9fe43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:12.790983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab92df-ed17-40f8-b132-ae1eadf9fe43 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:12.791265 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab92df-ed17-40f8-b132-ae1eadf9fe43 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:12.791534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab92df-ed17-40f8-b132-ae1eadf9fe43 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:12.793025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:12.799228 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab92df-ed17-40f8-b132-ae1eadf9fe43 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:12.800707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab92df-ed17-40f8-b132-ae1eadf9fe43 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:12.813203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-feab92df-ed17-40f8-b132-ae1eadf9fe43 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:18:12.813203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:12.813203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:12.813203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:12.813203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:12.813203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:12.813203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:12.813203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:12.813203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:12.813203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:12.813203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:12.813203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:12.813203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:12.813203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:12.813203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:12.813203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:12.814155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:12.814155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:12.814155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:12.814155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:12.814155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:12.814155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:12.814155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:12.814155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:12.814155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:12.814155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:12.814155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:12.814155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:12.814155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:12.814155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:12.814155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:12.814155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:12.814155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:12.814155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:12.815648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:12.815648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:12.815648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:12.815648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:12.815648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:12.815648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:12.815648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:12.815648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:12.815648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:18:12.815648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:12.815648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 280/551] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:18:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:12.820214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab92df-ed17-40f8-b132-ae1eadf9fe43 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:12.821593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b46f9-e704-4633-9db3-06da3b6ad24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:12.822382 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b46f9-e704-4633-9db3-06da3b6ad24c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:12.822807 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b46f9-e704-4633-9db3-06da3b6ad24c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:12.823224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b46f9-e704-4633-9db3-06da3b6ad24c None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:12.824054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b46f9-e704-4633-9db3-06da3b6ad24c None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:12.824504 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b46f9-e704-4633-9db3-06da3b6ad24c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:12.839768 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b46f9-e704-4633-9db3-06da3b6ad24c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:12.858411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:12.860068 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 272/552] 10.222.0.96 () {56 vars in 1103 bytes} [Wed Aug 24 04:18:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:18:12.867624 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b46f9-e704-4633-9db3-06da3b6ad24c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:12.955754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab92df-ed17-40f8-b132-ae1eadf9fe43 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:13.006148 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a826828-11ae-4e39-b6e3-cfac2d95e976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:13.006676 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a826828-11ae-4e39-b6e3-cfac2d95e976 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:13.006956 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a826828-11ae-4e39-b6e3-cfac2d95e976 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:13.007229 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a826828-11ae-4e39-b6e3-cfac2d95e976 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:13.007967 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a826828-11ae-4e39-b6e3-cfac2d95e976 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:13.008275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a826828-11ae-4e39-b6e3-cfac2d95e976 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:13.009899 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a826828-11ae-4e39-b6e3-cfac2d95e976 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:13.019407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b46f9-e704-4633-9db3-06da3b6ad24c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:13.051350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 281/553] 10.222.0.96 () {56 vars in 1135 bytes} [Wed Aug 24 04:18:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:13.056222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e77e90-fec8-4231-958f-890913dee5f9 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:13.056222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e77e90-fec8-4231-958f-890913dee5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:13.056222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e77e90-fec8-4231-958f-890913dee5f9 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:13.056222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 282/554] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:13.056222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a0e4e-98c2-4b23-a12f-eea23bb744e5 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:13.056222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a0e4e-98c2-4b23-a12f-eea23bb744e5 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:13.056621 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a0e4e-98c2-4b23-a12f-eea23bb744e5 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:13.057723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 283/555] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:13.058567 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a0e4e-98c2-4b23-a12f-eea23bb744e5 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:13.069936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39f9ce-ada7-4465-908f-ef6bec75a5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:13.070887 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39f9ce-ada7-4465-908f-ef6bec75a5df None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:13.071430 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39f9ce-ada7-4465-908f-ef6bec75a5df None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:13.071706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39f9ce-ada7-4465-908f-ef6bec75a5df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:13.083350 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39f9ce-ada7-4465-908f-ef6bec75a5df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:13.084820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39f9ce-ada7-4465-908f-ef6bec75a5df None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:13.099555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-4f39f9ce-ada7-4465-908f-ef6bec75a5df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:13.099555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:13.099555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:13.099555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:13.099555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:13.099555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:13.099555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:13.099555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:13.099555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:13.099555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:13.099555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:13.099555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:13.099555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:13.099555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:13.099555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:13.099555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:13.100500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:13.100500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:13.100500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:13.100500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:13.100500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:13.100500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:13.100500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:13.100500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:13.100500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:13.100500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:13.100500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:13.100500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:13.100500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:13.100500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:13.100500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:13.100500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:13.100500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:13.101412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:13.101412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:13.101412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:13.105442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 273/556] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:18:13.106462 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4c5df-2726-4f6b-a604-f1f216bd2b6f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:13.106752 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4c5df-2726-4f6b-a604-f1f216bd2b6f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:13.107031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4c5df-2726-4f6b-a604-f1f216bd2b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:13.125966 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3ff4c5df-2726-4f6b-a604-f1f216bd2b6f None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:13.127170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3ff4c5df-2726-4f6b-a604-f1f216bd2b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:13.153005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:13.153837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:13.171221 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a0e4e-98c2-4b23-a12f-eea23bb744e5 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:13.204915 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 274/557] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:13.204915 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617139a-225e-49a7-a2da-4750b4744f35 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:13.204915 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617139a-225e-49a7-a2da-4750b4744f35 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:13.204915 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617139a-225e-49a7-a2da-4750b4744f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:13.218334 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aad250-444b-436c-b7a8-bfd525e45774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:13.219700 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aad250-444b-436c-b7a8-bfd525e45774 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:13.220438 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aad250-444b-436c-b7a8-bfd525e45774 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:13.221173 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aad250-444b-436c-b7a8-bfd525e45774 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:13.237165 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4617139a-225e-49a7-a2da-4750b4744f35 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:13.239437 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4617139a-225e-49a7-a2da-4750b4744f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:13.336612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aad250-444b-436c-b7a8-bfd525e45774 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:13.338444 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aad250-444b-436c-b7a8-bfd525e45774 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:13.352822 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 275/558] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:13.353980 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617139a-225e-49a7-a2da-4750b4744f35 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:13.498053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:13.508723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:13.517398 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 284/559] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:18:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:13.518500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aad250-444b-436c-b7a8-bfd525e45774 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:13.525378 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617139a-225e-49a7-a2da-4750b4744f35 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:13.563348 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54883c-e238-4ad7-a2af-0eabbc1f2615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:13.563967 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54883c-e238-4ad7-a2af-0eabbc1f2615 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:13.564251 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54883c-e238-4ad7-a2af-0eabbc1f2615 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:13.564528 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54883c-e238-4ad7-a2af-0eabbc1f2615 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:13.565273 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54883c-e238-4ad7-a2af-0eabbc1f2615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:13.565584 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54883c-e238-4ad7-a2af-0eabbc1f2615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:13.567786 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54883c-e238-4ad7-a2af-0eabbc1f2615 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:13.584724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 276/560] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:13.584724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54883c-e238-4ad7-a2af-0eabbc1f2615 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:13.646536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aad250-444b-436c-b7a8-bfd525e45774 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:13.689092 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474e9fe-3eee-4583-aa66-02342a5542e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:13.690104 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474e9fe-3eee-4583-aa66-02342a5542e6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:13.690459 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474e9fe-3eee-4583-aa66-02342a5542e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:13.690808 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474e9fe-3eee-4583-aa66-02342a5542e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:13.704447 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474e9fe-3eee-4583-aa66-02342a5542e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:13.709443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-b474e9fe-3eee-4583-aa66-02342a5542e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:13.709443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:13.709443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:13.709443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:13.709443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:13.709443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:13.709443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:13.709443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:13.709443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:13.709443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:13.709443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:13.709443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:13.709443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:13.709443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:13.709443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:13.709443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:13.710372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:13.710372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:13.710372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:13.710372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:13.710372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:13.710372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:13.710372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:13.710372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:13.710372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:13.710372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:13.710372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:13.710372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:13.710372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:13.710372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:13.710372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:13.710372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:13.711209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:13.711209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:13.711209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:13.711209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:13.711209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:13.711209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:13.711209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:13.711209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:13.711209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:13.711209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:13.711209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:13.711209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:13.711209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 285/561] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:18:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:13.711903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474e9fe-3eee-4583-aa66-02342a5542e6 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:13.717524 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54883c-e238-4ad7-a2af-0eabbc1f2615 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:13.754866 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20d8e7-79b2-4a21-bf3b-6aa8f07885c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:13.755457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20d8e7-79b2-4a21-bf3b-6aa8f07885c3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:13.755736 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20d8e7-79b2-4a21-bf3b-6aa8f07885c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:13.756007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20d8e7-79b2-4a21-bf3b-6aa8f07885c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:13.764161 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:13.768486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20d8e7-79b2-4a21-bf3b-6aa8f07885c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:13.770210 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20d8e7-79b2-4a21-bf3b-6aa8f07885c3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:13.779139 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:13.786712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-6b20d8e7-79b2-4a21-bf3b-6aa8f07885c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:13.786712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:13.786712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:13.786712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:13.786712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:13.786712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:13.786712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:13.786712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:13.786712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:13.786712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:13.786712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:13.786712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:13.786712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:13.786712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:13.786712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:13.786712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:13.787673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:13.787673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:13.787673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:13.787673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:13.787673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:13.787673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:13.787673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:13.787673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:13.787673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:13.787673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:13.787673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:13.787673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:13.787673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:13.787673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:13.787673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:13.787673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:13.787673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:13.788571 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:13.788571 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:13.788571 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:13.790122 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 277/562] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:13.791178 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20d8e7-79b2-4a21-bf3b-6aa8f07885c3 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:13.821761 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474e9fe-3eee-4583-aa66-02342a5542e6 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:13.860842 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dc073-c469-4d77-9b96-b22f176a7166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:13.861476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dc073-c469-4d77-9b96-b22f176a7166 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:13.861756 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dc073-c469-4d77-9b96-b22f176a7166 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:13.862028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842dc073-c469-4d77-9b96-b22f176a7166 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:13.870499 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842dc073-c469-4d77-9b96-b22f176a7166 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:13.871934 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842dc073-c469-4d77-9b96-b22f176a7166 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:13.883987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-842dc073-c469-4d77-9b96-b22f176a7166 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:18:13.883987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:13.883987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:13.883987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:13.883987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:13.883987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:13.883987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:13.883987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:13.883987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:13.883987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:13.883987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:13.883987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:13.883987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:13.883987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:13.883987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:13.883987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:13.884978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:13.884978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:13.884978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:13.884978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:13.884978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:13.884978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:13.884978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:13.884978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:13.884978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:13.884978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:13.884978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:13.884978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:13.884978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:13.884978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:13.884978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:13.884978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:13.884978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:13.884978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:13.886005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:13.886005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:13.886005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:13.886005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:13.886005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:13.886005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:13.886005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:13.886005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:13.886005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:18:13.886005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:13.886005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 286/563] 10.222.0.96 () {56 vars in 1093 bytes} [Wed Aug 24 04:18:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:13.886005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dc073-c469-4d77-9b96-b22f176a7166 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:13.909354 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20d8e7-79b2-4a21-bf3b-6aa8f07885c3 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:13.943250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad69469-ad6f-40ad-8c7e-3b7a6c23c32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:13.943880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad69469-ad6f-40ad-8c7e-3b7a6c23c32b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:13.944158 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad69469-ad6f-40ad-8c7e-3b7a6c23c32b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:13.944429 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad69469-ad6f-40ad-8c7e-3b7a6c23c32b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:13.955227 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad69469-ad6f-40ad-8c7e-3b7a6c23c32b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:13.960592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-fad69469-ad6f-40ad-8c7e-3b7a6c23c32b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:13.960592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:13.960592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:13.960592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:13.960592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:13.960592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:13.960592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:13.960592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:13.960592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:13.960592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:13.960592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:13.960592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:13.960592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:13.960592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:13.960592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:13.960592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:13.961629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:13.961629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:13.961629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:13.961629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:13.961629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:13.961629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:13.961629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:13.961629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:13.961629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:13.961629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:13.961629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:13.961629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:13.961629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:13.961629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:13.961629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:13.961629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:13.962442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:13.962442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:13.962442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:13.962442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:13.962442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:13.962442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:13.962442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:13.962442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:13.962442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:13.962442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:13.962442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:13.962442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:13.962442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 278/564] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:18:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:13.963135 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad69469-ad6f-40ad-8c7e-3b7a6c23c32b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:13.991274 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842dc073-c469-4d77-9b96-b22f176a7166 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:13.998183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:14.022024 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:14.026755 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c87b4-6da8-4007-9e55-20840864f741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:14.027361 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c87b4-6da8-4007-9e55-20840864f741 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:14.027645 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c87b4-6da8-4007-9e55-20840864f741 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:14.027921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c87b4-6da8-4007-9e55-20840864f741 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:14.028590 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c87b4-6da8-4007-9e55-20840864f741 None admin] RBAC: Adding query filter params (name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:14.028934 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c87b4-6da8-4007-9e55-20840864f741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:14.030315 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c87b4-6da8-4007-9e55-20840864f741 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:14.039747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 287/565] 10.222.0.96 () {56 vars in 1103 bytes} [Wed Aug 24 04:18:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:14.040942 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b76b2-6ed7-4b2d-a748-a6ab26c5b718 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:14.041231 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b76b2-6ed7-4b2d-a748-a6ab26c5b718 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:14.041510 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b76b2-6ed7-4b2d-a748-a6ab26c5b718 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:14.042887 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 288/566] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:14.043392 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b76b2-6ed7-4b2d-a748-a6ab26c5b718 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:14.068582 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad69469-ad6f-40ad-8c7e-3b7a6c23c32b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:14.103502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683abd61-2e1b-4296-975a-50c705ee383d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:14.104107 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683abd61-2e1b-4296-975a-50c705ee383d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:14.104395 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683abd61-2e1b-4296-975a-50c705ee383d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:14.104676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683abd61-2e1b-4296-975a-50c705ee383d None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:14.105345 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683abd61-2e1b-4296-975a-50c705ee383d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:14.105662 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683abd61-2e1b-4296-975a-50c705ee383d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:14.107035 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683abd61-2e1b-4296-975a-50c705ee383d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:14.119318 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 279/567] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:14.120292 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683abd61-2e1b-4296-975a-50c705ee383d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:14.150547 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b76b2-6ed7-4b2d-a748-a6ab26c5b718 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:14.184811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bd8ac-4a3d-424f-abe9-3cd318a7d83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:14.185356 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bd8ac-4a3d-424f-abe9-3cd318a7d83f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:14.185644 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bd8ac-4a3d-424f-abe9-3cd318a7d83f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:14.185920 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bd8ac-4a3d-424f-abe9-3cd318a7d83f None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:14.186660 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0bd8ac-4a3d-424f-abe9-3cd318a7d83f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:14.186971 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0bd8ac-4a3d-424f-abe9-3cd318a7d83f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:14.188402 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0bd8ac-4a3d-424f-abe9-3cd318a7d83f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:14.205723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 289/568] 10.222.0.96 () {56 vars in 1133 bytes} [Wed Aug 24 04:18:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:14.206529 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bd8ac-4a3d-424f-abe9-3cd318a7d83f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:14.224246 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683abd61-2e1b-4296-975a-50c705ee383d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:14.235897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:14.245524 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:14.259949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5fc87-4591-4a92-898f-de4269a05f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:14.260557 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5fc87-4591-4a92-898f-de4269a05f93 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:14.260874 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5fc87-4591-4a92-898f-de4269a05f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:14.261152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5fc87-4591-4a92-898f-de4269a05f93 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:14.261816 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5fc87-4591-4a92-898f-de4269a05f93 None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:14.262123 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5fc87-4591-4a92-898f-de4269a05f93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:14.263495 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5fc87-4591-4a92-898f-de4269a05f93 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:14.271976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 280/569] 10.222.0.96 () {56 vars in 1103 bytes} [Wed Aug 24 04:18:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:14.273261 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832b9b4-d33e-430c-9b4d-64256eb11697 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:14.273551 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832b9b4-d33e-430c-9b4d-64256eb11697 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:14.273840 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832b9b4-d33e-430c-9b4d-64256eb11697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:14.293051 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5832b9b4-d33e-430c-9b4d-64256eb11697 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:14.294359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5832b9b4-d33e-430c-9b4d-64256eb11697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:14.315584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bd8ac-4a3d-424f-abe9-3cd318a7d83f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:14.350966 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b39b6-0e33-4ec8-ad3c-5d5d33608418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:14.351598 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b39b6-0e33-4ec8-ad3c-5d5d33608418 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:14.351880 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b39b6-0e33-4ec8-ad3c-5d5d33608418 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:14.352160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b39b6-0e33-4ec8-ad3c-5d5d33608418 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:14.361127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 281/570] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:14.361966 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832b9b4-d33e-430c-9b4d-64256eb11697 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:14.362243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b39b6-0e33-4ec8-ad3c-5d5d33608418 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:14.363749 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b39b6-0e33-4ec8-ad3c-5d5d33608418 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:14.382461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-ea7b39b6-0e33-4ec8-ad3c-5d5d33608418 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:14.382461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:14.382461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:14.382461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:14.382461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:14.382461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:14.382461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:14.382461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:14.382461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:14.382461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:14.382461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:14.382461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:14.382461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:14.382461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:14.382461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:14.382461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:14.383600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:14.383600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:14.383600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:14.383600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:14.383600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:14.383600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:14.383600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:14.383600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:14.383600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:14.383600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:14.383600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:14.383600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:14.383600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:14.383600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:14.383600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:14.383600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:14.383600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:14.384712 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:14.384712 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:14.384712 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:14.386124 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 290/571] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:14.387105 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b39b6-0e33-4ec8-ad3c-5d5d33608418 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:14.475749 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:14.483259 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832b9b4-d33e-430c-9b4d-64256eb11697 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:14.499244 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:14.499709 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b39b6-0e33-4ec8-ad3c-5d5d33608418 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:14.523761 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b75562-bbdb-4430-9f8e-cca66b61ccd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:14.524497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b75562-bbdb-4430-9f8e-cca66b61ccd0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:14.524815 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b75562-bbdb-4430-9f8e-cca66b61ccd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:14.525084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b75562-bbdb-4430-9f8e-cca66b61ccd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:14.531883 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b75562-bbdb-4430-9f8e-cca66b61ccd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:14.533396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b75562-bbdb-4430-9f8e-cca66b61ccd0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:14.537638 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6e065-20a2-41b9-98d9-a45c99f9dc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:14.538274 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6e065-20a2-41b9-98d9-a45c99f9dc79 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:14.538562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6e065-20a2-41b9-98d9-a45c99f9dc79 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:14.538845 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6e065-20a2-41b9-98d9-a45c99f9dc79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:14.545757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-10b75562-bbdb-4430-9f8e-cca66b61ccd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:14.545757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:14.545757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:14.545757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:14.545757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:14.545757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:14.545757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:14.545757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:14.545757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:14.545757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:14.545757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:14.545757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:14.545757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:14.545757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:14.545757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:14.546671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:14.546671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:14.546671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:14.546671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:14.546671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:14.546671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:14.546671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:14.546671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:14.546671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:14.546671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:14.546671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:14.546671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:14.546671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:14.546671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:14.546671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:14.546671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:14.546671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:14.547558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:14.547558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:14.547558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:14.547558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:14.547558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:14.547558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:14.547558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:14.547558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:14.549055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 282/572] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:14.549976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b75562-bbdb-4430-9f8e-cca66b61ccd0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:14.553010 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6e065-20a2-41b9-98d9-a45c99f9dc79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:14.554475 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6e065-20a2-41b9-98d9-a45c99f9dc79 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:14.569349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-6fd6e065-20a2-41b9-98d9-a45c99f9dc79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:14.569349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:14.569349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:14.569349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:14.569349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:14.569349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:14.569349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:14.569349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:14.569349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:14.569349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:14.569349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:14.569349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:14.569349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:14.569349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:14.569349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:14.569349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:14.570338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:14.570338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:14.570338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:14.570338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:14.570338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:14.570338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:14.570338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:14.570338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:14.570338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:14.570338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:14.570338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:14.570338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:14.570338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:14.570338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:14.570338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:14.570338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:14.570338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:14.571481 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:14.571481 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:14.571481 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:14.571481 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 291/573] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:14.571481 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6e065-20a2-41b9-98d9-a45c99f9dc79 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:14.661688 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b75562-bbdb-4430-9f8e-cca66b61ccd0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:14.683538 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6e065-20a2-41b9-98d9-a45c99f9dc79 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:14.700505 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef0fb0-4cd3-4619-8c81-a1b044d81092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:14.701170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef0fb0-4cd3-4619-8c81-a1b044d81092 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:14.701452 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef0fb0-4cd3-4619-8c81-a1b044d81092 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:14.701727 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef0fb0-4cd3-4619-8c81-a1b044d81092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:14.712922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef0fb0-4cd3-4619-8c81-a1b044d81092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:14.714363 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef0fb0-4cd3-4619-8c81-a1b044d81092 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:14.717881 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:14.724704 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37c199-2737-435d-86df-2b62b2b69d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:14.725333 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37c199-2737-435d-86df-2b62b2b69d25 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:14.725613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37c199-2737-435d-86df-2b62b2b69d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:14.725930 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37c199-2737-435d-86df-2b62b2b69d25 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:14.726527 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37c199-2737-435d-86df-2b62b2b69d25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:14.726834 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37c199-2737-435d-86df-2b62b2b69d25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:14.728203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37c199-2737-435d-86df-2b62b2b69d25 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:14.728723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-dcef0fb0-4cd3-4619-8c81-a1b044d81092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:14.728723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:14.728723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:14.728723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:14.728723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:14.728723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:14.728723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:14.728723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:14.728723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:14.728723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:14.728723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:14.728723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:14.728723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:14.728723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:14.728723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:14.728723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:14.729606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:14.729606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:14.729606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:14.729606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:14.729606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:14.729606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:14.729606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:14.729606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:14.729606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:14.729606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:14.729606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:14.729606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:14.729606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:14.729606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:14.729606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:14.729606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:14.729606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:14.730463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:14.730463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:14.730463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:14.730463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 283/574] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:14.730693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef0fb0-4cd3-4619-8c81-a1b044d81092 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:14.746503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 292/575] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:14.746503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37c199-2737-435d-86df-2b62b2b69d25 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:14.760555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:14.836449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef0fb0-4cd3-4619-8c81-a1b044d81092 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:14.845911 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37c199-2737-435d-86df-2b62b2b69d25 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:14.870102 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9e26d-9cbf-4fba-b6fe-62d13d367e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:14.870732 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9e26d-9cbf-4fba-b6fe-62d13d367e80 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:14.871013 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9e26d-9cbf-4fba-b6fe-62d13d367e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:14.871284 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9e26d-9cbf-4fba-b6fe-62d13d367e80 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:14.871974 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9e26d-9cbf-4fba-b6fe-62d13d367e80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:14.872281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9e26d-9cbf-4fba-b6fe-62d13d367e80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:14.873768 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9e26d-9cbf-4fba-b6fe-62d13d367e80 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:14.881468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8161c23-fec5-4b3b-b2b5-96cb7ae65dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:14.882087 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8161c23-fec5-4b3b-b2b5-96cb7ae65dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:14.882425 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8161c23-fec5-4b3b-b2b5-96cb7ae65dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:14.882710 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8161c23-fec5-4b3b-b2b5-96cb7ae65dd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:14.883357 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8161c23-fec5-4b3b-b2b5-96cb7ae65dd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:14.884249 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8161c23-fec5-4b3b-b2b5-96cb7ae65dd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:14.885589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8161c23-fec5-4b3b-b2b5-96cb7ae65dd8 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:14.891710 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 284/576] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:14.892534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9e26d-9cbf-4fba-b6fe-62d13d367e80 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:14.904727 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 293/577] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:14.904727 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8161c23-fec5-4b3b-b2b5-96cb7ae65dd8 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:14.966264 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:14.997079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:15.015124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9e26d-9cbf-4fba-b6fe-62d13d367e80 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:15.018968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8161c23-fec5-4b3b-b2b5-96cb7ae65dd8 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:15.048454 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061742e-91cd-4a0c-ab64-bbff4012ae3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:15.049119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061742e-91cd-4a0c-ab64-bbff4012ae3b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:15.049403 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061742e-91cd-4a0c-ab64-bbff4012ae3b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:15.049679 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061742e-91cd-4a0c-ab64-bbff4012ae3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:15.053565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdb664-9e67-4c34-935e-9f2e8ddc67d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:15.054171 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdb664-9e67-4c34-935e-9f2e8ddc67d0 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:15.054457 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdb664-9e67-4c34-935e-9f2e8ddc67d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:15.054745 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdb664-9e67-4c34-935e-9f2e8ddc67d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:15.055389 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdb664-9e67-4c34-935e-9f2e8ddc67d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:15.055698 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdb664-9e67-4c34-935e-9f2e8ddc67d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:15.057124 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdb664-9e67-4c34-935e-9f2e8ddc67d0 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:15.061097 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061742e-91cd-4a0c-ab64-bbff4012ae3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:15.067627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-d061742e-91cd-4a0c-ab64-bbff4012ae3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:15.067627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:15.067627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:15.067627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:15.067627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:15.067627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:15.067627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:15.067627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:15.067627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:15.067627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:15.067627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:15.067627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:15.067627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:15.067627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:15.067627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:15.067627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:15.068758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:15.068758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:15.068758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:15.068758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:15.068758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:15.068758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:15.068758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:15.068758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:15.068758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:15.068758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:15.068758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:15.068758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:15.068758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:15.068758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:15.068758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:15.068758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:15.069688 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:15.069688 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:15.069688 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:15.069688 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:15.069688 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:15.069688 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:15.069688 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:15.069688 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:15.069688 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:15.069688 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:15.069688 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:15.069688 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:15.069688 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 285/578] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:18:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:15.069688 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061742e-91cd-4a0c-ab64-bbff4012ae3b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:15.071431 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 294/579] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:15.072398 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdb664-9e67-4c34-935e-9f2e8ddc67d0 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:15.174367 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061742e-91cd-4a0c-ab64-bbff4012ae3b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:15.178456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdb664-9e67-4c34-935e-9f2e8ddc67d0 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:15.189039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:15.208665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07915fd9-0f9e-4767-974f-74b7f42da0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:15.209315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07915fd9-0f9e-4767-974f-74b7f42da0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:15.209593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07915fd9-0f9e-4767-974f-74b7f42da0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:15.209865 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07915fd9-0f9e-4767-974f-74b7f42da0c0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:15.215226 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9ddaa-3d1d-483b-b22e-13ccd864c280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:15.215832 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9ddaa-3d1d-483b-b22e-13ccd864c280 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:15.216116 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9ddaa-3d1d-483b-b22e-13ccd864c280 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:15.216395 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9ddaa-3d1d-483b-b22e-13ccd864c280 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:15.217157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9ddaa-3d1d-483b-b22e-13ccd864c280 None admin] RBAC: Adding query filter params (role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=953d2dbd5e7d435f9148fd043b4ce7a7) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:15.217308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07915fd9-0f9e-4767-974f-74b7f42da0c0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:15.217468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9ddaa-3d1d-483b-b22e-13ccd864c280 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:15.218768 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07915fd9-0f9e-4767-974f-74b7f42da0c0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:15.218888 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9ddaa-3d1d-483b-b22e-13ccd864c280 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:15.224511 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 295/580] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:18:15 2022] GET /identity/v3/role_assignments?user.id=953d2dbd5e7d435f9148fd043b4ce7a7&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:15.225358 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9ddaa-3d1d-483b-b22e-13ccd864c280 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:15.230674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-07915fd9-0f9e-4767-974f-74b7f42da0c0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:18:15.230674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:15.230674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:15.230674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:15.230674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:15.230674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:15.230674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:15.230674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:15.230674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:15.230674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:15.230674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:15.230674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:15.230674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:15.230674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:15.230674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:15.230674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:15.231856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:15.231856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:15.231856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:15.231856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:15.231856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:15.231856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:15.231856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:15.231856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:15.231856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:15.231856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:15.231856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:15.231856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:15.231856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:15.231856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:15.231856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:15.231856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:15.231856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:15.231856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:15.233152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:15.233152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:15.233152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:15.233152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:15.233152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:15.233152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:15.233152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:15.233152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:15.233152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:18:15.233152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:15.233152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 286/581] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:18:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:15.233152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07915fd9-0f9e-4767-974f-74b7f42da0c0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:15.239864 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:15.357244 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9ddaa-3d1d-483b-b22e-13ccd864c280 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:15.363264 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07915fd9-0f9e-4767-974f-74b7f42da0c0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:15.395616 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b26ea8-c2be-41aa-8608-8b5fc3436ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:15.396253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b26ea8-c2be-41aa-8608-8b5fc3436ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:15.396537 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b26ea8-c2be-41aa-8608-8b5fc3436ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:15.396862 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b26ea8-c2be-41aa-8608-8b5fc3436ce6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:15.403290 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b14b8-3b37-4add-ba45-ddebe232fa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:15.404347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b14b8-3b37-4add-ba45-ddebe232fa4e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:15.404465 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b26ea8-c2be-41aa-8608-8b5fc3436ce6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:15.404900 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b14b8-3b37-4add-ba45-ddebe232fa4e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:15.405338 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b14b8-3b37-4add-ba45-ddebe232fa4e None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:15.405964 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b26ea8-c2be-41aa-8608-8b5fc3436ce6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:15.406303 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b14b8-3b37-4add-ba45-ddebe232fa4e None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:15.406798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b14b8-3b37-4add-ba45-ddebe232fa4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:15.408968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b14b8-3b37-4add-ba45-ddebe232fa4e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:15.417861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-31b26ea8-c2be-41aa-8608-8b5fc3436ce6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:15.417861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:15.417861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:15.417861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:15.417861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:15.417861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:15.417861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:15.417861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:15.417861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:15.417861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:15.417861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:15.417861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:15.417861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:15.417861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:15.417861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:15.418917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:15.418917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:15.418917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:15.418917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:15.418917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:15.418917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:15.418917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:15.418917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:15.418917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:15.418917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:15.418917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:15.418917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:15.418917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:15.418917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:15.418917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:15.418917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:15.418917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:15.419803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:15.419803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:15.419803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:15.419803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:15.419803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:15.419803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:15.419803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:15.419803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:15.419803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 296/582] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:15.419803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b26ea8-c2be-41aa-8608-8b5fc3436ce6 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:15.421075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 287/583] 10.222.0.96 () {56 vars in 1103 bytes} [Wed Aug 24 04:18:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:15.422016 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b14b8-3b37-4add-ba45-ddebe232fa4e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:15.463568 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:15.497224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:15.532504 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b26ea8-c2be-41aa-8608-8b5fc3436ce6 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:15.541941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b14b8-3b37-4add-ba45-ddebe232fa4e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:15.571604 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c0f8a-bbcb-4bf1-83e4-281eb2aaaf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:15.572236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c0f8a-bbcb-4bf1-83e4-281eb2aaaf82 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:15.572524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c0f8a-bbcb-4bf1-83e4-281eb2aaaf82 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:15.572820 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c0f8a-bbcb-4bf1-83e4-281eb2aaaf82 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:15.577983 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a2ad0-32cb-4563-8172-ca191e0d7fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:15.578593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a2ad0-32cb-4563-8172-ca191e0d7fbe None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:15.578876 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a2ad0-32cb-4563-8172-ca191e0d7fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:15.579151 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a2ad0-32cb-4563-8172-ca191e0d7fbe None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:15.579892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a2ad0-32cb-4563-8172-ca191e0d7fbe None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:15.580203 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a2ad0-32cb-4563-8172-ca191e0d7fbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:15.581377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c0f8a-bbcb-4bf1-83e4-281eb2aaaf82 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:15.581649 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a2ad0-32cb-4563-8172-ca191e0d7fbe None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:15.583051 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c0f8a-bbcb-4bf1-83e4-281eb2aaaf82 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:15.594783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-650c0f8a-bbcb-4bf1-83e4-281eb2aaaf82 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:18:15.594783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:15.594783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:15.594783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:15.594783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:15.594783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:15.594783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:15.594783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:15.594783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:15.594783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:15.594783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:15.594783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:15.594783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:15.594783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:15.594783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:15.594783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:15.595753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:15.595753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:15.595753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:15.595753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:15.595753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:15.595753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:15.595753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:15.595753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:15.595753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:15.595753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:15.595753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:15.595753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:15.595753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:15.595753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:15.595753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:15.595753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:15.595753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:15.595753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:15.596715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:15.596715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:15.596715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:15.596715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:15.596715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:15.596715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:15.596715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:15.596715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:15.596715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:18:15.596715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:15.600844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 297/584] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:18:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:15.601791 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 288/585] 10.222.0.96 () {56 vars in 1137 bytes} [Wed Aug 24 04:18:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:15.602195 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c0f8a-bbcb-4bf1-83e4-281eb2aaaf82 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:15.602617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a2ad0-32cb-4563-8172-ca191e0d7fbe None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:15.710679 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:15.718624 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a2ad0-32cb-4563-8172-ca191e0d7fbe None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:15.719330 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c0f8a-bbcb-4bf1-83e4-281eb2aaaf82 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:15.749946 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:15.758028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9cd81-2db4-44ce-abcc-b09701c836d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:15.758647 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9cd81-2db4-44ce-abcc-b09701c836d5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:15.758935 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9cd81-2db4-44ce-abcc-b09701c836d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:15.759206 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9cd81-2db4-44ce-abcc-b09701c836d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:15.759914 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9cd81-2db4-44ce-abcc-b09701c836d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:15.760223 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9cd81-2db4-44ce-abcc-b09701c836d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:15.761685 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9cd81-2db4-44ce-abcc-b09701c836d5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:15.765762 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034ed5f-6060-4cde-a77f-9ebbea76038d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:15.766642 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034ed5f-6060-4cde-a77f-9ebbea76038d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:15.767130 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034ed5f-6060-4cde-a77f-9ebbea76038d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:15.767613 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034ed5f-6060-4cde-a77f-9ebbea76038d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:15.774466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 298/586] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:15.775282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9cd81-2db4-44ce-abcc-b09701c836d5 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:15.784499 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3034ed5f-6060-4cde-a77f-9ebbea76038d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:15.786975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3034ed5f-6060-4cde-a77f-9ebbea76038d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:15.806560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-3034ed5f-6060-4cde-a77f-9ebbea76038d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:15.806560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:15.806560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:15.806560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:15.806560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:15.806560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:15.806560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:15.806560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:15.806560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:15.806560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:15.806560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:15.806560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:15.806560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:15.806560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:15.806560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:15.806560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:15.807511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:15.807511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:15.807511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:15.807511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:15.807511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:15.807511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:15.807511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:15.807511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:15.807511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:15.807511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:15.807511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:15.807511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:15.807511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:15.807511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:15.807511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:15.807511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:15.807511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:15.808433 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:15.808433 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:15.808433 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:15.810209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 289/587] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:15.810920 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034ed5f-6060-4cde-a77f-9ebbea76038d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:15.895717 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9cd81-2db4-44ce-abcc-b09701c836d5 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:15.919758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034ed5f-6060-4cde-a77f-9ebbea76038d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:15.936957 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab56d1c-e7d2-45c2-8c6f-4a634766f1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:15.937562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab56d1c-e7d2-45c2-8c6f-4a634766f1cc None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:15.937844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab56d1c-e7d2-45c2-8c6f-4a634766f1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:15.938123 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab56d1c-e7d2-45c2-8c6f-4a634766f1cc None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:15.938867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab56d1c-e7d2-45c2-8c6f-4a634766f1cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:15.939174 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab56d1c-e7d2-45c2-8c6f-4a634766f1cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:15.940805 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab56d1c-e7d2-45c2-8c6f-4a634766f1cc None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:15.959235 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0fc49-148e-46fe-9fe2-005298a0bbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:15.959965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0fc49-148e-46fe-9fe2-005298a0bbe1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:15.960322 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0fc49-148e-46fe-9fe2-005298a0bbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:15.960670 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0fc49-148e-46fe-9fe2-005298a0bbe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:15.967062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 299/588] 10.222.0.96 () {56 vars in 1137 bytes} [Wed Aug 24 04:18:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:15.967062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab56d1c-e7d2-45c2-8c6f-4a634766f1cc None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:15.980907 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0fc49-148e-46fe-9fe2-005298a0bbe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:15.982014 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:15.982890 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0fc49-148e-46fe-9fe2-005298a0bbe1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:15.997637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-dcd0fc49-148e-46fe-9fe2-005298a0bbe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:15.997637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:15.997637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:15.997637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:15.997637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:15.997637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:15.997637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:15.997637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:15.997637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:15.997637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:15.997637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:15.997637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:15.997637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:15.997637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:15.997637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:15.997637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:15.998629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:15.998629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:15.998629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:15.998629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:15.998629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:15.998629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:15.998629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:15.998629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:15.998629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:15.998629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:15.998629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:15.998629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:15.998629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:15.998629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:15.998629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:15.998629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:15.998629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:15.999637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:15.999637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:15.999637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:15.999637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 290/589] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:15.999637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0fc49-148e-46fe-9fe2-005298a0bbe1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:16.030058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:16.093275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab56d1c-e7d2-45c2-8c6f-4a634766f1cc None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:16.106844 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0fc49-148e-46fe-9fe2-005298a0bbe1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:16.132120 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51dd90-9890-4924-a86c-07f859483e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:16.133001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51dd90-9890-4924-a86c-07f859483e38 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:16.133337 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51dd90-9890-4924-a86c-07f859483e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:16.133696 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51dd90-9890-4924-a86c-07f859483e38 None admin] PATH_INFO: `/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/3539784b4e91472eb20addc6707dc30d/roles/f1c5993fc3be47ef98bfd2ae3cdcd6e7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:16.144858 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b135d-58bb-4488-832b-1eeb559780c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:16.146065 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b135d-58bb-4488-832b-1eeb559780c0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:16.146336 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b135d-58bb-4488-832b-1eeb559780c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:16.146609 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b135d-58bb-4488-832b-1eeb559780c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:16.147253 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b135d-58bb-4488-832b-1eeb559780c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:16.147567 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b135d-58bb-4488-832b-1eeb559780c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:16.148969 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b135d-58bb-4488-832b-1eeb559780c0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:16.151260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51dd90-9890-4924-a86c-07f859483e38 None admin] RBAC: Authorizing `identity:create_grant(project_id=d76b6cd68a7f4613a8e921781495f256, user_id=3539784b4e91472eb20addc6707dc30d, role_id=f1c5993fc3be47ef98bfd2ae3cdcd6e7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:16.152735 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51dd90-9890-4924-a86c-07f859483e38 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:16.163327 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 291/590] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:16.164054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b135d-58bb-4488-832b-1eeb559780c0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:16.181510 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 300/591] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:18:15 2022] PUT /identity/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/3539784b4e91472eb20addc6707dc30d/roles/f1c5993fc3be47ef98bfd2ae3cdcd6e7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:18:16.181510 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51dd90-9890-4924-a86c-07f859483e38 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:16.271717 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:16.308560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:16.330969 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b135d-58bb-4488-832b-1eeb559780c0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:16.340585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51dd90-9890-4924-a86c-07f859483e38 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:16.380035 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d26f1-1608-48be-bf7e-fe74f2a48c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:16.380753 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d26f1-1608-48be-bf7e-fe74f2a48c10 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:16.380974 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d26f1-1608-48be-bf7e-fe74f2a48c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:16.381244 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d26f1-1608-48be-bf7e-fe74f2a48c10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:16.382696 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b5c0c-1eb2-43d6-8490-1b968505c485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:16.383491 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b5c0c-1eb2-43d6-8490-1b968505c485 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:16.384103 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b5c0c-1eb2-43d6-8490-1b968505c485 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:16.384394 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b5c0c-1eb2-43d6-8490-1b968505c485 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:16.386540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b5c0c-1eb2-43d6-8490-1b968505c485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:16.386540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b5c0c-1eb2-43d6-8490-1b968505c485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:16.386849 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b5c0c-1eb2-43d6-8490-1b968505c485 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:16.394653 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d26f1-1608-48be-bf7e-fe74f2a48c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:16.394846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d26f1-1608-48be-bf7e-fe74f2a48c10 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:16.401099 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 301/592] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:16.402025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b5c0c-1eb2-43d6-8490-1b968505c485 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:16.413731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-b76d26f1-1608-48be-bf7e-fe74f2a48c10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:16.413731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:16.413731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:16.413731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:16.413731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:16.413731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:16.413731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:16.413731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:16.413731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:16.413731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:16.413731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:16.413731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:16.413731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:16.413731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:16.413731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:16.413731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:16.414714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:16.414714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:16.414714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:16.414714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:16.414714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:16.414714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:16.414714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:16.414714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:16.414714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:16.414714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:16.414714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:16.414714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:16.414714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:16.414714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:16.414714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:16.414714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:16.414714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:16.415593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:16.415593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:16.415593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:16.419898 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 292/593] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:16.420778 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d26f1-1608-48be-bf7e-fe74f2a48c10 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:16.512652 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b5c0c-1eb2-43d6-8490-1b968505c485 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:16.525161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d26f1-1608-48be-bf7e-fe74f2a48c10 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:16.543756 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:16.564769 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110f2c1-cf0c-451b-b47d-0f1053e47c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:16.565462 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110f2c1-cf0c-451b-b47d-0f1053e47c47 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:16.565749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110f2c1-cf0c-451b-b47d-0f1053e47c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:16.566027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110f2c1-cf0c-451b-b47d-0f1053e47c47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:16.569275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a23e5b-99b1-4a31-95fa-7ae74a837cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:16.570542 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a23e5b-99b1-4a31-95fa-7ae74a837cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:16.571330 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a23e5b-99b1-4a31-95fa-7ae74a837cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:16.571816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a23e5b-99b1-4a31-95fa-7ae74a837cd7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:16.574768 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110f2c1-cf0c-451b-b47d-0f1053e47c47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:16.576499 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110f2c1-cf0c-451b-b47d-0f1053e47c47 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:16.580181 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:16.584544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a23e5b-99b1-4a31-95fa-7ae74a837cd7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:16.587022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a23e5b-99b1-4a31-95fa-7ae74a837cd7 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:16.593202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-1110f2c1-cf0c-451b-b47d-0f1053e47c47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:16.593202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:16.593202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:16.593202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:16.593202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:16.593202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:16.593202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:16.593202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:16.593202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:16.593202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:16.593202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:16.593202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:16.593202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:16.593202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:16.593202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:16.594140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:16.594140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:16.594140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:16.594140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:16.594140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:16.594140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:16.594140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:16.594140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:16.594140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:16.594140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:16.594140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:16.594140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:16.594140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:16.594140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:16.594140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:16.594140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:16.594140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:16.595224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:16.595224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:16.595224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:16.595224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:16.595224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:16.595224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:16.595224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:16.595224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:16.595224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 293/594] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:16.595224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110f2c1-cf0c-451b-b47d-0f1053e47c47 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:16.604600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-f5a23e5b-99b1-4a31-95fa-7ae74a837cd7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:18:16.604600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:16.604600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:16.604600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:16.604600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:16.604600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:16.604600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:16.604600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:16.604600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:16.604600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:16.604600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:16.604600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:16.604600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:16.604600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:16.604600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:16.604600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:16.606072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:16.606072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:16.606072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:16.606072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:16.606072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:16.606072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:16.606072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:16.606072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:16.606072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:16.606072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:16.606072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:16.606072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:16.606072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:16.606072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:16.606072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:16.606072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:16.606072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:16.606072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:16.607320 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:16.607320 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:16.607320 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:16.607320 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:16.607320 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:16.607320 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:16.607320 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:16.607320 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:16.607320 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:18:16.607320 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:16.609900 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 302/595] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:18:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:16.610983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a23e5b-99b1-4a31-95fa-7ae74a837cd7 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:16.710416 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110f2c1-cf0c-451b-b47d-0f1053e47c47 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:16.728016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a23e5b-99b1-4a31-95fa-7ae74a837cd7 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:16.762844 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e72e97-0b7e-4261-937e-6687e5603615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:16.763484 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e72e97-0b7e-4261-937e-6687e5603615 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:16.763770 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e72e97-0b7e-4261-937e-6687e5603615 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:16.764057 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e72e97-0b7e-4261-937e-6687e5603615 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:16.764734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e72e97-0b7e-4261-937e-6687e5603615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:16.765204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e72e97-0b7e-4261-937e-6687e5603615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:16.766946 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e72e97-0b7e-4261-937e-6687e5603615 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:16.773849 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bcdd6-00d5-4c35-b45d-78c2ec4fec57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:16.775399 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bcdd6-00d5-4c35-b45d-78c2ec4fec57 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:16.776152 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bcdd6-00d5-4c35-b45d-78c2ec4fec57 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:16.776996 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bcdd6-00d5-4c35-b45d-78c2ec4fec57 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:16.778406 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bcdd6-00d5-4c35-b45d-78c2ec4fec57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:16.779049 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bcdd6-00d5-4c35-b45d-78c2ec4fec57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:16.780116 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 294/596] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:16.781058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e72e97-0b7e-4261-937e-6687e5603615 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:16.782226 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bcdd6-00d5-4c35-b45d-78c2ec4fec57 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:16.804638 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 303/597] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:16.806152 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bcdd6-00d5-4c35-b45d-78c2ec4fec57 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:16.852433 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:16.875095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:16.901965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e72e97-0b7e-4261-937e-6687e5603615 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:16.955626 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7177d5-0f21-41a4-9aa8-6b5bfaa4fb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:16.956370 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7177d5-0f21-41a4-9aa8-6b5bfaa4fb66 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:16.956654 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7177d5-0f21-41a4-9aa8-6b5bfaa4fb66 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:16.957000 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7177d5-0f21-41a4-9aa8-6b5bfaa4fb66 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:16.958031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7177d5-0f21-41a4-9aa8-6b5bfaa4fb66 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:16.958330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7177d5-0f21-41a4-9aa8-6b5bfaa4fb66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:16.963610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7177d5-0f21-41a4-9aa8-6b5bfaa4fb66 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:16.965256 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bcdd6-00d5-4c35-b45d-78c2ec4fec57 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:16.992930 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 295/598] 10.222.0.96 () {56 vars in 1139 bytes} [Wed Aug 24 04:18:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:16.993898 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7177d5-0f21-41a4-9aa8-6b5bfaa4fb66 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:17.013835 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f20c3-579e-4ea9-b9be-9acd5d01a887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:17.014876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f20c3-579e-4ea9-b9be-9acd5d01a887 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:17.015369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f20c3-579e-4ea9-b9be-9acd5d01a887 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:17.015952 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f20c3-579e-4ea9-b9be-9acd5d01a887 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:17.026468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f20c3-579e-4ea9-b9be-9acd5d01a887 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:17.029023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f20c3-579e-4ea9-b9be-9acd5d01a887 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:17.044064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-b92f20c3-579e-4ea9-b9be-9acd5d01a887 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:17.044064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:17.044064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:17.044064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:17.044064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:17.044064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:17.044064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:17.044064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:17.044064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:17.044064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:17.044064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:17.044064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:17.044064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:17.044064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:17.044064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:17.045199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:17.045199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:17.045199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:17.045199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:17.045199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:17.045199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:17.045199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:17.045199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:17.045199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:17.045199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:17.045199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:17.045199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:17.045199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:17.045199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:17.045199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:17.045199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:17.045199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:17.046218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:17.046218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:17.046218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:17.046218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:17.046218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:17.046218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:17.046218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:17.046218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:17.046218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 304/599] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:17.046912 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f20c3-579e-4ea9-b9be-9acd5d01a887 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:17.126391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7177d5-0f21-41a4-9aa8-6b5bfaa4fb66 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:17.149308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:17.161463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f20c3-579e-4ea9-b9be-9acd5d01a887 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:17.163500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:17.178039 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d036578-a2b5-46d0-b60b-5a212e166d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:17.178961 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d036578-a2b5-46d0-b60b-5a212e166d1e None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:17.179679 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d036578-a2b5-46d0-b60b-5a212e166d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:17.180110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d036578-a2b5-46d0-b60b-5a212e166d1e None admin] PATH_INFO: `/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/b182bf0bbbcf4a808626443c6c2a7a6a/roles/f1c5993fc3be47ef98bfd2ae3cdcd6e7` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:17.197133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d036578-a2b5-46d0-b60b-5a212e166d1e None admin] RBAC: Authorizing `identity:create_grant(project_id=d76b6cd68a7f4613a8e921781495f256, user_id=b182bf0bbbcf4a808626443c6c2a7a6a, role_id=f1c5993fc3be47ef98bfd2ae3cdcd6e7)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:17.198581 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d036578-a2b5-46d0-b60b-5a212e166d1e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:17.205938 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84138e71-d973-4724-84eb-905509d41809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:17.206690 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84138e71-d973-4724-84eb-905509d41809 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:17.207070 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84138e71-d973-4724-84eb-905509d41809 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:17.207492 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84138e71-d973-4724-84eb-905509d41809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:17.215661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 296/600] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:18:16 2022] PUT /identity/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/b182bf0bbbcf4a808626443c6c2a7a6a/roles/f1c5993fc3be47ef98bfd2ae3cdcd6e7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:18:17.220321 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84138e71-d973-4724-84eb-905509d41809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:17.222050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84138e71-d973-4724-84eb-905509d41809 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:17.225805 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d036578-a2b5-46d0-b60b-5a212e166d1e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:17.250086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-84138e71-d973-4724-84eb-905509d41809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:17.250086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:17.250086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:17.250086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:17.250086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:17.250086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:17.250086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:17.250086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:17.250086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:17.250086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:17.250086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:17.250086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:17.250086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:17.250086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:17.250086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:17.250086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:17.251303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:17.251303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:17.251303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:17.251303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:17.251303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:17.251303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:17.251303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:17.251303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:17.251303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:17.251303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:17.251303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:17.251303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:17.251303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:17.251303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:17.251303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:17.251303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:17.251303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:17.252418 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:17.252418 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:17.252418 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:17.252418 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 305/601] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:17.253026 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416369a-2ed5-4a00-a25c-fb523c484af7 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:17.253026 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416369a-2ed5-4a00-a25c-fb523c484af7 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:17.253193 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416369a-2ed5-4a00-a25c-fb523c484af7 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:17.254739 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 306/602] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:17.262126 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416369a-2ed5-4a00-a25c-fb523c484af7 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:17.388947 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d036578-a2b5-46d0-b60b-5a212e166d1e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:17.419829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416369a-2ed5-4a00-a25c-fb523c484af7 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:17.435699 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181995cb-8348-44b6-bc59-44d170de0dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:17.436321 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181995cb-8348-44b6-bc59-44d170de0dca None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:17.436631 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181995cb-8348-44b6-bc59-44d170de0dca None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:17.436944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181995cb-8348-44b6-bc59-44d170de0dca None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:17.437648 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181995cb-8348-44b6-bc59-44d170de0dca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:17.437954 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181995cb-8348-44b6-bc59-44d170de0dca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:17.439400 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181995cb-8348-44b6-bc59-44d170de0dca None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:17.453047 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 297/603] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:17.454358 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf12fc0-00f4-4a7c-9e1d-5ac2ae120486 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:17.454650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf12fc0-00f4-4a7c-9e1d-5ac2ae120486 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:17.454928 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf12fc0-00f4-4a7c-9e1d-5ac2ae120486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:17.462433 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f23b6-9545-45ce-ba15-52998577dca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:17.463975 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f23b6-9545-45ce-ba15-52998577dca1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:17.464267 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f23b6-9545-45ce-ba15-52998577dca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:17.464552 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f23b6-9545-45ce-ba15-52998577dca1 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:17.465245 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f23b6-9545-45ce-ba15-52998577dca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:17.465563 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f23b6-9545-45ce-ba15-52998577dca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:17.467066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f23b6-9545-45ce-ba15-52998577dca1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:17.475071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-cbf12fc0-00f4-4a7c-9e1d-5ac2ae120486 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:17.476275 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cbf12fc0-00f4-4a7c-9e1d-5ac2ae120486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:17.482840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 307/604] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:17.483731 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f23b6-9545-45ce-ba15-52998577dca1 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:17.504584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:17.505071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:17.556194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 298/605] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:17.557183 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf12fc0-00f4-4a7c-9e1d-5ac2ae120486 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:17.632252 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f23b6-9545-45ce-ba15-52998577dca1 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:17.671099 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf12fc0-00f4-4a7c-9e1d-5ac2ae120486 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:17.680770 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134be754-0c46-4afe-b113-39f3bcf7f523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:17.681918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134be754-0c46-4afe-b113-39f3bcf7f523 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:17.682204 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134be754-0c46-4afe-b113-39f3bcf7f523 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:17.682485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134be754-0c46-4afe-b113-39f3bcf7f523 None admin] PATH_INFO: `/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/6106a46199b74f649cd29a0d02610049/roles/f1c5993fc3be47ef98bfd2ae3cdcd6e7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:17.706849 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134be754-0c46-4afe-b113-39f3bcf7f523 None admin] RBAC: Authorizing `identity:create_grant(project_id=d76b6cd68a7f4613a8e921781495f256, user_id=6106a46199b74f649cd29a0d02610049, role_id=f1c5993fc3be47ef98bfd2ae3cdcd6e7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:17.708912 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134be754-0c46-4afe-b113-39f3bcf7f523 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:17.727261 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be9ce2-4092-491d-8d9d-68d967fb99d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:17.728038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be9ce2-4092-491d-8d9d-68d967fb99d6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:17.728325 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be9ce2-4092-491d-8d9d-68d967fb99d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:17.728639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be9ce2-4092-491d-8d9d-68d967fb99d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:17.736136 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be9ce2-4092-491d-8d9d-68d967fb99d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:17.737666 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be9ce2-4092-491d-8d9d-68d967fb99d6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:17.746396 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 308/606] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:18:17 2022] PUT /identity/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/6106a46199b74f649cd29a0d02610049/roles/f1c5993fc3be47ef98bfd2ae3cdcd6e7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:18:17.757750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-82be9ce2-4092-491d-8d9d-68d967fb99d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:17.757750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:17.757750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:17.757750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:17.757750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:17.757750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:17.757750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:17.757750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:17.757750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:17.757750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:17.757750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:17.757750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:17.757750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:17.757750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:17.757750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:17.758862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:17.758862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:17.758862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:17.758862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:17.758862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:17.758862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:17.758862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:17.758862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:17.758862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:17.758862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:17.758862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:17.758862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:17.758862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:17.758862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:17.758862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:17.758862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:17.758862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:17.760155 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:17.760155 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:17.760155 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:17.760155 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:17.760155 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:17.760155 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:17.760155 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:17.760155 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:17.760155 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 299/607] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:17.764632 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134be754-0c46-4afe-b113-39f3bcf7f523 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:17.856454 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:17.892197 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be9ce2-4092-491d-8d9d-68d967fb99d6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:17.913754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134be754-0c46-4afe-b113-39f3bcf7f523 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:17.933166 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:17.956328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91619e-595a-45cd-b613-ba161d125465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:17.957154 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91619e-595a-45cd-b613-ba161d125465 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:17.958130 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91619e-595a-45cd-b613-ba161d125465 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:17.958563 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91619e-595a-45cd-b613-ba161d125465 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:17.959789 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91619e-595a-45cd-b613-ba161d125465 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:17.960207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91619e-595a-45cd-b613-ba161d125465 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:17.962062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91619e-595a-45cd-b613-ba161d125465 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:17.976917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 309/608] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:17.989439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91619e-595a-45cd-b613-ba161d125465 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:18.080336 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be9ce2-4092-491d-8d9d-68d967fb99d6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:18.128148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4082f3-1233-4020-a79e-712b15438afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:18.128922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4082f3-1233-4020-a79e-712b15438afe None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:18.130234 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4082f3-1233-4020-a79e-712b15438afe None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:18.130594 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4082f3-1233-4020-a79e-712b15438afe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:18.135120 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91619e-595a-45cd-b613-ba161d125465 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:18.141656 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4082f3-1233-4020-a79e-712b15438afe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:18.146600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-2a4082f3-1233-4020-a79e-712b15438afe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:18.146600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:18.146600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:18.146600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:18.146600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:18.146600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:18.146600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:18.146600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:18.146600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:18.146600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:18.146600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:18.146600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:18.146600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:18.146600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:18.146600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:18.146600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:18.147735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:18.147735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:18.147735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:18.147735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:18.147735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:18.147735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:18.147735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:18.147735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:18.147735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:18.147735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:18.147735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:18.147735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:18.147735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:18.147735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:18.147735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:18.147735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:18.148906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:18.148906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:18.148906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:18.148906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:18.148906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:18.148906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:18.148906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:18.148906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:18.148906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:18.148906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:18.148906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:18.148906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:18.150763 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 300/609] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:18:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:18.156267 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4082f3-1233-4020-a79e-712b15438afe None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:18.181047 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:18.203218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0d004-ab7a-4d33-96f3-1c445cf18022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:18.203984 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0d004-ab7a-4d33-96f3-1c445cf18022 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:18.204373 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0d004-ab7a-4d33-96f3-1c445cf18022 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:18.204781 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0d004-ab7a-4d33-96f3-1c445cf18022 None admin] PATH_INFO: `/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/50358dbf699a41188dae93496161709d/roles/f1c5993fc3be47ef98bfd2ae3cdcd6e7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:18.237736 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0d004-ab7a-4d33-96f3-1c445cf18022 None admin] RBAC: Authorizing `identity:create_grant(project_id=d76b6cd68a7f4613a8e921781495f256, user_id=50358dbf699a41188dae93496161709d, role_id=f1c5993fc3be47ef98bfd2ae3cdcd6e7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:18.239941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0d004-ab7a-4d33-96f3-1c445cf18022 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:18.265693 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 310/610] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:18:17 2022] PUT /identity/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/50358dbf699a41188dae93496161709d/roles/f1c5993fc3be47ef98bfd2ae3cdcd6e7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:18:18.293077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:18.317410 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4082f3-1233-4020-a79e-712b15438afe None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:18.357323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a67b2-14a2-4b7e-a113-1719d1b6412b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:18.358124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a67b2-14a2-4b7e-a113-1719d1b6412b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:18.358506 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a67b2-14a2-4b7e-a113-1719d1b6412b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:18.358886 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a67b2-14a2-4b7e-a113-1719d1b6412b None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:18.359671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a67b2-14a2-4b7e-a113-1719d1b6412b None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:18.360087 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a67b2-14a2-4b7e-a113-1719d1b6412b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:18.361629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a67b2-14a2-4b7e-a113-1719d1b6412b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:18.372403 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 301/611] 10.222.0.96 () {56 vars in 1103 bytes} [Wed Aug 24 04:18:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:18.378152 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0d004-ab7a-4d33-96f3-1c445cf18022 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:18.494168 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3178e-dd60-485f-b2fb-2e1f16748ce7 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:18.494662 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3178e-dd60-485f-b2fb-2e1f16748ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:18.494883 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3178e-dd60-485f-b2fb-2e1f16748ce7 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:18.496343 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 302/612] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:18.502866 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4ad68-fd6a-4c67-882e-53d7cfc2e5be None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:18.503244 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4ad68-fd6a-4c67-882e-53d7cfc2e5be None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:18.503598 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4ad68-fd6a-4c67-882e-53d7cfc2e5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:18.531269 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-73f4ad68-fd6a-4c67-882e-53d7cfc2e5be None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:18.532871 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-73f4ad68-fd6a-4c67-882e-53d7cfc2e5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:18.541411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0d004-ab7a-4d33-96f3-1c445cf18022 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:18.590528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15583686-c60a-4bdd-854e-75c0f3146da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:18.590973 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15583686-c60a-4bdd-854e-75c0f3146da0 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:18.591264 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15583686-c60a-4bdd-854e-75c0f3146da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:18.591543 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15583686-c60a-4bdd-854e-75c0f3146da0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:18.605467 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15583686-c60a-4bdd-854e-75c0f3146da0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:18.607361 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15583686-c60a-4bdd-854e-75c0f3146da0 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:18.617068 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 303/613] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:18.635064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-15583686-c60a-4bdd-854e-75c0f3146da0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:18.635064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:18.635064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:18.635064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:18.635064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:18.635064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:18.635064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:18.635064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:18.635064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:18.635064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:18.635064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:18.635064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:18.635064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:18.635064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:18.635064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:18.635064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:18.636383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:18.636383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:18.636383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:18.636383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:18.636383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:18.636383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:18.636383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:18.636383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:18.636383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:18.636383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:18.636383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:18.636383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:18.636383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:18.636383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:18.636383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:18.636383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:18.636383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:18.637309 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:18.637309 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:18.637309 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:18.639245 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 311/614] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:18.645395 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4ad68-fd6a-4c67-882e-53d7cfc2e5be None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:18.755966 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:18.788218 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4ad68-fd6a-4c67-882e-53d7cfc2e5be None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:18.823646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52149b25-6e25-4571-8af3-f5dcf0cfaf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:18.824267 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52149b25-6e25-4571-8af3-f5dcf0cfaf50 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:18.824550 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52149b25-6e25-4571-8af3-f5dcf0cfaf50 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:18.825635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52149b25-6e25-4571-8af3-f5dcf0cfaf50 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:18.826301 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52149b25-6e25-4571-8af3-f5dcf0cfaf50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:18.826611 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52149b25-6e25-4571-8af3-f5dcf0cfaf50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:18.828052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52149b25-6e25-4571-8af3-f5dcf0cfaf50 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:18.841100 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 304/615] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:18.849915 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15583686-c60a-4bdd-854e-75c0f3146da0 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:18.905623 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:19.012302 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52149b25-6e25-4571-8af3-f5dcf0cfaf50 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:19.018818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15583686-c60a-4bdd-854e-75c0f3146da0 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:19.061525 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd7ab0-65c3-4861-813e-b245956a930d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:19.062624 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd7ab0-65c3-4861-813e-b245956a930d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:19.063239 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd7ab0-65c3-4861-813e-b245956a930d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:19.063713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd7ab0-65c3-4861-813e-b245956a930d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:19.073928 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd7ab0-65c3-4861-813e-b245956a930d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:19.075992 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd7ab0-65c3-4861-813e-b245956a930d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:19.089426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-a7fd7ab0-65c3-4861-813e-b245956a930d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:18:19.089426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:19.089426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:19.089426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:19.089426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:19.089426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:19.089426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:19.089426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:19.089426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:19.089426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:19.089426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:19.089426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:19.089426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:19.089426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:19.089426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:19.089426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:19.090460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:19.090460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:19.090460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:19.090460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:19.090460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:19.090460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:19.090460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:19.090460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:19.090460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:19.090460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:19.090460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:19.090460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:19.090460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:19.090460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:19.090460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:19.090460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:19.090460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:19.090460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:19.091452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:19.091452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:19.091452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:19.091452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:19.091452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:19.091452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:19.091452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:19.091452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:19.091452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:18:19.091452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:19.094369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 312/616] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:18:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:19.101107 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd7ab0-65c3-4861-813e-b245956a930d None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:19.197518 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:19.215424 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd7ab0-65c3-4861-813e-b245956a930d None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:19.255609 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52149b25-6e25-4571-8af3-f5dcf0cfaf50 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:19.260078 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc93f00-b06a-4c52-9008-29536c8d260a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:19.260721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc93f00-b06a-4c52-9008-29536c8d260a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:19.261015 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc93f00-b06a-4c52-9008-29536c8d260a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:19.261295 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc93f00-b06a-4c52-9008-29536c8d260a None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:19.262042 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc93f00-b06a-4c52-9008-29536c8d260a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:19.262404 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc93f00-b06a-4c52-9008-29536c8d260a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:19.263795 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc93f00-b06a-4c52-9008-29536c8d260a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:19.299092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97315636-8650-4669-bdb1-ab650c32ba02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:19.299736 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97315636-8650-4669-bdb1-ab650c32ba02 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:19.300021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97315636-8650-4669-bdb1-ab650c32ba02 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:19.300295 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97315636-8650-4669-bdb1-ab650c32ba02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:19.301662 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:19.305274 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 313/617] 10.222.0.96 () {56 vars in 1135 bytes} [Wed Aug 24 04:18:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:19.311124 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc93f00-b06a-4c52-9008-29536c8d260a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:19.330139 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97315636-8650-4669-bdb1-ab650c32ba02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:19.339434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-97315636-8650-4669-bdb1-ab650c32ba02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:19.339434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:19.339434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:19.339434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:19.339434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:19.339434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:19.339434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:19.339434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:19.339434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:19.339434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:19.339434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:19.339434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:19.339434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:19.339434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:19.339434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:19.339434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:19.340483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:19.340483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:19.340483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:19.340483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:19.340483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:19.340483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:19.340483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:19.340483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:19.340483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:19.340483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:19.340483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:19.340483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:19.340483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:19.340483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:19.340483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:19.340483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:19.341459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:19.341459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:19.341459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:19.341459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:19.341459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:19.341459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:19.341459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:19.341459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:19.341459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:19.341459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:19.341459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:19.341459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:19.347640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 305/618] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:18:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:18:19.355923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97315636-8650-4669-bdb1-ab650c32ba02 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:19.451099 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc93f00-b06a-4c52-9008-29536c8d260a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:19.496568 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6774a42-b5c9-44b5-b65f-cb5d4d2f94cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:19.497241 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6774a42-b5c9-44b5-b65f-cb5d4d2f94cd None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:19.497526 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6774a42-b5c9-44b5-b65f-cb5d4d2f94cd None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:19.497803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6774a42-b5c9-44b5-b65f-cb5d4d2f94cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:19.511363 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6774a42-b5c9-44b5-b65f-cb5d4d2f94cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:19.517120 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6774a42-b5c9-44b5-b65f-cb5d4d2f94cd None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:19.524108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:19.531045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97315636-8650-4669-bdb1-ab650c32ba02 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:19.551885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-d6774a42-b5c9-44b5-b65f-cb5d4d2f94cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:19.551885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:19.551885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:19.551885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:19.551885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:19.551885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:19.551885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:19.551885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:19.551885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:19.551885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:19.551885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:19.551885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:19.551885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:19.551885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:19.551885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:19.551885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:19.552913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:19.552913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:19.552913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:19.552913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:19.552913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:19.552913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:19.552913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:19.552913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:19.552913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:19.552913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:19.552913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:19.552913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:19.552913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:19.552913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:19.552913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:19.552913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:19.552913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:19.553958 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:19.553958 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:19.553958 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:19.556803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 314/619] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:19.558538 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6774a42-b5c9-44b5-b65f-cb5d4d2f94cd None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:19.571403 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be1599-cf18-4222-bac9-8152dfc397d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:19.572016 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be1599-cf18-4222-bac9-8152dfc397d2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:19.572297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be1599-cf18-4222-bac9-8152dfc397d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:19.572573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be1599-cf18-4222-bac9-8152dfc397d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:19.573440 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be1599-cf18-4222-bac9-8152dfc397d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:19.573750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be1599-cf18-4222-bac9-8152dfc397d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:19.575239 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be1599-cf18-4222-bac9-8152dfc397d2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:19.584361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 306/620] 10.222.0.96 () {56 vars in 1103 bytes} [Wed Aug 24 04:18:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:19.585662 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc554cd-c9f3-4e6d-ac5d-8f28f50b695f None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:19.585951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc554cd-c9f3-4e6d-ac5d-8f28f50b695f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:19.586331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc554cd-c9f3-4e6d-ac5d-8f28f50b695f None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:19.591717 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 307/621] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:19.592602 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc554cd-c9f3-4e6d-ac5d-8f28f50b695f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:19.652981 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:19.671178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6774a42-b5c9-44b5-b65f-cb5d4d2f94cd None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:19.710087 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c931175-417c-4361-8745-acbdf34480c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:19.710684 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc554cd-c9f3-4e6d-ac5d-8f28f50b695f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:19.710879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c931175-417c-4361-8745-acbdf34480c3 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:19.711042 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c931175-417c-4361-8745-acbdf34480c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:19.711221 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c931175-417c-4361-8745-acbdf34480c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:19.711873 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c931175-417c-4361-8745-acbdf34480c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:19.712174 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c931175-417c-4361-8745-acbdf34480c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:19.713604 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c931175-417c-4361-8745-acbdf34480c3 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:19.726483 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 315/622] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:18:19.727811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68ceff-6572-4249-9d26-9a42c435f5d8 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:19.728101 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68ceff-6572-4249-9d26-9a42c435f5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:19.728375 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68ceff-6572-4249-9d26-9a42c435f5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:19.747310 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-1f68ceff-6572-4249-9d26-9a42c435f5d8 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:19.748448 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1f68ceff-6572-4249-9d26-9a42c435f5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:19.749283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0ab0c-0b77-4b22-9df4-bbcb7e43360c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:19.750001 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0ab0c-0b77-4b22-9df4-bbcb7e43360c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:19.750454 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0ab0c-0b77-4b22-9df4-bbcb7e43360c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:19.750797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0ab0c-0b77-4b22-9df4-bbcb7e43360c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:19.763289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0ab0c-0b77-4b22-9df4-bbcb7e43360c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:19.765203 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0ab0c-0b77-4b22-9df4-bbcb7e43360c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:19.782976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-77e0ab0c-0b77-4b22-9df4-bbcb7e43360c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:19.782976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:19.782976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:19.782976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:19.782976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:19.782976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:19.782976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:19.782976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:19.782976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:19.782976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:19.782976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:19.782976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:19.782976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:19.782976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:19.782976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:19.782976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:19.785255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:19.785255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:19.785255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:19.785255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:19.785255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:19.785255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:19.785255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:19.785255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:19.785255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:19.785255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:19.785255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:19.785255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:19.785255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:19.785255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:19.785255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:19.785255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:19.785255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:19.787677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:19.787677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:19.787677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:19.787677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 308/623] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:19.787677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0ab0c-0b77-4b22-9df4-bbcb7e43360c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:19.804466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:19.828516 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 316/624] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:19.828516 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68ceff-6572-4249-9d26-9a42c435f5d8 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:19.926900 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68ceff-6572-4249-9d26-9a42c435f5d8 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:19.962936 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28676cfb-a98b-46f2-be37-66ee487baae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:19.963562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28676cfb-a98b-46f2-be37-66ee487baae7 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:19.963856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28676cfb-a98b-46f2-be37-66ee487baae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:19.964135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28676cfb-a98b-46f2-be37-66ee487baae7 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:19.964813 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28676cfb-a98b-46f2-be37-66ee487baae7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:19.965118 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28676cfb-a98b-46f2-be37-66ee487baae7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:19.966494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28676cfb-a98b-46f2-be37-66ee487baae7 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:19.979893 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 317/625] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:19.987741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28676cfb-a98b-46f2-be37-66ee487baae7 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:20.002640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0ab0c-0b77-4b22-9df4-bbcb7e43360c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:20.007157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:20.053309 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:20.130238 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bc314-f8c5-4720-b7c4-1fae8288442a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:20.130896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bc314-f8c5-4720-b7c4-1fae8288442a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:20.131181 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bc314-f8c5-4720-b7c4-1fae8288442a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:20.131456 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bc314-f8c5-4720-b7c4-1fae8288442a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:20.149859 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bc314-f8c5-4720-b7c4-1fae8288442a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:20.151354 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bc314-f8c5-4720-b7c4-1fae8288442a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:20.154194 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28676cfb-a98b-46f2-be37-66ee487baae7 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:20.172002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-099bc314-f8c5-4720-b7c4-1fae8288442a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:20.172002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:20.172002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:20.172002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:20.172002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:20.172002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:20.172002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:20.172002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:20.172002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:20.172002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:20.172002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:20.172002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:20.172002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:20.172002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:20.172002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:20.173572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:20.173572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:20.173572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:20.173572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:20.173572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:20.173572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:20.173572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:20.173572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:20.173572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:20.173572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:20.173572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:20.173572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:20.173572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:20.173572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:20.173572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:20.173572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:20.173572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:20.175119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:20.175119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:20.175119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:20.175119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:20.175119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:20.175119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:20.175119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:20.175119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:20.175119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 309/626] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:20.175119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bc314-f8c5-4720-b7c4-1fae8288442a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:20.234759 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984df67b-d526-4edd-a774-aa275603623f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:20.236160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984df67b-d526-4edd-a774-aa275603623f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:20.237107 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984df67b-d526-4edd-a774-aa275603623f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:20.238222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984df67b-d526-4edd-a774-aa275603623f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:20.257822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984df67b-d526-4edd-a774-aa275603623f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:20.262358 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984df67b-d526-4edd-a774-aa275603623f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:20.290913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-984df67b-d526-4edd-a774-aa275603623f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:18:20.290913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:20.290913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:20.290913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:20.290913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:20.290913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:20.290913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:20.290913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:20.290913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:20.290913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:20.290913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:20.290913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:20.290913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:20.290913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:20.290913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:20.290913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:20.292793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:20.292793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:20.292793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:20.292793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:20.292793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:20.292793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:20.292793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:20.292793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:20.292793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:20.292793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:20.292793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:20.292793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:20.292793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:20.292793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:20.292793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:20.292793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:20.292793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:20.292793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:20.294717 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:20.294717 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:20.294717 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:20.294717 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:20.294717 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:20.294717 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:20.294717 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:20.294717 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:20.294717 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:18:20.294717 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:20.299102 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 318/627] 10.222.0.96 () {56 vars in 1093 bytes} [Wed Aug 24 04:18:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:20.300719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984df67b-d526-4edd-a774-aa275603623f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:20.301610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bc314-f8c5-4720-b7c4-1fae8288442a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:20.339730 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbc358-c55b-4618-853c-98722616052c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:20.340391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbc358-c55b-4618-853c-98722616052c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:20.340729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbc358-c55b-4618-853c-98722616052c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:20.340979 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbc358-c55b-4618-853c-98722616052c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:20.352515 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbc358-c55b-4618-853c-98722616052c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:20.357863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-edcbc358-c55b-4618-853c-98722616052c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:20.357863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:20.357863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:20.357863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:20.357863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:20.357863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:20.357863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:20.357863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:20.357863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:20.357863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:20.357863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:20.357863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:20.357863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:20.357863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:20.357863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:20.357863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:20.358932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:20.358932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:20.358932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:20.358932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:20.358932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:20.358932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:20.358932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:20.358932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:20.358932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:20.358932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:20.358932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:20.358932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:20.358932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:20.358932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:20.358932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:20.358932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:20.359797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:20.359797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:20.359797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:20.359797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:20.359797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:20.359797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:20.359797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:20.359797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:20.359797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:20.359797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:20.359797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:20.359797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:20.359797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 310/628] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:18:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:20.360536 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4410803-3c02-45e8-ab51-807b2d9d6e71 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:20.361175 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4410803-3c02-45e8-ab51-807b2d9d6e71 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:20.361175 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4410803-3c02-45e8-ab51-807b2d9d6e71 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:20.362448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 311/629] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:20.365505 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4410803-3c02-45e8-ab51-807b2d9d6e71 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:20.395410 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:20.423411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984df67b-d526-4edd-a774-aa275603623f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:20.431405 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:20.468964 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad533e02-aa94-412d-b06c-a447ed429970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:20.469926 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad533e02-aa94-412d-b06c-a447ed429970 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:20.470395 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad533e02-aa94-412d-b06c-a447ed429970 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:20.470808 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad533e02-aa94-412d-b06c-a447ed429970 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:20.471806 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad533e02-aa94-412d-b06c-a447ed429970 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:20.472242 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad533e02-aa94-412d-b06c-a447ed429970 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:20.475014 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad533e02-aa94-412d-b06c-a447ed429970 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:20.485734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4410803-3c02-45e8-ab51-807b2d9d6e71 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:20.490708 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 319/630] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:20.496323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad533e02-aa94-412d-b06c-a447ed429970 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:20.523306 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7a615-75f9-4ef7-8d05-7613436731f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:20.523921 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7a615-75f9-4ef7-8d05-7613436731f4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:20.524209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7a615-75f9-4ef7-8d05-7613436731f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:20.524489 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7a615-75f9-4ef7-8d05-7613436731f4 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:20.525261 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7a615-75f9-4ef7-8d05-7613436731f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:20.525588 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7a615-75f9-4ef7-8d05-7613436731f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:20.527001 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7a615-75f9-4ef7-8d05-7613436731f4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:20.550470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 312/631] 10.222.0.96 () {56 vars in 1133 bytes} [Wed Aug 24 04:18:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:20.550470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d5c3e-53f5-4ff2-abb4-516010febcb4 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:20.550470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d5c3e-53f5-4ff2-abb4-516010febcb4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:20.550470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d5c3e-53f5-4ff2-abb4-516010febcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:20.567089 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-632d5c3e-53f5-4ff2-abb4-516010febcb4 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:20.568394 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-632d5c3e-53f5-4ff2-abb4-516010febcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:20.614287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad533e02-aa94-412d-b06c-a447ed429970 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:20.643107 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 313/632] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:20.643759 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d5c3e-53f5-4ff2-abb4-516010febcb4 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:20.658343 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca178422-c6b7-48e0-a761-37aff16ba0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:20.659331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:20.660834 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca178422-c6b7-48e0-a761-37aff16ba0f4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:20.661623 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca178422-c6b7-48e0-a761-37aff16ba0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:20.662107 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca178422-c6b7-48e0-a761-37aff16ba0f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:20.663345 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca178422-c6b7-48e0-a761-37aff16ba0f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:20.663878 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca178422-c6b7-48e0-a761-37aff16ba0f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:20.666298 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca178422-c6b7-48e0-a761-37aff16ba0f4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:20.681110 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 320/633] 10.222.0.96 () {56 vars in 1103 bytes} [Wed Aug 24 04:18:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:20.682796 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca178422-c6b7-48e0-a761-37aff16ba0f4 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:20.723489 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:20.770838 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d5c3e-53f5-4ff2-abb4-516010febcb4 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:20.803222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca178422-c6b7-48e0-a761-37aff16ba0f4 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:20.808810 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b2651-60b7-4af8-82d5-1a98e110b33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:20.809474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b2651-60b7-4af8-82d5-1a98e110b33f None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:20.809756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b2651-60b7-4af8-82d5-1a98e110b33f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:20.810031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b2651-60b7-4af8-82d5-1a98e110b33f None admin] PATH_INFO: `/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/953d2dbd5e7d435f9148fd043b4ce7a7/roles/f1c5993fc3be47ef98bfd2ae3cdcd6e7` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:20.827877 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b2651-60b7-4af8-82d5-1a98e110b33f None admin] RBAC: Authorizing `identity:create_grant(project_id=d76b6cd68a7f4613a8e921781495f256, user_id=953d2dbd5e7d435f9148fd043b4ce7a7, role_id=f1c5993fc3be47ef98bfd2ae3cdcd6e7)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:20.828070 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b2651-60b7-4af8-82d5-1a98e110b33f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:20.843293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 314/634] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:18:20 2022] PUT /identity/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/953d2dbd5e7d435f9148fd043b4ce7a7/roles/f1c5993fc3be47ef98bfd2ae3cdcd6e7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:18:20.844014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b2651-60b7-4af8-82d5-1a98e110b33f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:20.856476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d907eb-b937-4ced-9ffd-f58a477d7235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:20.858098 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d907eb-b937-4ced-9ffd-f58a477d7235 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:20.858786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d907eb-b937-4ced-9ffd-f58a477d7235 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:20.859329 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d907eb-b937-4ced-9ffd-f58a477d7235 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:20.922512 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:20.962164 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d907eb-b937-4ced-9ffd-f58a477d7235 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:20.963655 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d907eb-b937-4ced-9ffd-f58a477d7235 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:20.971504 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b2651-60b7-4af8-82d5-1a98e110b33f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:21.008449 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:21.023335 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76519db-401f-43ee-a277-cf21ab9d8cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:21.024332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76519db-401f-43ee-a277-cf21ab9d8cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:21.024768 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76519db-401f-43ee-a277-cf21ab9d8cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:21.025148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76519db-401f-43ee-a277-cf21ab9d8cd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:21.037481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76519db-401f-43ee-a277-cf21ab9d8cd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:21.038929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76519db-401f-43ee-a277-cf21ab9d8cd9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:21.054535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-b76519db-401f-43ee-a277-cf21ab9d8cd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:21.054535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:21.054535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:21.054535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:21.054535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:21.054535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:21.054535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:21.054535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:21.054535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:21.054535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:21.054535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:21.054535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:21.054535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:21.054535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:21.054535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:21.054535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:21.055513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:21.055513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:21.055513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:21.055513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:21.055513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:21.055513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:21.055513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:21.055513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:21.055513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:21.055513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:21.055513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:21.055513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:21.055513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:21.055513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:21.055513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:21.055513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:21.055513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:21.056406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:21.056406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:21.056406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:21.056406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 315/635] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:21.057191 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886c515-e859-4141-af4c-b6cbd05983eb None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:21.057376 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886c515-e859-4141-af4c-b6cbd05983eb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:21.057626 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886c515-e859-4141-af4c-b6cbd05983eb None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:21.060829 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 316/636] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:21.060829 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886c515-e859-4141-af4c-b6cbd05983eb None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:21.095819 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 321/637] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:18:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:21.096780 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d907eb-b937-4ced-9ffd-f58a477d7235 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:21.174618 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886c515-e859-4141-af4c-b6cbd05983eb None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:21.189994 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:21.204347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d907eb-b937-4ced-9ffd-f58a477d7235 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:21.213957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c44a3-32fe-4e90-8843-c330772a0fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:21.214586 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c44a3-32fe-4e90-8843-c330772a0fea None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:21.214871 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c44a3-32fe-4e90-8843-c330772a0fea None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:21.215146 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c44a3-32fe-4e90-8843-c330772a0fea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:21.226319 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c44a3-32fe-4e90-8843-c330772a0fea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:21.231092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-392c44a3-32fe-4e90-8843-c330772a0fea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:21.231092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:21.231092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:21.231092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:21.231092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:21.231092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:21.231092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:21.231092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:21.231092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:21.231092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:21.231092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:21.231092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:21.231092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:21.231092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:21.231092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:21.231092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:21.232027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:21.232027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:21.232027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:21.232027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:21.232027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:21.232027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:21.232027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:21.232027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:21.232027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:21.232027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:21.232027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:21.232027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:21.232027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:21.232027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:21.232027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:21.232027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:21.233307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:21.233307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:21.233307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:21.233307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:21.233307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:21.233307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:21.233307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:21.233307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:21.233307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:21.233307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:21.233307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:21.233307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:21.233307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 317/638] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:18:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:21.234192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1dd8b-346a-4152-a4d9-03d8d35da153 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:21.234490 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1dd8b-346a-4152-a4d9-03d8d35da153 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:21.234664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1dd8b-346a-4152-a4d9-03d8d35da153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:21.241944 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:21.250918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53bcbe-bae7-4add-bc96-c1603388fbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:21.251532 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53bcbe-bae7-4add-bc96-c1603388fbcf None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:21.251810 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53bcbe-bae7-4add-bc96-c1603388fbcf None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:21.252180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53bcbe-bae7-4add-bc96-c1603388fbcf None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:21.252839 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b1f1dd8b-346a-4152-a4d9-03d8d35da153 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:21.252958 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53bcbe-bae7-4add-bc96-c1603388fbcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:21.253168 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53bcbe-bae7-4add-bc96-c1603388fbcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:21.254057 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b1f1dd8b-346a-4152-a4d9-03d8d35da153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:21.254585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53bcbe-bae7-4add-bc96-c1603388fbcf None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:21.274982 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 322/639] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:21.274982 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53bcbe-bae7-4add-bc96-c1603388fbcf None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:21.335302 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 318/640] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:21.336472 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1dd8b-346a-4152-a4d9-03d8d35da153 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:21.392224 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53bcbe-bae7-4add-bc96-c1603388fbcf None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:21.431225 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e85e3-c933-4f77-ae46-d963ff76bb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:21.432235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e85e3-c933-4f77-ae46-d963ff76bb40 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:21.432745 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e85e3-c933-4f77-ae46-d963ff76bb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:21.433223 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e85e3-c933-4f77-ae46-d963ff76bb40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:21.449182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e85e3-c933-4f77-ae46-d963ff76bb40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:21.451416 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e85e3-c933-4f77-ae46-d963ff76bb40 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:21.468615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-3f1e85e3-c933-4f77-ae46-d963ff76bb40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:21.468615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:21.468615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:21.468615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:21.468615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:21.468615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:21.468615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:21.468615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:21.468615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:21.468615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:21.468615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:21.468615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:21.468615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:21.468615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:21.468615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:21.468615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:21.469594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:21.469594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:21.469594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:21.469594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:21.469594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:21.469594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:21.469594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:21.469594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:21.469594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:21.469594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:21.469594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:21.469594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:21.469594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:21.469594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:21.469594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:21.469594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:21.469594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:21.470505 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:21.470505 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:21.470505 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:21.471133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1dd8b-346a-4152-a4d9-03d8d35da153 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:21.472833 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 323/641] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:21.473370 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:21.474655 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e85e3-c933-4f77-ae46-d963ff76bb40 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:21.517810 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bda42-3063-407e-8ba7-cfef77ea1352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:21.518425 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bda42-3063-407e-8ba7-cfef77ea1352 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:21.518705 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bda42-3063-407e-8ba7-cfef77ea1352 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:21.518978 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bda42-3063-407e-8ba7-cfef77ea1352 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:21.519698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bda42-3063-407e-8ba7-cfef77ea1352 None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:21.520695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bda42-3063-407e-8ba7-cfef77ea1352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:21.522617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bda42-3063-407e-8ba7-cfef77ea1352 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:21.524901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:21.538758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 319/642] 10.222.0.96 () {56 vars in 1103 bytes} [Wed Aug 24 04:18:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:21.538758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bda42-3063-407e-8ba7-cfef77ea1352 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:21.601702 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e85e3-c933-4f77-ae46-d963ff76bb40 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:21.637361 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170ac5d-761d-40a9-ad2c-ad35b4007d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:21.638004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170ac5d-761d-40a9-ad2c-ad35b4007d66 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:21.638288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170ac5d-761d-40a9-ad2c-ad35b4007d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:21.638567 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170ac5d-761d-40a9-ad2c-ad35b4007d66 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:21.646855 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170ac5d-761d-40a9-ad2c-ad35b4007d66 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:21.648303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170ac5d-761d-40a9-ad2c-ad35b4007d66 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:21.659369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-9170ac5d-761d-40a9-ad2c-ad35b4007d66 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:18:21.659369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:21.659369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:21.659369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:21.659369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:21.659369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:21.659369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:21.659369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:21.659369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:21.659369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:21.659369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:21.659369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:21.659369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:21.659369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:21.659369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:21.659369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:21.660397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:21.660397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:21.660397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:21.660397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:21.660397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:21.660397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:21.660397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:21.660397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:21.660397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:21.660397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:21.660397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:21.660397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:21.660397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:21.660397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:21.660397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:21.660397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:21.660397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:21.660397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:21.662038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:21.662038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:21.662038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:21.662038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:21.662038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:21.662038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:21.662038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:21.662038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:21.662038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:18:21.662038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:21.662038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 324/643] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:18:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:21.662038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170ac5d-761d-40a9-ad2c-ad35b4007d66 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:21.669282 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bda42-3063-407e-8ba7-cfef77ea1352 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:21.706166 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3e724-ac75-4270-9481-ebf4d50978a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:21.706845 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3e724-ac75-4270-9481-ebf4d50978a7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:21.707202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3e724-ac75-4270-9481-ebf4d50978a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:21.708001 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3e724-ac75-4270-9481-ebf4d50978a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:21.708651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3e724-ac75-4270-9481-ebf4d50978a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:21.708984 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3e724-ac75-4270-9481-ebf4d50978a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:21.710359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3e724-ac75-4270-9481-ebf4d50978a7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:21.726634 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 320/644] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:21.726634 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3e724-ac75-4270-9481-ebf4d50978a7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:21.752594 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:21.768930 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:21.773475 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170ac5d-761d-40a9-ad2c-ad35b4007d66 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:21.810355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8257c-c834-4f0d-9ace-cc1f85bdb7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:21.810986 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8257c-c834-4f0d-9ace-cc1f85bdb7be None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:21.811268 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8257c-c834-4f0d-9ace-cc1f85bdb7be None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:21.811543 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8257c-c834-4f0d-9ace-cc1f85bdb7be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:21.824218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8257c-c834-4f0d-9ace-cc1f85bdb7be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:21.825730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8257c-c834-4f0d-9ace-cc1f85bdb7be None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:21.840606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3e724-ac75-4270-9481-ebf4d50978a7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:21.841353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-69f8257c-c834-4f0d-9ace-cc1f85bdb7be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:21.841353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:21.841353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:21.841353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:21.841353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:21.841353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:21.841353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:21.841353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:21.841353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:21.841353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:21.841353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:21.841353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:21.841353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:21.841353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:21.841353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:21.841353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:21.842263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:21.842263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:21.842263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:21.842263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:21.842263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:21.842263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:21.842263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:21.842263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:21.842263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:21.842263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:21.842263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:21.842263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:21.842263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:21.842263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:21.842263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:21.842263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:21.842263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:21.844031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:21.844031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:21.844031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:21.844031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 325/645] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:21.844031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8257c-c834-4f0d-9ace-cc1f85bdb7be None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:21.885040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbda257-eddf-4abc-8d0c-df7692335c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:21.885667 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbda257-eddf-4abc-8d0c-df7692335c5d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:21.885947 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbda257-eddf-4abc-8d0c-df7692335c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:21.886218 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbda257-eddf-4abc-8d0c-df7692335c5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:21.897329 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbda257-eddf-4abc-8d0c-df7692335c5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:21.902347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-adbda257-eddf-4abc-8d0c-df7692335c5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:21.902347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:21.902347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:21.902347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:21.902347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:21.902347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:21.902347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:21.902347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:21.902347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:21.902347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:21.902347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:21.902347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:21.902347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:21.902347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:21.902347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:21.902347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:21.903277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:21.903277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:21.903277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:21.903277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:21.903277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:21.903277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:21.903277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:21.903277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:21.903277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:21.903277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:21.903277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:21.903277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:21.903277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:21.903277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:21.903277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:21.903277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:21.904118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:21.904118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:21.904118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:21.904118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:21.904118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:21.904118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:21.904118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:21.904118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:21.904118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:21.904118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:21.904118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:21.904118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:21.904118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 321/646] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:18:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:21.905558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbda257-eddf-4abc-8d0c-df7692335c5d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:21.958119 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8257c-c834-4f0d-9ace-cc1f85bdb7be None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:21.995098 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1c19f-090c-400e-85b0-a959fce36fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:21.995713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1c19f-090c-400e-85b0-a959fce36fdf None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:21.995999 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1c19f-090c-400e-85b0-a959fce36fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:21.996278 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1c19f-090c-400e-85b0-a959fce36fdf None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:21.997046 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1c19f-090c-400e-85b0-a959fce36fdf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:21.997359 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1c19f-090c-400e-85b0-a959fce36fdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:21.998796 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1c19f-090c-400e-85b0-a959fce36fdf None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:21.999698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:22.016552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbda257-eddf-4abc-8d0c-df7692335c5d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:22.028369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 326/647] 10.222.0.96 () {56 vars in 1137 bytes} [Wed Aug 24 04:18:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:22.028369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1c19f-090c-400e-85b0-a959fce36fdf None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:22.042389 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:22.052729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49999b60-381d-49f0-9599-c0bd081569aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:22.053369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49999b60-381d-49f0-9599-c0bd081569aa None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:22.053655 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49999b60-381d-49f0-9599-c0bd081569aa None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:22.053974 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49999b60-381d-49f0-9599-c0bd081569aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:22.060896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49999b60-381d-49f0-9599-c0bd081569aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:22.062335 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49999b60-381d-49f0-9599-c0bd081569aa None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:22.074781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-49999b60-381d-49f0-9599-c0bd081569aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:22.074781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:22.074781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:22.074781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:22.074781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:22.074781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:22.074781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:22.074781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:22.074781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:22.074781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:22.074781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:22.074781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:22.074781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:22.074781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:22.074781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:22.075729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:22.075729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:22.075729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:22.075729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:22.075729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:22.075729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:22.075729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:22.075729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:22.075729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:22.075729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:22.075729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:22.075729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:22.075729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:22.075729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:22.075729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:22.075729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:22.075729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:22.076637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:22.076637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:22.076637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:22.076637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:22.076637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:22.076637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:22.076637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:22.076637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:22.076637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 322/648] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:22.076637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49999b60-381d-49f0-9599-c0bd081569aa None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:22.143275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1c19f-090c-400e-85b0-a959fce36fdf None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:22.181233 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939e901-f404-4359-80df-c14b8aa4780c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:22.181853 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939e901-f404-4359-80df-c14b8aa4780c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:22.182143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939e901-f404-4359-80df-c14b8aa4780c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:22.182425 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939e901-f404-4359-80df-c14b8aa4780c None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:22.183078 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939e901-f404-4359-80df-c14b8aa4780c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:22.183389 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939e901-f404-4359-80df-c14b8aa4780c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:22.184807 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939e901-f404-4359-80df-c14b8aa4780c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:22.188412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49999b60-381d-49f0-9599-c0bd081569aa None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:22.197065 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 327/649] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:22.197894 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939e901-f404-4359-80df-c14b8aa4780c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:22.231038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2ebb2-66b6-4c37-813a-0b137174200f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:22.231614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2ebb2-66b6-4c37-813a-0b137174200f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:22.231906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2ebb2-66b6-4c37-813a-0b137174200f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:22.232185 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2ebb2-66b6-4c37-813a-0b137174200f None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:22.232886 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2ebb2-66b6-4c37-813a-0b137174200f None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:22.233198 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2ebb2-66b6-4c37-813a-0b137174200f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:22.234581 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2ebb2-66b6-4c37-813a-0b137174200f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:22.243625 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 323/650] 10.222.0.96 () {56 vars in 1103 bytes} [Wed Aug 24 04:18:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:22.244426 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2ebb2-66b6-4c37-813a-0b137174200f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:22.259643 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:22.284553 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:22.330927 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939e901-f404-4359-80df-c14b8aa4780c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:22.358028 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2ebb2-66b6-4c37-813a-0b137174200f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:22.369107 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513bdc2-8b6b-4f00-962d-605241a773a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:22.369799 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513bdc2-8b6b-4f00-962d-605241a773a6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:22.370051 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513bdc2-8b6b-4f00-962d-605241a773a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:22.370256 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513bdc2-8b6b-4f00-962d-605241a773a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:22.393322 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31129cb-2421-426b-9588-451f3bb75adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:22.393922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31129cb-2421-426b-9588-451f3bb75adf None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:22.394204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31129cb-2421-426b-9588-451f3bb75adf None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:22.394472 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31129cb-2421-426b-9588-451f3bb75adf None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:22.395170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31129cb-2421-426b-9588-451f3bb75adf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:22.395476 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31129cb-2421-426b-9588-451f3bb75adf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:22.396947 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31129cb-2421-426b-9588-451f3bb75adf None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:22.415490 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 324/651] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:22.415490 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31129cb-2421-426b-9588-451f3bb75adf None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:22.447349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513bdc2-8b6b-4f00-962d-605241a773a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:22.448849 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513bdc2-8b6b-4f00-962d-605241a773a6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:22.487707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:22.523512 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:22.525257 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31129cb-2421-426b-9588-451f3bb75adf None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:22.558857 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 328/652] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:18:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:22.559532 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513bdc2-8b6b-4f00-962d-605241a773a6 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:22.566638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e40d02-3ea1-45e6-87bd-5021c8daf1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:22.567386 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e40d02-3ea1-45e6-87bd-5021c8daf1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:22.567984 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e40d02-3ea1-45e6-87bd-5021c8daf1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:22.567984 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e40d02-3ea1-45e6-87bd-5021c8daf1f9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:22.576154 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e40d02-3ea1-45e6-87bd-5021c8daf1f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:22.577627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e40d02-3ea1-45e6-87bd-5021c8daf1f9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:22.590262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-c2e40d02-3ea1-45e6-87bd-5021c8daf1f9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:18:22.590262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:22.590262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:22.590262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:22.590262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:22.590262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:22.590262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:22.590262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:22.590262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:22.590262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:22.590262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:22.590262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:22.590262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:22.590262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:22.590262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:22.590262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:22.591226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:22.591226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:22.591226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:22.591226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:22.591226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:22.591226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:22.591226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:22.591226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:22.591226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:22.591226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:22.591226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:22.591226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:22.591226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:22.591226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:22.591226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:22.591226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:22.591226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:22.591226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:22.592194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:22.592194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:22.592194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:22.592194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:22.592194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:22.592194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:22.592194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:22.592194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:22.592194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:18:22.592194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:22.592194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 325/653] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:18:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:22.592194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e40d02-3ea1-45e6-87bd-5021c8daf1f9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:22.672362 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513bdc2-8b6b-4f00-962d-605241a773a6 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:22.703837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e40d02-3ea1-45e6-87bd-5021c8daf1f9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:22.710062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5413dc9-2aea-40e6-89cf-a927d869a824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:22.710892 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5413dc9-2aea-40e6-89cf-a927d869a824 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:22.711376 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5413dc9-2aea-40e6-89cf-a927d869a824 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:22.711871 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5413dc9-2aea-40e6-89cf-a927d869a824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:22.724641 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5413dc9-2aea-40e6-89cf-a927d869a824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:22.728672 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5413dc9-2aea-40e6-89cf-a927d869a824 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:22.734639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:22.745918 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b9907-1c60-4375-8dcb-0afc48f7404d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:22.746455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b9907-1c60-4375-8dcb-0afc48f7404d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:22.746740 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b9907-1c60-4375-8dcb-0afc48f7404d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:22.747016 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b9907-1c60-4375-8dcb-0afc48f7404d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:22.747754 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b9907-1c60-4375-8dcb-0afc48f7404d None admin] RBAC: Adding query filter params (role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=3539784b4e91472eb20addc6707dc30d) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:22.748066 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b9907-1c60-4375-8dcb-0afc48f7404d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:22.748160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-c5413dc9-2aea-40e6-89cf-a927d869a824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:22.748160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:22.748160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:22.748160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:22.748160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:22.748160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:22.748160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:22.748160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:22.748160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:22.748160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:22.748160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:22.748160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:22.748160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:22.748160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:22.748160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:22.748160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:22.749074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:22.749074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:22.749074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:22.749074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:22.749074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:22.749074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:22.749074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:22.749074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:22.749074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:22.749074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:22.749074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:22.749074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:22.749074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:22.749074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:22.749074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:22.749074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:22.749074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:22.754829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:22.754829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:22.754829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:22.755007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b9907-1c60-4375-8dcb-0afc48f7404d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:22.755081 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 329/654] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:22.755081 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5413dc9-2aea-40e6-89cf-a927d869a824 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:22.756712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 326/655] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:18:22 2022] GET /identity/v3/role_assignments?user.id=3539784b4e91472eb20addc6707dc30d&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:22.757213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b9907-1c60-4375-8dcb-0afc48f7404d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:22.787768 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:22.881445 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b9907-1c60-4375-8dcb-0afc48f7404d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:22.885485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5413dc9-2aea-40e6-89cf-a927d869a824 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:22.926890 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c04bc-7475-4c4b-b860-9f936d592268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:22.927519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c04bc-7475-4c4b-b860-9f936d592268 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:22.927781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c04bc-7475-4c4b-b860-9f936d592268 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:22.928068 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c04bc-7475-4c4b-b860-9f936d592268 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:22.928857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c04bc-7475-4c4b-b860-9f936d592268 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:22.929164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c04bc-7475-4c4b-b860-9f936d592268 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:22.931478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c04bc-7475-4c4b-b860-9f936d592268 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:22.932502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d70bc8-aecf-474b-ab57-bf447d8c3fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:22.932737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d70bc8-aecf-474b-ab57-bf447d8c3fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:22.933092 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d70bc8-aecf-474b-ab57-bf447d8c3fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:22.934206 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d70bc8-aecf-474b-ab57-bf447d8c3fc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:22.945609 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d70bc8-aecf-474b-ab57-bf447d8c3fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:22.948949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d70bc8-aecf-474b-ab57-bf447d8c3fc5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:22.954993 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 327/656] 10.222.0.96 () {56 vars in 1137 bytes} [Wed Aug 24 04:18:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:22.955834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c04bc-7475-4c4b-b860-9f936d592268 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:22.970186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-40d70bc8-aecf-474b-ab57-bf447d8c3fc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:22.970186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:22.970186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:22.970186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:22.970186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:22.970186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:22.970186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:22.970186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:22.970186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:22.970186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:22.970186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:22.970186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:22.970186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:22.970186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:22.970186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:22.970186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:22.971178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:22.971178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:22.971178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:22.971178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:22.971178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:22.971178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:22.971178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:22.971178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:22.971178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:22.971178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:22.971178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:22.971178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:22.971178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:22.971178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:22.971178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:22.971178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:22.971178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:22.972074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:22.972074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:22.972074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:22.973220 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 330/657] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:22.974243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c81f4-dbd1-493a-93a9-4e1b7fc8d0f0 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:22.974533 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c81f4-dbd1-493a-93a9-4e1b7fc8d0f0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:22.974814 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c81f4-dbd1-493a-93a9-4e1b7fc8d0f0 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:22.976410 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 331/658] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:22.981438 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c81f4-dbd1-493a-93a9-4e1b7fc8d0f0 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:23.031043 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:23.104593 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:23.112364 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c04bc-7475-4c4b-b860-9f936d592268 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:23.135955 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c81f4-dbd1-493a-93a9-4e1b7fc8d0f0 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:23.153661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fdf4d-1f3c-4508-8cab-b01d058bb270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:23.154753 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fdf4d-1f3c-4508-8cab-b01d058bb270 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:23.155944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fdf4d-1f3c-4508-8cab-b01d058bb270 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:23.156374 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fdf4d-1f3c-4508-8cab-b01d058bb270 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:23.157247 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fdf4d-1f3c-4508-8cab-b01d058bb270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:23.157723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fdf4d-1f3c-4508-8cab-b01d058bb270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:23.159264 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fdf4d-1f3c-4508-8cab-b01d058bb270 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:23.174467 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 328/659] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:23.175318 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fdf4d-1f3c-4508-8cab-b01d058bb270 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:23.180179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8fbfe-850d-42eb-b0f3-d357cca3d45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:23.181414 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8fbfe-850d-42eb-b0f3-d357cca3d45a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:23.181700 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8fbfe-850d-42eb-b0f3-d357cca3d45a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:23.181976 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8fbfe-850d-42eb-b0f3-d357cca3d45a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:23.264612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8fbfe-850d-42eb-b0f3-d357cca3d45a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:23.266170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8fbfe-850d-42eb-b0f3-d357cca3d45a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:23.299240 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fdf4d-1f3c-4508-8cab-b01d058bb270 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:23.311453 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:23.344126 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a05b7-ccc6-4a6d-a0fa-edf6eddac2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:23.344774 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a05b7-ccc6-4a6d-a0fa-edf6eddac2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:23.345059 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a05b7-ccc6-4a6d-a0fa-edf6eddac2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:23.345336 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a05b7-ccc6-4a6d-a0fa-edf6eddac2b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:23.345987 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a05b7-ccc6-4a6d-a0fa-edf6eddac2b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:23.346351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a05b7-ccc6-4a6d-a0fa-edf6eddac2b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:23.347830 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a05b7-ccc6-4a6d-a0fa-edf6eddac2b0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:23.365230 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 329/660] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:23.365230 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02180953-aa76-4d97-8035-f441f0ba73b1 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:23.365230 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02180953-aa76-4d97-8035-f441f0ba73b1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:23.365230 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02180953-aa76-4d97-8035-f441f0ba73b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:23.368476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:23.385133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-02180953-aa76-4d97-8035-f441f0ba73b1 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:23.387009 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-02180953-aa76-4d97-8035-f441f0ba73b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:23.408848 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 332/661] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:18:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:23.412118 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8fbfe-850d-42eb-b0f3-d357cca3d45a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:23.479620 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 330/662] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:23.480473 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02180953-aa76-4d97-8035-f441f0ba73b1 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:23.548515 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8fbfe-850d-42eb-b0f3-d357cca3d45a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:23.591826 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917682a-cb69-4cd7-8dbf-bfdfe8b18ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:23.592895 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917682a-cb69-4cd7-8dbf-bfdfe8b18ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:23.593277 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917682a-cb69-4cd7-8dbf-bfdfe8b18ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:23.593803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917682a-cb69-4cd7-8dbf-bfdfe8b18ca6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:23.594566 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:23.598108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02180953-aa76-4d97-8035-f441f0ba73b1 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:23.604440 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917682a-cb69-4cd7-8dbf-bfdfe8b18ca6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:23.605919 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917682a-cb69-4cd7-8dbf-bfdfe8b18ca6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:23.622023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-9917682a-cb69-4cd7-8dbf-bfdfe8b18ca6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:18:23.622023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:23.622023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:23.622023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:23.622023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:23.622023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:23.622023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:23.622023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:23.622023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:23.622023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:23.622023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:23.622023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:23.622023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:23.622023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:23.622023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:23.622023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:23.622998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:23.622998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:23.622998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:23.622998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:23.622998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:23.622998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:23.622998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:23.622998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:23.622998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:23.622998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:23.622998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:23.622998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:23.622998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:23.622998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:23.622998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:23.622998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:23.622998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:23.622998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:23.623941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:23.623941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:23.623941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:23.623941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:23.623941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:23.623941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:23.623941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:23.623941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:23.623941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:18:23.623941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:23.627958 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 333/663] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:18:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:23.628801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917682a-cb69-4cd7-8dbf-bfdfe8b18ca6 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:23.643121 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765dc93-b73a-493c-845b-1b2975ccf208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:23.644057 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765dc93-b73a-493c-845b-1b2975ccf208 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:23.644586 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765dc93-b73a-493c-845b-1b2975ccf208 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:23.645299 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765dc93-b73a-493c-845b-1b2975ccf208 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:23.652620 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765dc93-b73a-493c-845b-1b2975ccf208 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:23.654315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765dc93-b73a-493c-845b-1b2975ccf208 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:23.666675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-d765dc93-b73a-493c-845b-1b2975ccf208 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:23.666675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:23.666675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:23.666675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:23.666675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:23.666675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:23.666675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:23.666675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:23.666675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:23.666675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:23.666675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:23.666675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:23.666675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:23.666675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:23.666675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:23.667687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:23.667687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:23.667687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:23.667687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:23.667687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:23.667687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:23.667687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:23.667687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:23.667687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:23.667687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:23.667687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:23.667687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:23.667687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:23.667687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:23.667687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:23.667687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:23.667687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:23.668582 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:23.668582 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:23.668582 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:23.668582 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:23.668582 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:23.668582 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:23.668582 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:23.668582 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:23.670971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 331/664] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:23.671123 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:23.677381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765dc93-b73a-493c-845b-1b2975ccf208 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:23.762126 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917682a-cb69-4cd7-8dbf-bfdfe8b18ca6 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:23.797320 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3dd3a8-c6b5-4344-bc8d-3bdf0bb6cd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:23.797955 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dd3a8-c6b5-4344-bc8d-3bdf0bb6cd70 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:23.798222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dd3a8-c6b5-4344-bc8d-3bdf0bb6cd70 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:23.798499 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dd3a8-c6b5-4344-bc8d-3bdf0bb6cd70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:23.805704 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765dc93-b73a-493c-845b-1b2975ccf208 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:23.809878 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3dd3a8-c6b5-4344-bc8d-3bdf0bb6cd70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:23.811340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3dd3a8-c6b5-4344-bc8d-3bdf0bb6cd70 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:23.829013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-3b3dd3a8-c6b5-4344-bc8d-3bdf0bb6cd70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:23.829013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:23.829013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:23.829013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:23.829013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:23.829013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:23.829013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:23.829013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:23.829013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:23.829013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:23.829013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:23.829013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:23.829013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:23.829013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:23.829013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:23.829013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:23.830170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:23.830170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:23.830170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:23.830170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:23.830170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:23.830170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:23.830170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:23.830170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:23.830170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:23.830170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:23.830170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:23.830170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:23.830170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:23.830170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:23.830170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:23.830170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:23.830170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:23.831253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:23.831253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:23.831253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:23.831253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 334/665] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:23.831253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3dd3a8-c6b5-4344-bc8d-3bdf0bb6cd70 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:23.853360 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427444b0-3eb0-4663-8304-beab2b18ffef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:23.853891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427444b0-3eb0-4663-8304-beab2b18ffef None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:23.854175 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427444b0-3eb0-4663-8304-beab2b18ffef None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:23.854451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427444b0-3eb0-4663-8304-beab2b18ffef None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:23.855195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427444b0-3eb0-4663-8304-beab2b18ffef None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:23.855510 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427444b0-3eb0-4663-8304-beab2b18ffef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:23.856989 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427444b0-3eb0-4663-8304-beab2b18ffef None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:23.879643 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 332/666] 10.222.0.96 () {56 vars in 1139 bytes} [Wed Aug 24 04:18:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:23.879643 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427444b0-3eb0-4663-8304-beab2b18ffef None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:23.898480 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:23.928576 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:23.948068 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3dd3a8-c6b5-4344-bc8d-3bdf0bb6cd70 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:23.982980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893bb52-d5ed-4547-ba48-5bf460dfdb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:23.983591 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893bb52-d5ed-4547-ba48-5bf460dfdb01 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:23.983874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893bb52-d5ed-4547-ba48-5bf460dfdb01 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:23.984164 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893bb52-d5ed-4547-ba48-5bf460dfdb01 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:23.984866 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893bb52-d5ed-4547-ba48-5bf460dfdb01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:23.985178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893bb52-d5ed-4547-ba48-5bf460dfdb01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:23.986636 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893bb52-d5ed-4547-ba48-5bf460dfdb01 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:23.994335 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427444b0-3eb0-4663-8304-beab2b18ffef None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:24.005236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 335/667] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:24.005236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893bb52-d5ed-4547-ba48-5bf460dfdb01 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:24.034734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2f70c-d687-457d-b572-3be43c819e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:24.036130 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2f70c-d687-457d-b572-3be43c819e52 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:24.036477 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2f70c-d687-457d-b572-3be43c819e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:24.036862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2f70c-d687-457d-b572-3be43c819e52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:24.047619 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2f70c-d687-457d-b572-3be43c819e52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:24.052498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-95b2f70c-d687-457d-b572-3be43c819e52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:24.052498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:24.052498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:24.052498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:24.052498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:24.052498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:24.052498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:24.052498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:24.052498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:24.052498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:24.052498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:24.052498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:24.052498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:24.052498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:24.052498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:24.052498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:24.053610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:24.053610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:24.053610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:24.053610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:24.053610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:24.053610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:24.053610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:24.053610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:24.053610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:24.053610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:24.053610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:24.053610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:24.053610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:24.053610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:24.053610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:24.053610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:24.054661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:24.054661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:24.054661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:24.054661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:24.054661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:24.054661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:24.054661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:24.054661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:24.054661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:24.054661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:24.054661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:24.054661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:24.055530 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 333/668] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:18:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:24.056331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2f70c-d687-457d-b572-3be43c819e52 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:24.116662 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893bb52-d5ed-4547-ba48-5bf460dfdb01 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:24.135499 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:24.152465 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d936c4-c5cc-433d-a35a-48a00c3e12d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:24.153103 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d936c4-c5cc-433d-a35a-48a00c3e12d2 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:24.153383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d936c4-c5cc-433d-a35a-48a00c3e12d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:24.153658 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d936c4-c5cc-433d-a35a-48a00c3e12d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:24.154301 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d936c4-c5cc-433d-a35a-48a00c3e12d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:24.154603 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d936c4-c5cc-433d-a35a-48a00c3e12d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:24.155973 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d936c4-c5cc-433d-a35a-48a00c3e12d2 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:24.161152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2f70c-d687-457d-b572-3be43c819e52 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:24.172453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 336/669] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:24.172453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d936c4-c5cc-433d-a35a-48a00c3e12d2 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:24.182167 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:24.201612 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d18b2-81ca-41bf-ae9c-2bdba6b2786c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:24.202224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d18b2-81ca-41bf-ae9c-2bdba6b2786c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:24.202506 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d18b2-81ca-41bf-ae9c-2bdba6b2786c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:24.202783 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d18b2-81ca-41bf-ae9c-2bdba6b2786c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:24.273437 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d18b2-81ca-41bf-ae9c-2bdba6b2786c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:24.275075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d18b2-81ca-41bf-ae9c-2bdba6b2786c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:24.283285 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d936c4-c5cc-433d-a35a-48a00c3e12d2 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:24.319266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1584e-f6a9-4e97-b51c-7e054801689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:24.319879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1584e-f6a9-4e97-b51c-7e054801689b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:24.320159 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1584e-f6a9-4e97-b51c-7e054801689b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:24.320441 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1584e-f6a9-4e97-b51c-7e054801689b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:24.321467 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1584e-f6a9-4e97-b51c-7e054801689b None admin] RBAC: Adding query filter params (role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=b182bf0bbbcf4a808626443c6c2a7a6a) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:24.321781 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1584e-f6a9-4e97-b51c-7e054801689b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:24.323257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1584e-f6a9-4e97-b51c-7e054801689b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:24.329418 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 337/670] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:18:24 2022] GET /identity/v3/role_assignments?user.id=b182bf0bbbcf4a808626443c6c2a7a6a&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:24.330031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1584e-f6a9-4e97-b51c-7e054801689b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:24.383378 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:24.420854 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 334/671] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:18:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:24.421901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d18b2-81ca-41bf-ae9c-2bdba6b2786c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:24.444791 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:24.489364 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1584e-f6a9-4e97-b51c-7e054801689b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:24.533824 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083c995-1d0c-4c67-a5fe-7637c1609b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:24.534444 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083c995-1d0c-4c67-a5fe-7637c1609b90 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:24.534727 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083c995-1d0c-4c67-a5fe-7637c1609b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:24.535062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083c995-1d0c-4c67-a5fe-7637c1609b90 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:24.535912 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083c995-1d0c-4c67-a5fe-7637c1609b90 None admin] RBAC: Adding query filter params (name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:24.536414 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083c995-1d0c-4c67-a5fe-7637c1609b90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:24.538715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083c995-1d0c-4c67-a5fe-7637c1609b90 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:24.547688 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 338/672] 10.222.0.96 () {56 vars in 1103 bytes} [Wed Aug 24 04:18:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:24.548548 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083c995-1d0c-4c67-a5fe-7637c1609b90 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:24.565303 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d18b2-81ca-41bf-ae9c-2bdba6b2786c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:24.605985 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73029551-f81d-43c6-993d-928b1feac33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:24.606627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73029551-f81d-43c6-993d-928b1feac33f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:24.606913 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73029551-f81d-43c6-993d-928b1feac33f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:24.607187 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73029551-f81d-43c6-993d-928b1feac33f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:24.616007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73029551-f81d-43c6-993d-928b1feac33f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:24.618183 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73029551-f81d-43c6-993d-928b1feac33f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:24.634892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-73029551-f81d-43c6-993d-928b1feac33f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:24.634892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:24.634892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:24.634892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:24.634892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:24.634892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:24.634892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:24.634892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:24.634892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:24.634892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:24.634892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:24.634892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:24.634892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:24.634892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:24.634892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:24.635856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:24.635856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:24.635856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:24.635856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:24.635856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:24.635856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:24.635856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:24.635856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:24.635856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:24.635856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:24.635856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:24.635856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:24.635856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:24.635856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:24.635856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:24.635856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:24.635856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:24.636884 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:24.636884 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:24.636884 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:24.636884 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:24.636884 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:24.636884 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:24.636884 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:24.636884 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:24.636884 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 335/673] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:24.637369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73029551-f81d-43c6-993d-928b1feac33f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:24.681148 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083c995-1d0c-4c67-a5fe-7637c1609b90 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:24.685641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:24.720594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:24.728619 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f74744-a9af-4c30-9165-479e75f62790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:24.729846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f74744-a9af-4c30-9165-479e75f62790 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:24.730325 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f74744-a9af-4c30-9165-479e75f62790 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:24.730776 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f74744-a9af-4c30-9165-479e75f62790 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:24.746673 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f74744-a9af-4c30-9165-479e75f62790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:24.748875 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f74744-a9af-4c30-9165-479e75f62790 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:24.760958 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73029551-f81d-43c6-993d-928b1feac33f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:24.765653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-92f74744-a9af-4c30-9165-479e75f62790 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:24.765653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:24.765653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:24.765653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:24.765653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:24.765653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:24.765653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:24.765653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:24.765653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:24.765653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:24.765653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:24.765653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:24.765653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:24.765653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:24.765653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:24.765653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:24.766596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:24.766596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:24.766596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:24.766596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:24.766596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:24.766596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:24.766596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:24.766596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:24.766596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:24.766596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:24.766596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:24.766596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:24.766596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:24.766596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:24.766596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:24.766596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:24.766596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:24.767486 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:24.767486 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:24.767486 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:24.767486 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 339/674] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:24.767707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f74744-a9af-4c30-9165-479e75f62790 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:24.805221 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550cd8b-fc3f-41f2-b20d-b21f92be6568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:24.805862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550cd8b-fc3f-41f2-b20d-b21f92be6568 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:24.806424 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550cd8b-fc3f-41f2-b20d-b21f92be6568 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:24.806424 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550cd8b-fc3f-41f2-b20d-b21f92be6568 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:24.817962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550cd8b-fc3f-41f2-b20d-b21f92be6568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:24.819404 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550cd8b-fc3f-41f2-b20d-b21f92be6568 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:24.835996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-b550cd8b-fc3f-41f2-b20d-b21f92be6568 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:24.835996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:24.835996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:24.835996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:24.835996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:24.835996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:24.835996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:24.835996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:24.835996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:24.835996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:24.835996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:24.835996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:24.835996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:24.835996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:24.835996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:24.835996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:24.836976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:24.836976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:24.836976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:24.836976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:24.836976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:24.836976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:24.836976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:24.836976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:24.836976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:24.836976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:24.836976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:24.836976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:24.836976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:24.836976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:24.836976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:24.836976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:24.836976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:24.843107 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:24.843107 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:24.843107 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:24.843107 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 336/675] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:24.843107 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550cd8b-fc3f-41f2-b20d-b21f92be6568 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:24.904179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f74744-a9af-4c30-9165-479e75f62790 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:24.937046 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:24.946451 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669e978-f18a-4f53-88a5-7c12fd198e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:24.947062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669e978-f18a-4f53-88a5-7c12fd198e79 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:24.947344 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669e978-f18a-4f53-88a5-7c12fd198e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:24.947617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669e978-f18a-4f53-88a5-7c12fd198e79 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:24.948309 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669e978-f18a-4f53-88a5-7c12fd198e79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:24.948617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669e978-f18a-4f53-88a5-7c12fd198e79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:24.949148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550cd8b-fc3f-41f2-b20d-b21f92be6568 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:24.950077 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f669e978-f18a-4f53-88a5-7c12fd198e79 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:24.968119 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 340/676] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:24.968119 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10014f7e-8ecb-4959-b242-6ccf68c8c7c5 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:24.968119 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10014f7e-8ecb-4959-b242-6ccf68c8c7c5 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:24.968119 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10014f7e-8ecb-4959-b242-6ccf68c8c7c5 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:24.968119 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 341/677] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:24.968119 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10014f7e-8ecb-4959-b242-6ccf68c8c7c5 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:24.990621 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb3185-df2e-4a6f-8225-2cf949998281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:24.991246 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb3185-df2e-4a6f-8225-2cf949998281 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:24.991528 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb3185-df2e-4a6f-8225-2cf949998281 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:24.991802 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb3185-df2e-4a6f-8225-2cf949998281 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:24.992449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb3185-df2e-4a6f-8225-2cf949998281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:24.992823 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb3185-df2e-4a6f-8225-2cf949998281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:24.994210 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb3185-df2e-4a6f-8225-2cf949998281 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:25.007110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 337/678] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:25.009705 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb3185-df2e-4a6f-8225-2cf949998281 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:25.026600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:25.087438 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10014f7e-8ecb-4959-b242-6ccf68c8c7c5 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:25.123328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6259e-cb56-4408-9d99-9956705eeb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:25.123946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6259e-cb56-4408-9d99-9956705eeb75 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:25.124232 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6259e-cb56-4408-9d99-9956705eeb75 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:25.124504 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6259e-cb56-4408-9d99-9956705eeb75 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:25.125214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6259e-cb56-4408-9d99-9956705eeb75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:25.125526 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6259e-cb56-4408-9d99-9956705eeb75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:25.126910 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6259e-cb56-4408-9d99-9956705eeb75 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:25.131610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb3185-df2e-4a6f-8225-2cf949998281 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:25.139055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 342/679] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:25.140080 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cf633-613f-43b9-98b6-67ebbf7094e9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:25.140372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cf633-613f-43b9-98b6-67ebbf7094e9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:25.140650 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cf633-613f-43b9-98b6-67ebbf7094e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:25.158656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-293cf633-613f-43b9-98b6-67ebbf7094e9 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:25.159850 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-293cf633-613f-43b9-98b6-67ebbf7094e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:25.174724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd86496-0397-43f2-bfb8-302729e8592e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:25.175332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd86496-0397-43f2-bfb8-302729e8592e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:25.175613 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd86496-0397-43f2-bfb8-302729e8592e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:25.175965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd86496-0397-43f2-bfb8-302729e8592e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:25.177587 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd86496-0397-43f2-bfb8-302729e8592e None admin] RBAC: Adding query filter params (role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=6106a46199b74f649cd29a0d02610049) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:25.177902 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd86496-0397-43f2-bfb8-302729e8592e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:25.179316 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd86496-0397-43f2-bfb8-302729e8592e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:25.185107 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 338/680] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:18:25 2022] GET /identity/v3/role_assignments?user.id=6106a46199b74f649cd29a0d02610049&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:25.185892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd86496-0397-43f2-bfb8-302729e8592e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:25.206941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:25.272970 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 343/681] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:25.272970 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cf633-613f-43b9-98b6-67ebbf7094e9 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:25.345495 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd86496-0397-43f2-bfb8-302729e8592e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:25.354650 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:25.392028 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad6a41-d786-4b8c-ab65-12935421d216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:25.393066 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad6a41-d786-4b8c-ab65-12935421d216 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:25.393526 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad6a41-d786-4b8c-ab65-12935421d216 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:25.394187 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad6a41-d786-4b8c-ab65-12935421d216 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:25.402987 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad6a41-d786-4b8c-ab65-12935421d216 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:25.405569 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad6a41-d786-4b8c-ab65-12935421d216 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:25.420463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-fdad6a41-d786-4b8c-ab65-12935421d216 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:25.420463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:25.420463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:25.420463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:25.420463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:25.420463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:25.420463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:25.420463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:25.420463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:25.420463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:25.420463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:25.420463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:25.420463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:25.420463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:25.420463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:25.421577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:25.421577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:25.421577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:25.421577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:25.421577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:25.421577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:25.421577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:25.421577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:25.421577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:25.421577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:25.421577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:25.421577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:25.421577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:25.421577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:25.421577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:25.421577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:25.421577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:25.422671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:25.422671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:25.422671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:25.422671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:25.422671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:25.422671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:25.422671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:25.422671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:25.425203 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 339/682] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:25.432081 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad6a41-d786-4b8c-ab65-12935421d216 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:25.443823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cf633-613f-43b9-98b6-67ebbf7094e9 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:25.486885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b574d-fd65-407f-94a2-bc7cec0a0893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:25.487617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b574d-fd65-407f-94a2-bc7cec0a0893 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:25.487968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b574d-fd65-407f-94a2-bc7cec0a0893 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:25.488337 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b574d-fd65-407f-94a2-bc7cec0a0893 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:25.499182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b574d-fd65-407f-94a2-bc7cec0a0893 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:25.501308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b574d-fd65-407f-94a2-bc7cec0a0893 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:25.523059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-e83b574d-fd65-407f-94a2-bc7cec0a0893 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:18:25.523059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:25.523059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:25.523059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:25.523059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:25.523059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:25.523059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:25.523059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:25.523059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:25.523059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:25.523059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:25.523059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:25.523059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:25.523059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:25.523059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:25.523059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:25.524370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:25.524370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:25.524370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:25.524370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:25.524370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:25.524370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:25.524370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:25.524370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:25.524370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:25.524370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:25.524370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:25.524370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:25.524370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:25.524370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:25.524370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:25.524370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:25.524370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:25.524370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:25.525635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:25.525635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:25.525635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:25.525635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:25.525635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:25.525635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:25.525635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:25.525635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:25.525635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:18:25.525635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:25.527263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 344/683] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:18:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:25.533305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b574d-fd65-407f-94a2-bc7cec0a0893 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:25.543425 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:25.581779 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad6a41-d786-4b8c-ab65-12935421d216 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:25.624665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d0482-27ab-4828-9b3a-7ac480055dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:25.625414 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d0482-27ab-4828-9b3a-7ac480055dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:25.625726 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d0482-27ab-4828-9b3a-7ac480055dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:25.626006 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d0482-27ab-4828-9b3a-7ac480055dd0 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:25.626714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d0482-27ab-4828-9b3a-7ac480055dd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:25.627018 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d0482-27ab-4828-9b3a-7ac480055dd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:25.628472 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d0482-27ab-4828-9b3a-7ac480055dd0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:25.642912 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 340/684] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:25.644724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d0482-27ab-4828-9b3a-7ac480055dd0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:25.653110 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:25.659843 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b574d-fd65-407f-94a2-bc7cec0a0893 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:25.702597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62dd85e-7714-43df-92ff-c99a06ac94dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:25.703245 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62dd85e-7714-43df-92ff-c99a06ac94dc None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:25.703439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62dd85e-7714-43df-92ff-c99a06ac94dc None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:25.703720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62dd85e-7714-43df-92ff-c99a06ac94dc None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:25.704506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62dd85e-7714-43df-92ff-c99a06ac94dc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:25.704860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62dd85e-7714-43df-92ff-c99a06ac94dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:25.706277 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62dd85e-7714-43df-92ff-c99a06ac94dc None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:25.726086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 345/685] 10.222.0.96 () {56 vars in 1135 bytes} [Wed Aug 24 04:18:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:18:25.726974 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62dd85e-7714-43df-92ff-c99a06ac94dc None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:25.769369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d0482-27ab-4828-9b3a-7ac480055dd0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:25.805483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622997d2-b32e-43da-a9cc-abff02bb7913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:25.806500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622997d2-b32e-43da-a9cc-abff02bb7913 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:25.807429 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622997d2-b32e-43da-a9cc-abff02bb7913 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:25.807901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622997d2-b32e-43da-a9cc-abff02bb7913 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:25.810144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:25.821716 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622997d2-b32e-43da-a9cc-abff02bb7913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:25.826804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-622997d2-b32e-43da-a9cc-abff02bb7913 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:18:25.826804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:25.826804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:25.826804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:25.826804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:25.826804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:25.826804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:25.826804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:25.826804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:25.826804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:25.826804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:25.826804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:25.826804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:25.826804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:25.826804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:25.826804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:25.827833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:25.827833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:25.827833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:25.827833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:25.827833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:25.827833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:25.827833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:25.827833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:25.827833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:25.827833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:25.827833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:25.827833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:25.827833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:25.827833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:25.827833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:25.827833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:25.828719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:25.828719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:25.828719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:25.828719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:25.828719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:25.828719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:25.828719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:25.828719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:25.828719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:25.828719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:25.828719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:18:25.828719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:25.831387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 341/686] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:18:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:25.833076 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622997d2-b32e-43da-a9cc-abff02bb7913 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:25.850106 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62dd85e-7714-43df-92ff-c99a06ac94dc None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:25.888166 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d778cd1-895f-477a-97a8-d219aeee9efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:25.888934 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d778cd1-895f-477a-97a8-d219aeee9efe None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:25.889208 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d778cd1-895f-477a-97a8-d219aeee9efe None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:25.889566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d778cd1-895f-477a-97a8-d219aeee9efe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:25.890299 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d778cd1-895f-477a-97a8-d219aeee9efe None admin] RBAC: Adding query filter params (role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=50358dbf699a41188dae93496161709d) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:25.890606 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d778cd1-895f-477a-97a8-d219aeee9efe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:25.892117 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d778cd1-895f-477a-97a8-d219aeee9efe None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:25.904848 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 346/687] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:18:25 2022] GET /identity/v3/role_assignments?user.id=50358dbf699a41188dae93496161709d&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:25.904848 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d778cd1-895f-477a-97a8-d219aeee9efe None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:25.922864 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:26.011478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622997d2-b32e-43da-a9cc-abff02bb7913 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:26.037341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d778cd1-895f-477a-97a8-d219aeee9efe None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:26.089572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244bf2d-dae0-40fe-8ae8-f03f7fe42da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:26.090261 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244bf2d-dae0-40fe-8ae8-f03f7fe42da8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:26.090548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244bf2d-dae0-40fe-8ae8-f03f7fe42da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:26.090822 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244bf2d-dae0-40fe-8ae8-f03f7fe42da8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:26.118303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23459eaa-43f4-4654-8764-27e12576c473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:26.118913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23459eaa-43f4-4654-8764-27e12576c473 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:26.119193 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23459eaa-43f4-4654-8764-27e12576c473 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:26.119468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23459eaa-43f4-4654-8764-27e12576c473 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:26.120134 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23459eaa-43f4-4654-8764-27e12576c473 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:26.120463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23459eaa-43f4-4654-8764-27e12576c473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:26.121878 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23459eaa-43f4-4654-8764-27e12576c473 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:26.132533 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 347/688] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:18:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:26.138426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23459eaa-43f4-4654-8764-27e12576c473 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:26.186519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:26.197334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244bf2d-dae0-40fe-8ae8-f03f7fe42da8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:26.198798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244bf2d-dae0-40fe-8ae8-f03f7fe42da8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:26.250833 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:26.276200 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23459eaa-43f4-4654-8764-27e12576c473 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:26.310467 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 342/689] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:18:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:26.312823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73349bd7-56c3-4cde-9dcc-7b4684b077a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:26.313708 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73349bd7-56c3-4cde-9dcc-7b4684b077a4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:26.314182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73349bd7-56c3-4cde-9dcc-7b4684b077a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:26.314646 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73349bd7-56c3-4cde-9dcc-7b4684b077a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:26.315867 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244bf2d-dae0-40fe-8ae8-f03f7fe42da8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:26.327416 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73349bd7-56c3-4cde-9dcc-7b4684b077a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:26.329213 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73349bd7-56c3-4cde-9dcc-7b4684b077a4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:26.344336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-73349bd7-56c3-4cde-9dcc-7b4684b077a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:26.344336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:26.344336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:26.344336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:26.344336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:26.344336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:26.344336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:26.344336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:26.344336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:26.344336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:26.344336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:26.344336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:26.344336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:26.344336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:26.344336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:26.344336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:26.345323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:26.345323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:26.345323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:26.345323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:26.345323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:26.345323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:26.345323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:26.345323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:26.345323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:26.345323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:26.345323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:26.345323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:26.345323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:26.345323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:26.345323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:26.345323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:26.345323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:26.346191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:26.346191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:26.346191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:26.348272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 348/690] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:18:26.354924 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73349bd7-56c3-4cde-9dcc-7b4684b077a4 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:26.429162 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:26.442591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244bf2d-dae0-40fe-8ae8-f03f7fe42da8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:26.479996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27449d11-7067-4b61-ad06-323379e9ada8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:26.480631 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27449d11-7067-4b61-ad06-323379e9ada8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:26.480939 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27449d11-7067-4b61-ad06-323379e9ada8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:26.481216 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27449d11-7067-4b61-ad06-323379e9ada8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:26.497811 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27449d11-7067-4b61-ad06-323379e9ada8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:26.498879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73349bd7-56c3-4cde-9dcc-7b4684b077a4 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:26.499809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27449d11-7067-4b61-ad06-323379e9ada8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:26.516998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-27449d11-7067-4b61-ad06-323379e9ada8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:26.516998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:26.516998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:26.516998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:26.516998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:26.516998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:26.516998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:26.516998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:26.516998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:26.516998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:26.516998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:26.516998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:26.516998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:26.516998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:26.516998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:26.516998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:26.517968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:26.517968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:26.517968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:26.517968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:26.517968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:26.517968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:26.517968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:26.517968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:26.517968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:26.517968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:26.517968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:26.517968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:26.517968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:26.517968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:26.517968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:26.517968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:26.517968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:26.518865 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:26.518865 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:26.518865 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:26.521471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 343/691] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:26.527213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881d966-c43f-4364-99c3-9fdfc115a171 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:26.527863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881d966-c43f-4364-99c3-9fdfc115a171 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:26.528355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881d966-c43f-4364-99c3-9fdfc115a171 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:26.530119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 344/692] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:26.531033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881d966-c43f-4364-99c3-9fdfc115a171 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:26.537064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:26.542060 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9981e75-9315-4240-8c8a-7401cd88a8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:26.542903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9981e75-9315-4240-8c8a-7401cd88a8ea None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:26.543009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9981e75-9315-4240-8c8a-7401cd88a8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:26.543237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9981e75-9315-4240-8c8a-7401cd88a8ea None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:26.543902 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9981e75-9315-4240-8c8a-7401cd88a8ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:26.544217 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9981e75-9315-4240-8c8a-7401cd88a8ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:26.545699 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9981e75-9315-4240-8c8a-7401cd88a8ea None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:26.559364 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 349/693] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:26.560613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a041f8-aff2-4393-83b1-60cd25cab769 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:26.565258 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a041f8-aff2-4393-83b1-60cd25cab769 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:26.565561 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a041f8-aff2-4393-83b1-60cd25cab769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:26.589567 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-03a041f8-aff2-4393-83b1-60cd25cab769 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:26.591006 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-03a041f8-aff2-4393-83b1-60cd25cab769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:26.647232 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881d966-c43f-4364-99c3-9fdfc115a171 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:26.667531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 350/694] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:26.673846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a041f8-aff2-4393-83b1-60cd25cab769 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:26.687654 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ef150-a665-4f8b-b9e3-476701e7f04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:26.688589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ef150-a665-4f8b-b9e3-476701e7f04e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:26.689112 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ef150-a665-4f8b-b9e3-476701e7f04e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:26.689599 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ef150-a665-4f8b-b9e3-476701e7f04e None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:26.690448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ef150-a665-4f8b-b9e3-476701e7f04e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:26.690960 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ef150-a665-4f8b-b9e3-476701e7f04e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:26.692934 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ef150-a665-4f8b-b9e3-476701e7f04e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:26.706554 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 345/695] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:26.712555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ef150-a665-4f8b-b9e3-476701e7f04e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:26.725251 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:26.808063 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a041f8-aff2-4393-83b1-60cd25cab769 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:26.825642 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ef150-a665-4f8b-b9e3-476701e7f04e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:26.845718 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07b3a8-d29a-4b35-9a6b-62e6b74e33f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:26.846358 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07b3a8-d29a-4b35-9a6b-62e6b74e33f3 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:26.846640 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07b3a8-d29a-4b35-9a6b-62e6b74e33f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:26.846914 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07b3a8-d29a-4b35-9a6b-62e6b74e33f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:26.855384 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07b3a8-d29a-4b35-9a6b-62e6b74e33f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:26.856967 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07b3a8-d29a-4b35-9a6b-62e6b74e33f3 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:26.868451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc72519-b030-4c39-a6bf-38f23a18e7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:26.869550 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc72519-b030-4c39-a6bf-38f23a18e7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:26.870067 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc72519-b030-4c39-a6bf-38f23a18e7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:26.870558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc72519-b030-4c39-a6bf-38f23a18e7a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:26.871069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-6b07b3a8-d29a-4b35-9a6b-62e6b74e33f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:18:26.871069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:26.871069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:26.871069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:26.871069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:26.871069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:26.871069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:26.871069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:26.871069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:26.871069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:26.871069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:26.871069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:26.871069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:26.871069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:26.871069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:26.871069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:26.871997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:26.871997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:26.871997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:26.871997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:26.871997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:26.871997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:26.871997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:26.871997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:26.871997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:26.871997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:26.871997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:26.871997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:26.871997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:26.871997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:26.871997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:26.871997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:26.871997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:26.871997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:26.872991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:26.872991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:26.872991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:26.872991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:26.872991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:26.872991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:26.872991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:26.872991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:26.872991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:18:26.872991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:26.873512 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:26.876986 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 351/696] 10.222.0.96 () {56 vars in 1093 bytes} [Wed Aug 24 04:18:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:26.879140 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07b3a8-d29a-4b35-9a6b-62e6b74e33f3 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:26.882545 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc72519-b030-4c39-a6bf-38f23a18e7a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:26.884230 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc72519-b030-4c39-a6bf-38f23a18e7a3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:26.896885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-acc72519-b030-4c39-a6bf-38f23a18e7a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:26.896885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:26.896885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:26.896885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:26.896885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:26.896885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:26.896885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:26.896885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:26.896885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:26.896885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:26.896885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:26.896885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:26.896885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:26.896885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:26.896885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:26.897773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:26.897773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:26.897773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:26.897773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:26.897773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:26.897773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:26.897773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:26.897773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:26.897773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:26.897773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:26.897773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:26.897773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:26.897773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:26.897773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:26.897773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:26.897773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:26.897773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:26.898645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:26.898645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:26.898645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:26.898645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:26.898645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:26.898645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:26.898645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:26.898645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:26.904988 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 346/697] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:18:26.906624 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc72519-b030-4c39-a6bf-38f23a18e7a3 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:26.990312 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07b3a8-d29a-4b35-9a6b-62e6b74e33f3 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:27.029898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaba911-75ab-4acf-a8a6-530053545b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:27.030574 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaba911-75ab-4acf-a8a6-530053545b9b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:27.030860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaba911-75ab-4acf-a8a6-530053545b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:27.031143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaba911-75ab-4acf-a8a6-530053545b9b None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:27.031886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaba911-75ab-4acf-a8a6-530053545b9b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:27.032433 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaba911-75ab-4acf-a8a6-530053545b9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:27.034104 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaba911-75ab-4acf-a8a6-530053545b9b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:27.042304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:27.064887 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 352/698] 10.222.0.96 () {56 vars in 1133 bytes} [Wed Aug 24 04:18:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:27.065711 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaba911-75ab-4acf-a8a6-530053545b9b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:27.091392 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc72519-b030-4c39-a6bf-38f23a18e7a3 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:27.119237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:27.129361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5320312-e258-444e-bad1-41e07a63e283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:27.130076 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5320312-e258-444e-bad1-41e07a63e283 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:27.130449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5320312-e258-444e-bad1-41e07a63e283 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:27.130731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5320312-e258-444e-bad1-41e07a63e283 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:27.131584 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5320312-e258-444e-bad1-41e07a63e283 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:27.131898 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5320312-e258-444e-bad1-41e07a63e283 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:27.133378 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5320312-e258-444e-bad1-41e07a63e283 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:27.147419 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 347/699] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:27.148310 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5320312-e258-444e-bad1-41e07a63e283 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:27.192560 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaba911-75ab-4acf-a8a6-530053545b9b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:27.242277 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577721d-6acb-4017-bb11-7b331a085fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:27.243068 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577721d-6acb-4017-bb11-7b331a085fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:27.243464 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577721d-6acb-4017-bb11-7b331a085fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:27.243798 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577721d-6acb-4017-bb11-7b331a085fe5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:27.244397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577721d-6acb-4017-bb11-7b331a085fe5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:27.246443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577721d-6acb-4017-bb11-7b331a085fe5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:27.261281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-6577721d-6acb-4017-bb11-7b331a085fe5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:18:27.261281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:27.261281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:18:27.261281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:18:27.261281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:18:27.261281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:18:27.261281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:18:27.261281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:27.261281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:18:27.261281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:27.261281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:18:27.261281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:27.261281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:27.261281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:27.261281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:27.261281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:27.261281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:27.262347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:27.262347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:27.262347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:27.262347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:27.262347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:27.262347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:27.262347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:18:27.262347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:18:27.262347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:18:27.262347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:18:27.262347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:27.262347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:27.262347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:27.262347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:27.262347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:27.262347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:27.263180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:27.263180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:27.263180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:27.263180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:27.263180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:27.263180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:27.263180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:27.263180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:27.263180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:27.263180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:27.263180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:18:27.263180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:27.263180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:18:27.263180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:27.263180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 353/700] 10.222.0.96 () {56 vars in 1129 bytes} [Wed Aug 24 04:18:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:27.264000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577721d-6acb-4017-bb11-7b331a085fe5 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:27.265552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5320312-e258-444e-bad1-41e07a63e283 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:27.298032 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:27.309218 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5dccf5-2494-4cd6-a188-63746cdf9e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:27.310099 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dccf5-2494-4cd6-a188-63746cdf9e15 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:27.310566 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dccf5-2494-4cd6-a188-63746cdf9e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:27.311016 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5dccf5-2494-4cd6-a188-63746cdf9e15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:27.390200 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5dccf5-2494-4cd6-a188-63746cdf9e15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:27.391691 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5dccf5-2494-4cd6-a188-63746cdf9e15 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:27.393637 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577721d-6acb-4017-bb11-7b331a085fe5 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:27.409034 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:27.430129 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcde291-02d3-492e-ab4c-80b1bdbf5039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:27.430750 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcde291-02d3-492e-ab4c-80b1bdbf5039 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:27.431038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcde291-02d3-492e-ab4c-80b1bdbf5039 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:27.431425 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcde291-02d3-492e-ab4c-80b1bdbf5039 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:27.432181 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcde291-02d3-492e-ab4c-80b1bdbf5039 None admin] RBAC: Adding query filter params (role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=953d2dbd5e7d435f9148fd043b4ce7a7) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:27.432497 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcde291-02d3-492e-ab4c-80b1bdbf5039 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:27.434060 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcde291-02d3-492e-ab4c-80b1bdbf5039 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:27.440735 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 354/701] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:18:27 2022] GET /identity/v3/role_assignments?user.id=953d2dbd5e7d435f9148fd043b4ce7a7&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:27.442570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcde291-02d3-492e-ab4c-80b1bdbf5039 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:27.571900 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 348/702] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:18:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:27.577746 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5dccf5-2494-4cd6-a188-63746cdf9e15 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:27.628015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:27.643306 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcde291-02d3-492e-ab4c-80b1bdbf5039 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:27.683919 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a49e5-a9b7-4171-bd20-f00432e24fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:27.684535 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a49e5-a9b7-4171-bd20-f00432e24fdc None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:27.684878 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a49e5-a9b7-4171-bd20-f00432e24fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:27.685143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a49e5-a9b7-4171-bd20-f00432e24fdc None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:27.685782 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a49e5-a9b7-4171-bd20-f00432e24fdc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:27.686091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a49e5-a9b7-4171-bd20-f00432e24fdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:27.687461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a49e5-a9b7-4171-bd20-f00432e24fdc None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:27.694399 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 355/703] 10.222.0.96 () {56 vars in 1124 bytes} [Wed Aug 24 04:18:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:27.695625 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00217f17-6a1c-4b03-abfe-5043e94e5277 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:27.695914 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00217f17-6a1c-4b03-abfe-5043e94e5277 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:27.696456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00217f17-6a1c-4b03-abfe-5043e94e5277 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:27.698198 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 356/704] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:27.699892 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00217f17-6a1c-4b03-abfe-5043e94e5277 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:27.723619 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5dccf5-2494-4cd6-a188-63746cdf9e15 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:27.743846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:27.766476 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe41409-05eb-40c2-96e1-114176b5c7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:27.767138 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe41409-05eb-40c2-96e1-114176b5c7ce None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:27.767421 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe41409-05eb-40c2-96e1-114176b5c7ce None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:27.767699 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe41409-05eb-40c2-96e1-114176b5c7ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:27.780109 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe41409-05eb-40c2-96e1-114176b5c7ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:27.781602 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe41409-05eb-40c2-96e1-114176b5c7ce None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:27.797570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-ffe41409-05eb-40c2-96e1-114176b5c7ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:27.797570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:27.797570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:27.797570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:27.797570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:27.797570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:27.797570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:27.797570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:27.797570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:27.797570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:27.797570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:27.797570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:27.797570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:27.797570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:27.797570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:27.797570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:27.798614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:27.798614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:27.798614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:27.798614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:27.798614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:27.798614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:27.798614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:27.798614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:27.798614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:27.798614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:27.798614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:27.798614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:27.798614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:27.798614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:27.798614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:27.798614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:27.798614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:27.799591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:27.799591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:27.799591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:27.799591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 349/705] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:27.799822 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac94d7-7d6e-4d20-8688-ea1752292be7 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:27.800374 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac94d7-7d6e-4d20-8688-ea1752292be7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:27.800374 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac94d7-7d6e-4d20-8688-ea1752292be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:27.824115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e9ac94d7-7d6e-4d20-8688-ea1752292be7 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:27.825456 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e9ac94d7-7d6e-4d20-8688-ea1752292be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:27.853755 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00217f17-6a1c-4b03-abfe-5043e94e5277 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:27.893685 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfd395-96ba-4949-9b86-967714ed0f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:27.895076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfd395-96ba-4949-9b86-967714ed0f3b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:27.895508 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfd395-96ba-4949-9b86-967714ed0f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:27.895927 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfd395-96ba-4949-9b86-967714ed0f3b None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:27.896876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfd395-96ba-4949-9b86-967714ed0f3b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:27.897439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfd395-96ba-4949-9b86-967714ed0f3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:27.899031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfd395-96ba-4949-9b86-967714ed0f3b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:27.905853 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 357/706] 10.222.0.96 () {56 vars in 1124 bytes} [Wed Aug 24 04:18:27 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:18:27.907010 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfd395-96ba-4949-9b86-967714ed0f3b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:27.933487 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 350/707] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:28.085450 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:28.092111 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfd395-96ba-4949-9b86-967714ed0f3b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:28.128508 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e09fe-6a17-49d9-8522-45af45a98d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:28.129821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e09fe-6a17-49d9-8522-45af45a98d51 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:28.130107 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e09fe-6a17-49d9-8522-45af45a98d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:28.130382 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e09fe-6a17-49d9-8522-45af45a98d51 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:28.131037 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e09fe-6a17-49d9-8522-45af45a98d51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:28.131344 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e09fe-6a17-49d9-8522-45af45a98d51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:28.132759 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e09fe-6a17-49d9-8522-45af45a98d51 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:28.146602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 358/708] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:28.152124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac94d7-7d6e-4d20-8688-ea1752292be7 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:28.163055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:28.265011 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac94d7-7d6e-4d20-8688-ea1752292be7 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:28.284724 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e09fe-6a17-49d9-8522-45af45a98d51 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:28.321830 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd94fa9-e89f-47fe-82ff-0dba1aa1dab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:28.322529 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd94fa9-e89f-47fe-82ff-0dba1aa1dab8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:28.322811 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd94fa9-e89f-47fe-82ff-0dba1aa1dab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:28.323133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd94fa9-e89f-47fe-82ff-0dba1aa1dab8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:28.330954 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd94fa9-e89f-47fe-82ff-0dba1aa1dab8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:28.332451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd94fa9-e89f-47fe-82ff-0dba1aa1dab8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:28.345373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-2cd94fa9-e89f-47fe-82ff-0dba1aa1dab8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:28.345373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:28.345373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:28.345373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:28.345373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:28.345373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:28.345373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:28.345373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:28.345373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:28.345373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:28.345373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:28.345373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:28.345373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:28.345373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:28.345373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:28.346488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:28.346488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:28.346488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:28.346488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:28.346488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:28.346488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:28.346488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:28.346488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:28.346488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:28.346488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:28.346488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:28.346488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:28.346488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:28.346488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:28.346488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:28.346488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:28.346488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:28.347608 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:28.347608 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:28.347608 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:28.347608 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:28.347608 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:28.347608 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:28.347608 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:28.347608 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:28.347608 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 351/709] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:28.353400 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd94fa9-e89f-47fe-82ff-0dba1aa1dab8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:28.430211 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:28.469444 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e09fe-6a17-49d9-8522-45af45a98d51 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:28.474176 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd94fa9-e89f-47fe-82ff-0dba1aa1dab8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:28.513586 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f94e7-43a8-436b-9fa1-119b9c701f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:28.514430 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f94e7-43a8-436b-9fa1-119b9c701f12 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:28.514856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f94e7-43a8-436b-9fa1-119b9c701f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:28.515260 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f94e7-43a8-436b-9fa1-119b9c701f12 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:28.516106 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f94e7-43a8-436b-9fa1-119b9c701f12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:28.516573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f94e7-43a8-436b-9fa1-119b9c701f12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:28.517594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329637f8-34c6-48e7-9ab0-e6bbf4864b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:28.518225 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329637f8-34c6-48e7-9ab0-e6bbf4864b89 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:28.518506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329637f8-34c6-48e7-9ab0-e6bbf4864b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:28.518697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f94e7-43a8-436b-9fa1-119b9c701f12 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:28.518817 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329637f8-34c6-48e7-9ab0-e6bbf4864b89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:28.532195 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329637f8-34c6-48e7-9ab0-e6bbf4864b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:28.533567 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 352/710] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:28.533727 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329637f8-34c6-48e7-9ab0-e6bbf4864b89 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:28.535085 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ec5eb-3642-4a9e-9bfb-d8e783eb7f44 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:28.536086 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ec5eb-3642-4a9e-9bfb-d8e783eb7f44 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:28.536503 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ec5eb-3642-4a9e-9bfb-d8e783eb7f44 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:28.538166 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 353/711] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:28.540362 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ec5eb-3642-4a9e-9bfb-d8e783eb7f44 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:28.559260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-329637f8-34c6-48e7-9ab0-e6bbf4864b89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:28.559260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:28.559260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:28.559260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:28.559260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:28.559260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:28.559260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:28.559260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:28.559260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:28.559260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:28.559260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:28.559260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:28.559260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:28.559260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:28.559260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:28.559260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:28.560466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:28.560466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:28.560466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:28.560466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:28.560466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:28.560466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:28.560466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:28.560466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:28.560466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:28.560466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:28.560466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:28.560466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:28.560466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:28.560466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:28.560466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:28.560466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:28.560466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:28.561439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:28.561439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:28.561439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:28.561439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 359/712] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:18:28.566020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44513705-1efd-4ad3-8a48-6d51036cd99a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:28.566304 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44513705-1efd-4ad3-8a48-6d51036cd99a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:28.566612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44513705-1efd-4ad3-8a48-6d51036cd99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:28.581552 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:28.589561 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-44513705-1efd-4ad3-8a48-6d51036cd99a None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:28.590941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-44513705-1efd-4ad3-8a48-6d51036cd99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:28.671484 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 360/713] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:28.672947 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44513705-1efd-4ad3-8a48-6d51036cd99a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:28.676645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ec5eb-3642-4a9e-9bfb-d8e783eb7f44 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:28.706904 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:28.716669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2337939-0108-4c56-847b-4bbd421c679f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:28.717593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2337939-0108-4c56-847b-4bbd421c679f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:28.718072 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2337939-0108-4c56-847b-4bbd421c679f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:28.718614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2337939-0108-4c56-847b-4bbd421c679f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:28.719535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2337939-0108-4c56-847b-4bbd421c679f None admin] RBAC: Adding query filter params (role.id=059d2bf5bb8e42939f5f826bfdad6a21, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=3539784b4e91472eb20addc6707dc30d) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:28.720044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2337939-0108-4c56-847b-4bbd421c679f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:28.721722 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2337939-0108-4c56-847b-4bbd421c679f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:28.728720 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 354/714] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:18:28 2022] GET /identity/v3/role_assignments?user.id=3539784b4e91472eb20addc6707dc30d&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=059d2bf5bb8e42939f5f826bfdad6a21 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:28.800095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44513705-1efd-4ad3-8a48-6d51036cd99a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:28.845777 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68330bc-edf4-4795-91ce-e1515a8bd541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:28.846411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68330bc-edf4-4795-91ce-e1515a8bd541 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:28.846694 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68330bc-edf4-4795-91ce-e1515a8bd541 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:28.846968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68330bc-edf4-4795-91ce-e1515a8bd541 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:28.847630 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68330bc-edf4-4795-91ce-e1515a8bd541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:28.848775 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68330bc-edf4-4795-91ce-e1515a8bd541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:28.850238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68330bc-edf4-4795-91ce-e1515a8bd541 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:28.863752 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 361/715] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:28.864074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:28.870792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2337939-0108-4c56-847b-4bbd421c679f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:28.983417 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2337939-0108-4c56-847b-4bbd421c679f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:29.019529 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdffb0c-6f87-44a2-b6d9-0f166c9566fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:29.020971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdffb0c-6f87-44a2-b6d9-0f166c9566fb None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:29.021256 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdffb0c-6f87-44a2-b6d9-0f166c9566fb None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:29.021539 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdffb0c-6f87-44a2-b6d9-0f166c9566fb None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:29.022195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdffb0c-6f87-44a2-b6d9-0f166c9566fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:29.023622 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdffb0c-6f87-44a2-b6d9-0f166c9566fb None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:29.046530 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 355/716] 10.222.0.96 () {60 vars in 1132 bytes} [Wed Aug 24 04:18:28 2022] POST /identity/v3/users => generated 254 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:18:29.126092 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68330bc-edf4-4795-91ce-e1515a8bd541 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:29.244378 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68330bc-edf4-4795-91ce-e1515a8bd541 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:29.281446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa0713-10d0-4c8f-aa9e-92b0fdc5193b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:29.282084 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa0713-10d0-4c8f-aa9e-92b0fdc5193b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:29.282362 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa0713-10d0-4c8f-aa9e-92b0fdc5193b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:29.282635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa0713-10d0-4c8f-aa9e-92b0fdc5193b None admin] PATH_INFO: `/v3/services/network` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:29.283285 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa0713-10d0-4c8f-aa9e-92b0fdc5193b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:29.284735 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa0713-10d0-4c8f-aa9e-92b0fdc5193b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:29.294622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-91fa0713-10d0-4c8f-aa9e-92b0fdc5193b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:18:29.294622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:29.294622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:18:29.294622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:18:29.294622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:18:29.294622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:18:29.294622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:18:29.294622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:29.294622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:18:29.294622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:29.294622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:18:29.294622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:29.294622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:29.294622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:29.294622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:29.294622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:29.294622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:29.297012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:29.297012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:29.297012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:29.297012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:29.297012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:29.297012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:29.297012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:18:29.297012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:18:29.297012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:18:29.297012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:18:29.297012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:29.297012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:29.297012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:29.297012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:29.297012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:29.297012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:29.299007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:29.299007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:29.299007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:29.299007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:29.299007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:29.299007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:29.299007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:29.299007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:29.299007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:29.299007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:29.299007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:18:29.299007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:29.299007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:18:29.299007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:29.299007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 362/717] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:29 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:29.307438 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdffb0c-6f87-44a2-b6d9-0f166c9566fb None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:29.370326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:29.429399 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdffb0c-6f87-44a2-b6d9-0f166c9566fb None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:29.470464 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b8ffe-e13a-473c-86cf-ac26e54d0ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:29.471089 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b8ffe-e13a-473c-86cf-ac26e54d0ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:29.471371 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b8ffe-e13a-473c-86cf-ac26e54d0ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:29.471641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b8ffe-e13a-473c-86cf-ac26e54d0ca1 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:29.472273 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b8ffe-e13a-473c-86cf-ac26e54d0ca1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:29.472577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b8ffe-e13a-473c-86cf-ac26e54d0ca1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:29.474413 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b8ffe-e13a-473c-86cf-ac26e54d0ca1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:29.479838 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 356/718] 10.222.0.96 () {56 vars in 1112 bytes} [Wed Aug 24 04:18:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:29.485314 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa0713-10d0-4c8f-aa9e-92b0fdc5193b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:29.555847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:29.601082 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa0713-10d0-4c8f-aa9e-92b0fdc5193b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:29.647753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01206681-65ed-4500-bf6d-0bbf5fb3e894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:29.648374 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01206681-65ed-4500-bf6d-0bbf5fb3e894 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:29.648659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01206681-65ed-4500-bf6d-0bbf5fb3e894 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:29.648964 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01206681-65ed-4500-bf6d-0bbf5fb3e894 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:29.649610 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01206681-65ed-4500-bf6d-0bbf5fb3e894 None admin] RBAC: Adding query filter params (type=network) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:29.649921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01206681-65ed-4500-bf6d-0bbf5fb3e894 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:29.651324 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01206681-65ed-4500-bf6d-0bbf5fb3e894 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:29.656314 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 363/719] 10.222.0.96 () {56 vars in 1112 bytes} [Wed Aug 24 04:18:29 2022] GET /identity/v3/services?type=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:29.907219 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0875b-cf50-4fc0-bb63-3d72e3cbefd2 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:29.907547 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0875b-cf50-4fc0-bb63-3d72e3cbefd2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:29.907778 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0875b-cf50-4fc0-bb63-3d72e3cbefd2 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:29.909295 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 357/720] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:29.915950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9746bc-b923-4ee6-8e02-a8fdde81c9a4 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:29.916242 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9746bc-b923-4ee6-8e02-a8fdde81c9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:29.916521 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9746bc-b923-4ee6-8e02-a8fdde81c9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:29.943364 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-3c9746bc-b923-4ee6-8e02-a8fdde81c9a4 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:29.944564 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3c9746bc-b923-4ee6-8e02-a8fdde81c9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:30.028229 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 364/721] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:30.305506 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4196cc-adcf-448b-99f3-87d553ac056c None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:30.305995 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4196cc-adcf-448b-99f3-87d553ac056c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:30.305995 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4196cc-adcf-448b-99f3-87d553ac056c None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:30.307571 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 358/722] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:30.313091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435e2f6-1b2a-474b-8019-71a10d3de98b None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:30.313507 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435e2f6-1b2a-474b-8019-71a10d3de98b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:30.313675 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435e2f6-1b2a-474b-8019-71a10d3de98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:30.332550 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-c435e2f6-1b2a-474b-8019-71a10d3de98b None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:30.333777 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c435e2f6-1b2a-474b-8019-71a10d3de98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:30.404613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:30.427622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 365/723] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:30.550922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4196cc-adcf-448b-99f3-87d553ac056c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:30.695767 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4196cc-adcf-448b-99f3-87d553ac056c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:30.713318 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:30.734304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63f9fb-85fb-467e-9a07-67da37c35287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:30.734937 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63f9fb-85fb-467e-9a07-67da37c35287 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:30.735216 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63f9fb-85fb-467e-9a07-67da37c35287 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:30.735487 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63f9fb-85fb-467e-9a07-67da37c35287 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:30.756340 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e63f9fb-85fb-467e-9a07-67da37c35287 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:30.761305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-3e63f9fb-85fb-467e-9a07-67da37c35287 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:18:30.761305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:30.761305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:30.761305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:30.761305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:30.761305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:30.761305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:30.761305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:30.761305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:30.761305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:30.761305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:30.761305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:30.761305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:30.761305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:30.761305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:30.761305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:30.762255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:30.762255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:30.762255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:30.762255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:30.762255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:30.762255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:30.762255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:30.762255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:30.762255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:30.762255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:30.762255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:30.762255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:30.762255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:30.762255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:30.762255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:30.762255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:30.763093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:30.763093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:30.763093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:30.763093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:30.763093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:30.763093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:30.763093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:30.763093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:30.763093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:30.763093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:30.763093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:18:30.763093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:30.763093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 359/724] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:18:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:30.768571 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435e2f6-1b2a-474b-8019-71a10d3de98b None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:30.775996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63f9fb-85fb-467e-9a07-67da37c35287 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:30.930768 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435e2f6-1b2a-474b-8019-71a10d3de98b None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:30.938956 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63f9fb-85fb-467e-9a07-67da37c35287 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:31.003358 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8698250-6895-4c4b-a2e9-b12e5fe39000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:31.005264 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8698250-6895-4c4b-a2e9-b12e5fe39000 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:31.005469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c04bee-87a4-49ec-8016-ea760b077d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:31.005989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8698250-6895-4c4b-a2e9-b12e5fe39000 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:31.006492 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8698250-6895-4c4b-a2e9-b12e5fe39000 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:31.007375 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8698250-6895-4c4b-a2e9-b12e5fe39000 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:31.007492 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c04bee-87a4-49ec-8016-ea760b077d38 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:31.007724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c04bee-87a4-49ec-8016-ea760b077d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:31.007994 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c04bee-87a4-49ec-8016-ea760b077d38 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:31.008450 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8698250-6895-4c4b-a2e9-b12e5fe39000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:31.008644 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c04bee-87a4-49ec-8016-ea760b077d38 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:31.010046 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c04bee-87a4-49ec-8016-ea760b077d38 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:31.016707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8698250-6895-4c4b-a2e9-b12e5fe39000 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:31.034285 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 360/725] 10.222.0.96 () {60 vars in 1141 bytes} [Wed Aug 24 04:18:30 2022] POST /identity/v3/services => generated 251 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:18:31.035056 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 366/726] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:18:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:18:31.041407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c04bee-87a4-49ec-8016-ea760b077d38 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:31.089543 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:31.211401 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c04bee-87a4-49ec-8016-ea760b077d38 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:31.257848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f913c2b-f1b1-494e-a2b7-7dabf2ec1c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:31.258432 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f913c2b-f1b1-494e-a2b7-7dabf2ec1c27 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:31.258716 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f913c2b-f1b1-494e-a2b7-7dabf2ec1c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:31.258992 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f913c2b-f1b1-494e-a2b7-7dabf2ec1c27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:31.270190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f913c2b-f1b1-494e-a2b7-7dabf2ec1c27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:31.271809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f913c2b-f1b1-494e-a2b7-7dabf2ec1c27 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:31.287044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-5f913c2b-f1b1-494e-a2b7-7dabf2ec1c27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:31.287044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:31.287044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:31.287044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:31.287044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:31.287044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:31.287044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:31.287044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:31.287044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:31.287044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:31.287044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:31.287044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:31.287044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:31.287044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:31.287044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:31.287044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:31.288055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:31.288055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:31.288055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:31.288055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:31.288055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:31.288055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:31.288055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:31.288055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:31.288055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:31.288055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:31.288055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:31.288055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:31.288055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:31.288055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:31.288055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:31.288055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:31.288055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:31.289005 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:31.289005 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:31.289005 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:31.292827 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 361/727] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:31.294397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8698250-6895-4c4b-a2e9-b12e5fe39000 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:31.322623 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed671226-f9bd-44a1-b358-74001d1d329b None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:31.323153 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed671226-f9bd-44a1-b358-74001d1d329b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:31.323153 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed671226-f9bd-44a1-b358-74001d1d329b None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:31.324888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 362/728] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:18:31.329532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9764c-99e3-4471-aeeb-3c0d392c6660 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:31.329815 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9764c-99e3-4471-aeeb-3c0d392c6660 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:31.330091 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9764c-99e3-4471-aeeb-3c0d392c6660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:31.350166 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-00b9764c-99e3-4471-aeeb-3c0d392c6660 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:31.351470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-00b9764c-99e3-4471-aeeb-3c0d392c6660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:31.358793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:31.427301 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8698250-6895-4c4b-a2e9-b12e5fe39000 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:31.437786 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 363/729] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:31.464995 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a58fc7-2ce7-4c38-98f8-3357d099c984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:31.465613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a58fc7-2ce7-4c38-98f8-3357d099c984 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:31.465894 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a58fc7-2ce7-4c38-98f8-3357d099c984 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:31.466185 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a58fc7-2ce7-4c38-98f8-3357d099c984 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:31.466875 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a58fc7-2ce7-4c38-98f8-3357d099c984 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:31.467186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a58fc7-2ce7-4c38-98f8-3357d099c984 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:31.468605 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a58fc7-2ce7-4c38-98f8-3357d099c984 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:31.484818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 367/730] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:31.487846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9764c-99e3-4471-aeeb-3c0d392c6660 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:31.508626 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:31.633716 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9764c-99e3-4471-aeeb-3c0d392c6660 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:31.669720 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262da4d-6964-4b9b-8b8c-f324e67f7068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:31.670671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262da4d-6964-4b9b-8b8c-f324e67f7068 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:31.671137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262da4d-6964-4b9b-8b8c-f324e67f7068 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:31.671592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262da4d-6964-4b9b-8b8c-f324e67f7068 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:31.680300 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262da4d-6964-4b9b-8b8c-f324e67f7068 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:31.682023 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262da4d-6964-4b9b-8b8c-f324e67f7068 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:31.688730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5619ddb-347b-45a6-898d-cfe135998218 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:31.689131 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5619ddb-347b-45a6-898d-cfe135998218 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:31.689480 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5619ddb-347b-45a6-898d-cfe135998218 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:31.691010 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 368/731] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:31.699044 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f70196-0395-4508-b2aa-2123092fb4b5 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:31.699382 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f70196-0395-4508-b2aa-2123092fb4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:31.699738 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f70196-0395-4508-b2aa-2123092fb4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:31.702029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-c262da4d-6964-4b9b-8b8c-f324e67f7068 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:18:31.702029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:31.702029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:31.702029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:31.702029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:31.702029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:31.702029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:31.702029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:31.702029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:31.702029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:31.702029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:31.702029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:31.702029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:31.702029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:31.702029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:31.702029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:31.702949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:31.702949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:31.702949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:31.702949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:31.702949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:31.702949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:31.702949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:31.702949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:31.702949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:31.702949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:31.702949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:31.702949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:31.702949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:31.702949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:31.702949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:31.702949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:31.702949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:31.702949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:31.703936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:31.703936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:31.703936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:31.703936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:31.703936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:31.703936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:31.703936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:31.703936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:31.703936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:18:31.703936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:31.706300 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 364/732] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:18:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:31.732080 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-35f70196-0395-4508-b2aa-2123092fb4b5 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:31.733577 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-35f70196-0395-4508-b2aa-2123092fb4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:31.734257 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262da4d-6964-4b9b-8b8c-f324e67f7068 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:31.822043 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 369/733] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:18:31.853954 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f70196-0395-4508-b2aa-2123092fb4b5 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:31.854471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:31.890883 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262da4d-6964-4b9b-8b8c-f324e67f7068 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:31.911082 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:31.980061 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f70196-0395-4508-b2aa-2123092fb4b5 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:31.986343 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df92a69-9539-4611-9a47-d5fed41f4919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:31.987195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df92a69-9539-4611-9a47-d5fed41f4919 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:31.987665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df92a69-9539-4611-9a47-d5fed41f4919 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:31.988116 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df92a69-9539-4611-9a47-d5fed41f4919 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:31.989930 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df92a69-9539-4611-9a47-d5fed41f4919 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:31.990459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df92a69-9539-4611-9a47-d5fed41f4919 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:31.992149 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df92a69-9539-4611-9a47-d5fed41f4919 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:32.024715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f90e03-5aa5-4a4b-89be-f4fab218298b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:32.024715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f90e03-5aa5-4a4b-89be-f4fab218298b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:32.024715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f90e03-5aa5-4a4b-89be-f4fab218298b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:32.024715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f90e03-5aa5-4a4b-89be-f4fab218298b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:32.031369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f90e03-5aa5-4a4b-89be-f4fab218298b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:32.034978 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 365/734] 10.222.0.96 () {56 vars in 1135 bytes} [Wed Aug 24 04:18:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:18:32.037473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-e0f90e03-5aa5-4a4b-89be-f4fab218298b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:18:32.037473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:32.037473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:32.037473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:32.037473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:32.037473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:32.037473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:32.037473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:32.037473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:32.037473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:32.037473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:32.037473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:32.037473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:32.037473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:32.037473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:32.037473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:32.038400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:32.038400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:32.038400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:32.038400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:32.038400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:32.038400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:32.038400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:32.038400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:32.038400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:32.038400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:32.038400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:32.038400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:32.038400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:32.038400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:32.038400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:32.038400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:32.039243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:32.039243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:32.039243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:32.039243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:32.039243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:32.039243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:32.039243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:32.039243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:32.039243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:32.039243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:32.039243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:18:32.039243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:32.039243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 370/735] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:18:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:32.041105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df92a69-9539-4611-9a47-d5fed41f4919 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:32.058844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f90e03-5aa5-4a4b-89be-f4fab218298b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:32.151871 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df92a69-9539-4611-9a47-d5fed41f4919 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:32.180235 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:32.189246 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16250984-4e6e-4d6c-a06d-dcc21a142c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:32.190052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16250984-4e6e-4d6c-a06d-dcc21a142c55 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:32.190486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16250984-4e6e-4d6c-a06d-dcc21a142c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:32.190915 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16250984-4e6e-4d6c-a06d-dcc21a142c55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:32.251559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:32.260339 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f90e03-5aa5-4a4b-89be-f4fab218298b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:32.271721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16250984-4e6e-4d6c-a06d-dcc21a142c55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:32.273052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16250984-4e6e-4d6c-a06d-dcc21a142c55 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:32.303304 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a428e0f-7903-433f-bac2-4f6a7f331895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:32.303907 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a428e0f-7903-433f-bac2-4f6a7f331895 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:32.304208 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a428e0f-7903-433f-bac2-4f6a7f331895 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:32.304463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a428e0f-7903-433f-bac2-4f6a7f331895 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:32.305169 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a428e0f-7903-433f-bac2-4f6a7f331895 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:32.305483 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a428e0f-7903-433f-bac2-4f6a7f331895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:32.306855 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a428e0f-7903-433f-bac2-4f6a7f331895 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:32.319735 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 371/736] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:18:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:32.319735 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a428e0f-7903-433f-bac2-4f6a7f331895 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:32.384092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 366/737] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:18:32 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:18:32.386119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c89fd-c4fd-4f10-a09c-33375799adb3 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:32.386411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c89fd-c4fd-4f10-a09c-33375799adb3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:32.386698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c89fd-c4fd-4f10-a09c-33375799adb3 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:32.392140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 367/738] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:32.392140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c89fd-c4fd-4f10-a09c-33375799adb3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:32.421463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:32.433162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a428e0f-7903-433f-bac2-4f6a7f331895 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:32.475427 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97b1ca-1356-4d1c-a290-80ce4a4c96b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:32.476068 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97b1ca-1356-4d1c-a290-80ce4a4c96b8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:32.476349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97b1ca-1356-4d1c-a290-80ce4a4c96b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:32.476657 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97b1ca-1356-4d1c-a290-80ce4a4c96b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:32.489329 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97b1ca-1356-4d1c-a290-80ce4a4c96b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:32.494925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-3e97b1ca-1356-4d1c-a290-80ce4a4c96b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:32.494925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:32.494925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:32.494925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:32.494925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:32.494925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:32.494925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:32.494925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:32.494925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:32.494925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:32.494925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:32.494925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:32.494925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:32.494925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:32.494925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:32.494925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:32.496190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:32.496190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:32.496190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:32.496190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:32.496190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:32.496190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:32.496190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:32.496190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:32.496190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:32.496190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:32.496190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:32.496190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:32.496190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:32.496190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:32.496190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:32.496190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:32.497275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:32.497275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:32.497275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:32.497275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:32.497275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:32.497275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:32.497275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:32.497275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:32.497275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:32.497275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:32.497275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:32.497275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:32.497275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 372/739] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:18:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:32.497275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97b1ca-1356-4d1c-a290-80ce4a4c96b8 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:32.517175 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c89fd-c4fd-4f10-a09c-33375799adb3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:32.524963 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:32.556222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41b299-1ab2-41f4-a894-da41900295d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:32.556883 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41b299-1ab2-41f4-a894-da41900295d6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:32.557162 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41b299-1ab2-41f4-a894-da41900295d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:32.557438 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41b299-1ab2-41f4-a894-da41900295d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:32.568350 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41b299-1ab2-41f4-a894-da41900295d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:32.569830 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41b299-1ab2-41f4-a894-da41900295d6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:32.585518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-6b41b299-1ab2-41f4-a894-da41900295d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:32.585518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:32.585518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:32.585518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:32.585518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:32.585518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:32.585518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:32.585518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:32.585518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:32.585518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:32.585518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:32.585518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:32.585518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:32.585518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:32.585518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:32.585518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:32.586707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:32.586707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:32.586707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:32.586707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:32.586707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:32.586707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:32.586707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:32.586707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:32.586707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:32.586707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:32.586707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:32.586707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:32.586707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:32.586707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:32.586707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:32.586707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:32.586707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:32.587835 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:32.587835 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:32.587835 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:32.589034 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 368/740] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:32.590518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fdbb1-850a-4b97-bff4-3e5421628502 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:32.590799 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fdbb1-850a-4b97-bff4-3e5421628502 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:32.591076 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fdbb1-850a-4b97-bff4-3e5421628502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:32.609754 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e43fdbb1-850a-4b97-bff4-3e5421628502 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:32.610956 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e43fdbb1-850a-4b97-bff4-3e5421628502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:32.624385 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97b1ca-1356-4d1c-a290-80ce4a4c96b8 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:32.662373 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9145e5-38dc-4939-b37c-3558d4f3f70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:32.663052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9145e5-38dc-4939-b37c-3558d4f3f70f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:32.663335 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9145e5-38dc-4939-b37c-3558d4f3f70f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:32.663641 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9145e5-38dc-4939-b37c-3558d4f3f70f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:32.674901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9145e5-38dc-4939-b37c-3558d4f3f70f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:32.676360 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9145e5-38dc-4939-b37c-3558d4f3f70f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:32.688732 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 369/741] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:18:32.688732 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fdbb1-850a-4b97-bff4-3e5421628502 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:32.702815 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:32.705573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-0f9145e5-38dc-4939-b37c-3558d4f3f70f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:32.705573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:32.705573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:32.705573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:32.705573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:32.705573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:32.705573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:32.705573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:32.705573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:32.705573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:32.705573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:32.705573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:32.705573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:32.705573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:32.705573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:32.705573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:32.706765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:32.706765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:32.706765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:32.706765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:32.706765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:32.706765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:32.706765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:32.706765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:32.706765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:32.706765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:32.706765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:32.706765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:32.706765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:32.706765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:32.706765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:32.706765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:32.706765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:32.708559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:32.708559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:32.708559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:32.708559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 373/742] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:32.708559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9145e5-38dc-4939-b37c-3558d4f3f70f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:32.801553 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:32.823733 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fdbb1-850a-4b97-bff4-3e5421628502 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:32.846619 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9145e5-38dc-4939-b37c-3558d4f3f70f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:32.869276 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7b3af-fe91-4c54-b2c5-3b29e5f91c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:32.870023 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7b3af-fe91-4c54-b2c5-3b29e5f91c17 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:32.870405 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7b3af-fe91-4c54-b2c5-3b29e5f91c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:32.870764 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7b3af-fe91-4c54-b2c5-3b29e5f91c17 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:32.871522 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7b3af-fe91-4c54-b2c5-3b29e5f91c17 None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:32.871925 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7b3af-fe91-4c54-b2c5-3b29e5f91c17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:32.873632 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7b3af-fe91-4c54-b2c5-3b29e5f91c17 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:32.883272 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 370/743] 10.222.0.96 () {56 vars in 1103 bytes} [Wed Aug 24 04:18:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:32.884351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7b3af-fe91-4c54-b2c5-3b29e5f91c17 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:32.894160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c52665-907c-40fd-a6b7-1384ec24baf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:32.895725 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c52665-907c-40fd-a6b7-1384ec24baf1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:32.896105 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c52665-907c-40fd-a6b7-1384ec24baf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:32.896479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c52665-907c-40fd-a6b7-1384ec24baf1 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:32.897365 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c52665-907c-40fd-a6b7-1384ec24baf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:32.897793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c52665-907c-40fd-a6b7-1384ec24baf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:32.899284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c52665-907c-40fd-a6b7-1384ec24baf1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:32.912104 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 374/744] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:32.913237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c52665-907c-40fd-a6b7-1384ec24baf1 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:32.970186 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:33.004466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7b3af-fe91-4c54-b2c5-3b29e5f91c17 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:33.040315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b899e1-a15e-4c86-93c2-6c42458f74ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:33.040957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b899e1-a15e-4c86-93c2-6c42458f74ee None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:33.041285 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b899e1-a15e-4c86-93c2-6c42458f74ee None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:33.041549 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b899e1-a15e-4c86-93c2-6c42458f74ee None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:33.042195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b899e1-a15e-4c86-93c2-6c42458f74ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:33.042500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b899e1-a15e-4c86-93c2-6c42458f74ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:33.043860 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b899e1-a15e-4c86-93c2-6c42458f74ee None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:33.044970 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c52665-907c-40fd-a6b7-1384ec24baf1 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:33.056817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 371/745] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:33.057793 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b899e1-a15e-4c86-93c2-6c42458f74ee None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:33.082757 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:33.090107 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017d814-9fa4-4d92-b12a-35d4ae443867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:33.090958 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017d814-9fa4-4d92-b12a-35d4ae443867 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:33.091455 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017d814-9fa4-4d92-b12a-35d4ae443867 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:33.091934 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017d814-9fa4-4d92-b12a-35d4ae443867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:33.102686 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017d814-9fa4-4d92-b12a-35d4ae443867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:33.104155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017d814-9fa4-4d92-b12a-35d4ae443867 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:33.119867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-1017d814-9fa4-4d92-b12a-35d4ae443867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:33.119867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:33.119867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:33.119867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:33.119867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:33.119867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:33.119867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:33.119867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:33.119867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:33.119867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:33.119867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:33.119867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:33.119867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:33.119867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:33.119867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:33.119867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:33.121076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:33.121076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:33.121076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:33.121076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:33.121076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:33.121076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:33.121076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:33.121076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:33.121076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:33.121076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:33.121076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:33.121076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:33.121076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:33.121076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:33.121076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:33.121076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:33.121076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:33.121978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:33.121978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:33.121978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:33.121978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 375/746] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:33.122199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017d814-9fa4-4d92-b12a-35d4ae443867 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:33.181423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b899e1-a15e-4c86-93c2-6c42458f74ee None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:33.213450 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:33.220310 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e25775-828f-4035-8ad7-f75caa490f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:33.221034 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e25775-828f-4035-8ad7-f75caa490f23 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:33.221216 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e25775-828f-4035-8ad7-f75caa490f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:33.221489 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e25775-828f-4035-8ad7-f75caa490f23 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:33.229231 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e25775-828f-4035-8ad7-f75caa490f23 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:33.230681 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e25775-828f-4035-8ad7-f75caa490f23 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:33.242519 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017d814-9fa4-4d92-b12a-35d4ae443867 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:33.243695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-c1e25775-828f-4035-8ad7-f75caa490f23 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:18:33.243695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:33.243695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:33.243695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:33.243695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:33.243695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:33.243695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:33.243695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:33.243695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:33.243695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:33.243695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:33.243695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:33.243695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:33.243695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:33.243695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:33.243695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:33.244680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:33.244680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:33.244680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:33.244680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:33.244680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:33.244680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:33.244680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:33.244680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:33.244680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:33.244680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:33.244680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:33.244680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:33.244680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:33.244680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:33.244680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:33.244680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:33.244680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:33.244680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:33.246372 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:33.246372 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:33.246372 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:33.246372 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:33.246372 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:33.246372 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:33.246372 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:33.246372 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:33.246372 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:18:33.246372 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:33.246372 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 372/747] 10.222.0.96 () {56 vars in 1093 bytes} [Wed Aug 24 04:18:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:33.246372 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e25775-828f-4035-8ad7-f75caa490f23 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:33.287474 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822fd07-36be-4b11-a107-e3ca501aa5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:33.288092 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822fd07-36be-4b11-a107-e3ca501aa5fd None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:33.288377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822fd07-36be-4b11-a107-e3ca501aa5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:33.288792 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822fd07-36be-4b11-a107-e3ca501aa5fd None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:33.289443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822fd07-36be-4b11-a107-e3ca501aa5fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:33.291039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822fd07-36be-4b11-a107-e3ca501aa5fd None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:33.308588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 376/748] 10.222.0.96 () {60 vars in 1141 bytes} [Wed Aug 24 04:18:33 2022] POST /identity/v3/services => generated 240 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:18:33.309462 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822fd07-36be-4b11-a107-e3ca501aa5fd None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:33.363835 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e25775-828f-4035-8ad7-f75caa490f23 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:33.371815 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:33.410719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881b902-bf02-4ed3-b3e1-c9055efcac79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:33.411425 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881b902-bf02-4ed3-b3e1-c9055efcac79 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:33.411694 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881b902-bf02-4ed3-b3e1-c9055efcac79 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:33.411970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881b902-bf02-4ed3-b3e1-c9055efcac79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:33.419355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881b902-bf02-4ed3-b3e1-c9055efcac79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:33.420882 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881b902-bf02-4ed3-b3e1-c9055efcac79 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:33.434201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-2881b902-bf02-4ed3-b3e1-c9055efcac79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:33.434201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:33.434201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:33.434201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:33.434201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:33.434201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:33.434201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:33.434201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:33.434201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:33.434201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:33.434201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:33.434201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:33.434201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:33.434201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:33.434201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:33.435383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:33.435383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:33.435383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:33.435383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:33.435383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:33.435383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:33.435383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:33.435383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:33.435383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:33.435383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:33.435383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:33.435383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:33.435383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:33.435383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:33.435383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:33.435383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:33.435383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:33.436283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:33.436283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:33.436283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:33.436283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:33.436283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:33.436283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:33.436283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:33.436283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:33.436283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 373/749] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:33.436814 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881b902-bf02-4ed3-b3e1-c9055efcac79 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:33.448192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822fd07-36be-4b11-a107-e3ca501aa5fd None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:33.493470 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee593b7e-cd01-496d-9f36-4490d4865fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:33.494784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee593b7e-cd01-496d-9f36-4490d4865fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:33.495222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee593b7e-cd01-496d-9f36-4490d4865fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:33.496064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee593b7e-cd01-496d-9f36-4490d4865fe3 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:33.496788 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee593b7e-cd01-496d-9f36-4490d4865fe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:33.497055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee593b7e-cd01-496d-9f36-4490d4865fe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:33.498575 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee593b7e-cd01-496d-9f36-4490d4865fe3 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:33.501602 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:33.511680 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 377/750] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:33.512963 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebd81f-7b51-436d-8890-f16e27811188 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:33.513255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebd81f-7b51-436d-8890-f16e27811188 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:33.513534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebd81f-7b51-436d-8890-f16e27811188 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:33.514884 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 378/751] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:33.515461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebd81f-7b51-436d-8890-f16e27811188 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:33.562926 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881b902-bf02-4ed3-b3e1-c9055efcac79 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:33.599561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cb8e1-2256-4e0e-ba0e-e5364624ad4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:33.600481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cb8e1-2256-4e0e-ba0e-e5364624ad4b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:33.600793 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cb8e1-2256-4e0e-ba0e-e5364624ad4b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:33.601071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cb8e1-2256-4e0e-ba0e-e5364624ad4b None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:33.601814 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cb8e1-2256-4e0e-ba0e-e5364624ad4b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:33.602126 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cb8e1-2256-4e0e-ba0e-e5364624ad4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:33.603576 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cb8e1-2256-4e0e-ba0e-e5364624ad4b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:33.622592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 374/752] 10.222.0.96 () {56 vars in 1133 bytes} [Wed Aug 24 04:18:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:33.623260 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cb8e1-2256-4e0e-ba0e-e5364624ad4b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:33.633358 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebd81f-7b51-436d-8890-f16e27811188 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:33.634957 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:33.672547 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c1228-740e-46af-9dc3-5a3efb7aaad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:33.673202 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c1228-740e-46af-9dc3-5a3efb7aaad3 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:33.673511 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c1228-740e-46af-9dc3-5a3efb7aaad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:33.673769 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c1228-740e-46af-9dc3-5a3efb7aaad3 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:33.674469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c1228-740e-46af-9dc3-5a3efb7aaad3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:33.674781 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c1228-740e-46af-9dc3-5a3efb7aaad3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:33.676873 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c1228-740e-46af-9dc3-5a3efb7aaad3 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:33.694275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 379/753] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:33.694275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff811aed-d94b-4feb-b220-8bd29f4a02cc None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:33.694275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff811aed-d94b-4feb-b220-8bd29f4a02cc None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:33.694275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff811aed-d94b-4feb-b220-8bd29f4a02cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:33.709596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ff811aed-d94b-4feb-b220-8bd29f4a02cc None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:33.710802 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ff811aed-d94b-4feb-b220-8bd29f4a02cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:33.731883 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cb8e1-2256-4e0e-ba0e-e5364624ad4b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:33.740370 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:33.775566 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6996b-480a-4e52-8e57-7cd36e0b43cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:33.776131 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6996b-480a-4e52-8e57-7cd36e0b43cf None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:33.776612 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6996b-480a-4e52-8e57-7cd36e0b43cf None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:33.777182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6996b-480a-4e52-8e57-7cd36e0b43cf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:33.787392 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6996b-480a-4e52-8e57-7cd36e0b43cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:33.788951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6996b-480a-4e52-8e57-7cd36e0b43cf None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:33.801003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 380/754] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:18:33.801283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-e2a6996b-480a-4e52-8e57-7cd36e0b43cf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:18:33.801283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:33.801283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:33.801283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:33.801283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:33.801283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:33.801283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:33.801283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:33.801283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:33.801283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:33.801283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:33.801283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:33.801283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:33.801283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:33.801283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:33.801283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:33.802182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:33.802182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:33.802182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:33.802182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:33.802182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:33.802182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:33.802182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:33.802182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:33.802182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:33.802182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:33.802182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:33.802182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:33.802182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:33.802182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:33.802182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:33.802182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:33.802182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:33.802182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:33.805784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:33.805784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:33.805784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:33.805784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:33.805784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:33.805784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:33.805784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:33.805784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:33.805784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:18:33.805784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:33.806417 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff811aed-d94b-4feb-b220-8bd29f4a02cc None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:33.806527 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 375/755] 10.222.0.96 () {56 vars in 1117 bytes} [Wed Aug 24 04:18:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:33.806527 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6996b-480a-4e52-8e57-7cd36e0b43cf None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:33.922602 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6996b-480a-4e52-8e57-7cd36e0b43cf None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:33.930754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:33.943487 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff811aed-d94b-4feb-b220-8bd29f4a02cc None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:33.962309 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec3859-8c41-4e9d-a38b-729e35377a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:33.963069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec3859-8c41-4e9d-a38b-729e35377a24 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:33.963633 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec3859-8c41-4e9d-a38b-729e35377a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:33.963912 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec3859-8c41-4e9d-a38b-729e35377a24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:33.964850 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec3859-8c41-4e9d-a38b-729e35377a24 None admin] RBAC: Adding query filter params (role.id=059d2bf5bb8e42939f5f826bfdad6a21, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=953d2dbd5e7d435f9148fd043b4ce7a7) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:33.965264 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec3859-8c41-4e9d-a38b-729e35377a24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:33.966931 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec3859-8c41-4e9d-a38b-729e35377a24 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:33.981271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 376/756] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:18:33 2022] GET /identity/v3/role_assignments?user.id=953d2dbd5e7d435f9148fd043b4ce7a7&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=059d2bf5bb8e42939f5f826bfdad6a21 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:33.982487 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec3859-8c41-4e9d-a38b-729e35377a24 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:33.990493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61d5ef-3f8c-4f01-a8a6-3ab0851dfab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:33.991446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61d5ef-3f8c-4f01-a8a6-3ab0851dfab8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:33.998448 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61d5ef-3f8c-4f01-a8a6-3ab0851dfab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:33.998967 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61d5ef-3f8c-4f01-a8a6-3ab0851dfab8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:34.021396 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61d5ef-3f8c-4f01-a8a6-3ab0851dfab8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:34.024905 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61d5ef-3f8c-4f01-a8a6-3ab0851dfab8 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:34.051531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-0a61d5ef-3f8c-4f01-a8a6-3ab0851dfab8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:34.051531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:34.051531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:34.051531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:34.051531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:34.051531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:34.051531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:34.051531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:34.051531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:34.051531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:34.051531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:34.051531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:34.051531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:34.051531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:34.051531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:34.051531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:34.052721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:34.052721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:34.052721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:34.052721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:34.052721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:34.052721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:34.052721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:34.052721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:34.052721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:34.052721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:34.052721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:34.052721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:34.052721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:34.052721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:34.052721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:34.052721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:34.052721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:34.053897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:34.053897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:34.053897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:34.056880 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 381/757] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:34.059090 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:34.062667 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61d5ef-3f8c-4f01-a8a6-3ab0851dfab8 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:34.165162 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec3859-8c41-4e9d-a38b-729e35377a24 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:34.186625 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61d5ef-3f8c-4f01-a8a6-3ab0851dfab8 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:34.208312 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d9a5e-42b3-4806-b7c2-a8e8a7ef9018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:34.209232 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d9a5e-42b3-4806-b7c2-a8e8a7ef9018 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:34.209674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d9a5e-42b3-4806-b7c2-a8e8a7ef9018 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:34.210555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d9a5e-42b3-4806-b7c2-a8e8a7ef9018 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:34.211501 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d9a5e-42b3-4806-b7c2-a8e8a7ef9018 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:34.212238 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d9a5e-42b3-4806-b7c2-a8e8a7ef9018 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:34.214063 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d9a5e-42b3-4806-b7c2-a8e8a7ef9018 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:34.227388 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf651944-08d6-4b62-8969-95e7f535f943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:34.227686 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf651944-08d6-4b62-8969-95e7f535f943 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:34.228097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf651944-08d6-4b62-8969-95e7f535f943 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:34.228470 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf651944-08d6-4b62-8969-95e7f535f943 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:34.229288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf651944-08d6-4b62-8969-95e7f535f943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:34.229697 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf651944-08d6-4b62-8969-95e7f535f943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:34.231167 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf651944-08d6-4b62-8969-95e7f535f943 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:34.242038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 377/758] 10.222.0.96 () {56 vars in 1149 bytes} [Wed Aug 24 04:18:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:34.242038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d9a5e-42b3-4806-b7c2-a8e8a7ef9018 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:34.248955 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 382/759] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:34.250171 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf651944-08d6-4b62-8969-95e7f535f943 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:34.255608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:34.346605 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:34.364035 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d9a5e-42b3-4806-b7c2-a8e8a7ef9018 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:34.372270 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf651944-08d6-4b62-8969-95e7f535f943 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:34.409869 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420695fa-f8dd-44ce-9353-74fb0366f04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:34.410624 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420695fa-f8dd-44ce-9353-74fb0366f04c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:34.410909 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420695fa-f8dd-44ce-9353-74fb0366f04c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:34.411189 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420695fa-f8dd-44ce-9353-74fb0366f04c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:34.414421 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e78a87-1918-4732-b6e6-d7d62d6d6c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:34.415225 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e78a87-1918-4732-b6e6-d7d62d6d6c7d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:34.415511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e78a87-1918-4732-b6e6-d7d62d6d6c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:34.415785 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e78a87-1918-4732-b6e6-d7d62d6d6c7d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:34.416742 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e78a87-1918-4732-b6e6-d7d62d6d6c7d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:34.418391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e78a87-1918-4732-b6e6-d7d62d6d6c7d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:34.434577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-f0e78a87-1918-4732-b6e6-d7d62d6d6c7d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:18:34.434577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:34.434577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:18:34.434577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:18:34.434577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:18:34.434577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:18:34.434577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:18:34.434577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:34.434577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:18:34.434577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:34.434577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:18:34.434577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:34.434577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:34.434577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:34.434577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:34.434577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:34.434577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:34.435645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:34.435645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:34.435645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:34.435645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:34.435645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:34.435645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:34.435645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:18:34.435645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:18:34.435645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:18:34.435645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:18:34.435645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:34.435645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:34.435645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:34.435645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:34.435645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:34.435645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:34.436481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:34.436481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:34.436481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:34.436481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:34.436481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:34.436481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:34.436481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:34.436481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:34.436481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:34.436481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:34.436481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:18:34.436481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:34.436481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:18:34.436481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:34.446908 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 378/760] 10.222.0.96 () {56 vars in 1129 bytes} [Wed Aug 24 04:18:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:34.446908 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e78a87-1918-4732-b6e6-d7d62d6d6c7d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:34.513675 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420695fa-f8dd-44ce-9353-74fb0366f04c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:34.515340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420695fa-f8dd-44ce-9353-74fb0366f04c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:34.519178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:34.635152 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 383/761] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:18:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:18:34.636116 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420695fa-f8dd-44ce-9353-74fb0366f04c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:34.696175 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e78a87-1918-4732-b6e6-d7d62d6d6c7d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:34.732969 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cd571-1d89-430c-ad85-4261044d7d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:34.733946 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cd571-1d89-430c-ad85-4261044d7d64 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:34.734453 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cd571-1d89-430c-ad85-4261044d7d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:34.734987 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cd571-1d89-430c-ad85-4261044d7d64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:34.743453 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3cd571-1d89-430c-ad85-4261044d7d64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:34.745232 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3cd571-1d89-430c-ad85-4261044d7d64 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:34.757372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420695fa-f8dd-44ce-9353-74fb0366f04c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:34.758387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-0c3cd571-1d89-430c-ad85-4261044d7d64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:34.758387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:34.758387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:34.758387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:34.758387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:34.758387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:34.758387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:34.758387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:34.758387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:34.758387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:34.758387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:34.758387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:34.758387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:34.758387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:34.758387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:34.759249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:34.759249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:34.759249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:34.759249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:34.759249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:34.759249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:34.759249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:34.759249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:34.759249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:34.759249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:34.759249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:34.759249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:34.759249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:34.759249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:34.759249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:34.759249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:34.759249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:34.760128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:34.760128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:34.760128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:34.760128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:34.760128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:34.760128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:34.760128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:34.760128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:34.762482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 379/762] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:34.763461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cd571-1d89-430c-ad85-4261044d7d64 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:34.779713 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:34.783554 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:34.811341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31e6af-126b-482b-bf26-cfbd0f093fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:34.812317 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31e6af-126b-482b-bf26-cfbd0f093fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:34.812859 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31e6af-126b-482b-bf26-cfbd0f093fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:34.813338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31e6af-126b-482b-bf26-cfbd0f093fd3 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:34.814713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31e6af-126b-482b-bf26-cfbd0f093fd3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:34.815453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31e6af-126b-482b-bf26-cfbd0f093fd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:34.818434 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31e6af-126b-482b-bf26-cfbd0f093fd3 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:34.836534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 384/763] 10.222.0.96 () {56 vars in 1124 bytes} [Wed Aug 24 04:18:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:34.837631 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31e6af-126b-482b-bf26-cfbd0f093fd3 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:34.901733 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cd571-1d89-430c-ad85-4261044d7d64 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:34.950166 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a525a62-4b26-4bb6-a993-dfbb9dd73f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:34.951192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a525a62-4b26-4bb6-a993-dfbb9dd73f87 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:34.951481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a525a62-4b26-4bb6-a993-dfbb9dd73f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:34.951758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a525a62-4b26-4bb6-a993-dfbb9dd73f87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:34.966295 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a525a62-4b26-4bb6-a993-dfbb9dd73f87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:34.968012 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a525a62-4b26-4bb6-a993-dfbb9dd73f87 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:34.969134 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31e6af-126b-482b-bf26-cfbd0f093fd3 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:34.987469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-7a525a62-4b26-4bb6-a993-dfbb9dd73f87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:34.987469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:34.987469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:34.987469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:34.987469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:34.987469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:34.987469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:34.987469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:34.987469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:34.987469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:34.987469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:34.987469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:34.987469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:34.987469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:34.987469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:34.987469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:34.988534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:34.988534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:34.988534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:34.988534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:34.988534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:34.988534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:34.988534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:34.988534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:34.988534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:34.988534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:34.988534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:34.988534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:34.988534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:34.988534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:34.988534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:34.988534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:34.988534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:34.989506 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:34.989506 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:34.989506 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:34.989506 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 380/764] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:34.990033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a525a62-4b26-4bb6-a993-dfbb9dd73f87 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:35.013929 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56aa6c-2ffd-439b-8842-0013b1e080ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:35.014968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56aa6c-2ffd-439b-8842-0013b1e080ca None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:35.015521 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56aa6c-2ffd-439b-8842-0013b1e080ca None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:35.016022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56aa6c-2ffd-439b-8842-0013b1e080ca None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:35.016995 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56aa6c-2ffd-439b-8842-0013b1e080ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:35.017519 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56aa6c-2ffd-439b-8842-0013b1e080ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:35.021058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56aa6c-2ffd-439b-8842-0013b1e080ca None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:35.039021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 385/765] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:35.040333 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56aa6c-2ffd-439b-8842-0013b1e080ca None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:35.061202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:35.072140 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:35.108636 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a525a62-4b26-4bb6-a993-dfbb9dd73f87 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:35.148408 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d62ac-70bd-4036-ba48-a83a0c46f9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:35.149073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d62ac-70bd-4036-ba48-a83a0c46f9ef None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:35.149359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d62ac-70bd-4036-ba48-a83a0c46f9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:35.149636 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d62ac-70bd-4036-ba48-a83a0c46f9ef None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:35.150268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d62ac-70bd-4036-ba48-a83a0c46f9ef None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:35.150577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d62ac-70bd-4036-ba48-a83a0c46f9ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:35.152362 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d62ac-70bd-4036-ba48-a83a0c46f9ef None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:35.155425 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56aa6c-2ffd-439b-8842-0013b1e080ca None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:35.163806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 381/766] 10.222.0.96 () {56 vars in 1124 bytes} [Wed Aug 24 04:18:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:35.164468 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d62ac-70bd-4036-ba48-a83a0c46f9ef None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:35.195059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1758a2-f2d6-4e86-b924-d8e29fa28a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:35.196184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1758a2-f2d6-4e86-b924-d8e29fa28a99 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:35.196955 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1758a2-f2d6-4e86-b924-d8e29fa28a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:35.197440 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1758a2-f2d6-4e86-b924-d8e29fa28a99 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:35.198314 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1758a2-f2d6-4e86-b924-d8e29fa28a99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:35.198869 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1758a2-f2d6-4e86-b924-d8e29fa28a99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:35.200462 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1758a2-f2d6-4e86-b924-d8e29fa28a99 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:35.214622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 386/767] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:35.215859 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1758a2-f2d6-4e86-b924-d8e29fa28a99 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:35.277701 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d62ac-70bd-4036-ba48-a83a0c46f9ef None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:35.307049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:35.310742 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:35.318307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f49bd-8a1a-4408-b9ce-63b76477232f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:35.319100 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f49bd-8a1a-4408-b9ce-63b76477232f None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:35.319284 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f49bd-8a1a-4408-b9ce-63b76477232f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:35.319544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f49bd-8a1a-4408-b9ce-63b76477232f None admin] PATH_INFO: `/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/3539784b4e91472eb20addc6707dc30d/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:35.321832 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f49bd-8a1a-4408-b9ce-63b76477232f None admin] RBAC: Authorizing `identity:create_grant(project_id=d76b6cd68a7f4613a8e921781495f256, user_id=3539784b4e91472eb20addc6707dc30d, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:35.323268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f49bd-8a1a-4408-b9ce-63b76477232f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:35.326255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1758a2-f2d6-4e86-b924-d8e29fa28a99 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:35.337536 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 382/768] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:18:35 2022] PUT /identity/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/3539784b4e91472eb20addc6707dc30d/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:18:35.339264 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f49bd-8a1a-4408-b9ce-63b76477232f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:35.387013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee252508-4498-4367-89a6-025c4487cb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:35.387685 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee252508-4498-4367-89a6-025c4487cb50 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:35.387970 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee252508-4498-4367-89a6-025c4487cb50 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:35.388249 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee252508-4498-4367-89a6-025c4487cb50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:35.389008 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee252508-4498-4367-89a6-025c4487cb50 None admin] RBAC: Adding query filter params (interface=public, service_id=5572efbb079d42b68b1b8f85a3d7d5f3, region_id=RegionOne) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:35.390074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee252508-4498-4367-89a6-025c4487cb50 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:35.391679 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee252508-4498-4367-89a6-025c4487cb50 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:35.403943 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 387/769] 10.222.0.96 () {56 vars in 1251 bytes} [Wed Aug 24 04:18:35 2022] GET /identity/v3/endpoints?service_id=5572efbb079d42b68b1b8f85a3d7d5f3&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:35.405259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ee0c3-7a74-4c48-b3a8-94c5984ab336 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:35.405551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ee0c3-7a74-4c48-b3a8-94c5984ab336 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:35.405828 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ee0c3-7a74-4c48-b3a8-94c5984ab336 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:35.407202 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 388/770] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:35.409473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ee0c3-7a74-4c48-b3a8-94c5984ab336 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:35.467230 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f49bd-8a1a-4408-b9ce-63b76477232f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:35.511979 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c3184-7755-4703-8dc0-54461fca3569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:35.512931 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c3184-7755-4703-8dc0-54461fca3569 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:35.513355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c3184-7755-4703-8dc0-54461fca3569 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:35.513767 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c3184-7755-4703-8dc0-54461fca3569 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:35.521465 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c3184-7755-4703-8dc0-54461fca3569 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:35.523086 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c3184-7755-4703-8dc0-54461fca3569 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:35.535026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-db5c3184-7755-4703-8dc0-54461fca3569 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:35.535026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:35.535026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:35.535026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:35.535026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:35.535026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:35.535026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:35.535026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:35.535026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:35.535026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:35.535026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:35.535026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:35.535026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:35.535026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:35.535026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:35.536328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:35.536328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:35.536328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:35.536328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:35.536328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:35.536328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:35.536328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:35.536328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:35.536328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:35.536328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:35.536328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:35.536328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:35.536328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:35.536328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:35.536328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:35.536328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:35.536328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:35.537519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:35.537519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:35.537519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:35.537519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:35.537519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:35.537519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:35.537519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:35.537519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:35.539565 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 383/771] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:35.541034 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce3852-7aae-42ad-87b6-a8f42a131e28 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:35.541552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce3852-7aae-42ad-87b6-a8f42a131e28 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:35.541831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce3852-7aae-42ad-87b6-a8f42a131e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:35.562105 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ee0c3-7a74-4c48-b3a8-94c5984ab336 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:35.564259 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-acce3852-7aae-42ad-87b6-a8f42a131e28 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:35.565564 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-acce3852-7aae-42ad-87b6-a8f42a131e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:35.613892 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479c352-4c9c-477d-9cf8-cf6af9a2f8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:35.614669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479c352-4c9c-477d-9cf8-cf6af9a2f8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:35.614954 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479c352-4c9c-477d-9cf8-cf6af9a2f8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:35.615339 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479c352-4c9c-477d-9cf8-cf6af9a2f8f5 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:35.615965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479c352-4c9c-477d-9cf8-cf6af9a2f8f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:35.617440 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479c352-4c9c-477d-9cf8-cf6af9a2f8f5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:35.623447 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 389/772] 10.222.0.96 () {56 vars in 1087 bytes} [Wed Aug 24 04:18:35 2022] GET /identity/v3/services => generated 772 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:35.623855 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:35.624667 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479c352-4c9c-477d-9cf8-cf6af9a2f8f5 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:35.647242 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:35.673070 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 384/773] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:18:35.767688 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479c352-4c9c-477d-9cf8-cf6af9a2f8f5 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:35.818257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fee0a-ce96-4bb5-8807-ea9661a1f7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:35.818882 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fee0a-ce96-4bb5-8807-ea9661a1f7ba None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:35.819166 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fee0a-ce96-4bb5-8807-ea9661a1f7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:35.819443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fee0a-ce96-4bb5-8807-ea9661a1f7ba None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:35.820194 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fee0a-ce96-4bb5-8807-ea9661a1f7ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:35.820509 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fee0a-ce96-4bb5-8807-ea9661a1f7ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:35.822291 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fee0a-ce96-4bb5-8807-ea9661a1f7ba None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:35.841259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 390/774] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:35.847133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce3852-7aae-42ad-87b6-a8f42a131e28 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:35.980252 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fee0a-ce96-4bb5-8807-ea9661a1f7ba None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:35.990237 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce3852-7aae-42ad-87b6-a8f42a131e28 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:36.030163 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc10b6-d619-4365-b954-adeb3744bdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:36.030789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc10b6-d619-4365-b954-adeb3744bdab None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:36.031072 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc10b6-d619-4365-b954-adeb3744bdab None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:36.031347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc10b6-d619-4365-b954-adeb3744bdab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:36.032090 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc10b6-d619-4365-b954-adeb3744bdab None admin] RBAC: Adding query filter params (role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=e9ffc48d1f6d49f49d00d1c2e762b987) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:36.032403 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc10b6-d619-4365-b954-adeb3744bdab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:36.033982 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc10b6-d619-4365-b954-adeb3744bdab None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:36.045043 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 385/775] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:18:35 2022] GET /identity/v3/role_assignments?user.id=e9ffc48d1f6d49f49d00d1c2e762b987&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:36.046638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5072a1a-3233-4201-b480-49b3bda328b4 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:36.046930 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5072a1a-3233-4201-b480-49b3bda328b4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:36.047210 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5072a1a-3233-4201-b480-49b3bda328b4 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:36.048681 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 386/776] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:36.055940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca9b4e-e987-4033-97ce-b4ac4138cc34 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:36.056249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca9b4e-e987-4033-97ce-b4ac4138cc34 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:36.056516 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca9b4e-e987-4033-97ce-b4ac4138cc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:36.085203 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-99ca9b4e-e987-4033-97ce-b4ac4138cc34 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:36.086458 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-99ca9b4e-e987-4033-97ce-b4ac4138cc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:36.087789 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:36.115576 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fee0a-ce96-4bb5-8807-ea9661a1f7ba None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:36.129185 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:36.156714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caba2a3-7985-4019-b312-d5aff39d411a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:36.157390 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caba2a3-7985-4019-b312-d5aff39d411a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:36.157673 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caba2a3-7985-4019-b312-d5aff39d411a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:36.157951 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caba2a3-7985-4019-b312-d5aff39d411a None admin] PATH_INFO: `/v3/services/network` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:36.158575 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caba2a3-7985-4019-b312-d5aff39d411a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:36.159977 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caba2a3-7985-4019-b312-d5aff39d411a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:36.170569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-9caba2a3-7985-4019-b312-d5aff39d411a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:18:36.170569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:36.170569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:18:36.170569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:18:36.170569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:18:36.170569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:18:36.170569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:18:36.170569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:36.170569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:18:36.170569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:36.170569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:18:36.170569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:36.170569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:36.170569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:36.170569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:36.170569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:36.170569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:36.171635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:36.171635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:36.171635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:36.171635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:36.171635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:36.171635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:36.171635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:18:36.171635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:18:36.171635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:18:36.171635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:18:36.171635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:36.171635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:36.171635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:36.171635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:36.171635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:36.171635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:36.172536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:36.172536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:36.172536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:36.172536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:36.172536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:36.172536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:36.172536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:36.172536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:36.172536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:36.172536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:36.172536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:18:36.172536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:36.172536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:18:36.172536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:36.172536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 391/777] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:35 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:18:36.181041 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caba2a3-7985-4019-b312-d5aff39d411a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:36.192525 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 387/778] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:18:36.314926 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caba2a3-7985-4019-b312-d5aff39d411a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:36.351550 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab04a0d-2082-4e46-a94d-d2d297904ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:36.352171 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab04a0d-2082-4e46-a94d-d2d297904ecd None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:36.352453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab04a0d-2082-4e46-a94d-d2d297904ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:36.352751 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab04a0d-2082-4e46-a94d-d2d297904ecd None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:36.353392 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab04a0d-2082-4e46-a94d-d2d297904ecd None admin] RBAC: Adding query filter params (name=network) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:36.353700 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab04a0d-2082-4e46-a94d-d2d297904ecd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:36.355074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab04a0d-2082-4e46-a94d-d2d297904ecd None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:36.360094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 392/779] 10.222.0.96 () {56 vars in 1112 bytes} [Wed Aug 24 04:18:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:36.366019 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca9b4e-e987-4033-97ce-b4ac4138cc34 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:36.520421 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca9b4e-e987-4033-97ce-b4ac4138cc34 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:36.528271 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab04a0d-2082-4e46-a94d-d2d297904ecd None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:36.534423 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:36.567218 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0a81a-4cd2-46c2-9502-48e1f984a10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:36.568942 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0a81a-4cd2-46c2-9502-48e1f984a10d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:36.569605 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0a81a-4cd2-46c2-9502-48e1f984a10d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:36.573026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0a81a-4cd2-46c2-9502-48e1f984a10d None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:36.573869 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0a81a-4cd2-46c2-9502-48e1f984a10d None admin] RBAC: Adding query filter params (type=network) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:36.574365 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0a81a-4cd2-46c2-9502-48e1f984a10d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:36.576033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0a81a-4cd2-46c2-9502-48e1f984a10d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:36.588922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 388/780] 10.222.0.96 () {56 vars in 1112 bytes} [Wed Aug 24 04:18:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:36.593276 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0a81a-4cd2-46c2-9502-48e1f984a10d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:36.657071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:36.739158 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab04a0d-2082-4e46-a94d-d2d297904ecd None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:36.766778 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0a81a-4cd2-46c2-9502-48e1f984a10d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:36.811050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d5cf5-208e-488b-b59e-c531be1a40e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:36.811690 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d5cf5-208e-488b-b59e-c531be1a40e8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:36.811969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d5cf5-208e-488b-b59e-c531be1a40e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:36.812240 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d5cf5-208e-488b-b59e-c531be1a40e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:36.822581 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca746c-8eb0-413b-bc52-0e9d5ccd5f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:36.823194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca746c-8eb0-413b-bc52-0e9d5ccd5f7d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:36.823475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca746c-8eb0-413b-bc52-0e9d5ccd5f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:36.823747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca746c-8eb0-413b-bc52-0e9d5ccd5f7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:36.824447 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca746c-8eb0-413b-bc52-0e9d5ccd5f7d None admin] RBAC: Adding query filter params (interface=public, service_id=3b3faf2ae07c46ccb386cfc6175c0ba4, region_id=RegionOne) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:36.836418 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca746c-8eb0-413b-bc52-0e9d5ccd5f7d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:36.837937 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca746c-8eb0-413b-bc52-0e9d5ccd5f7d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:36.849488 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d5cf5-208e-488b-b59e-c531be1a40e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:36.854784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-801d5cf5-208e-488b-b59e-c531be1a40e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:18:36.854784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:36.854784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:36.854784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:36.854784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:36.854784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:36.854784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:36.854784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:36.854784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:36.854784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:36.854784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:36.854784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:36.854784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:36.854784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:36.854784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:36.854784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:36.855931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:36.855931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:36.855931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:36.855931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:36.855931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:36.855931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:36.855931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:36.855931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:36.855931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:36.855931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:36.855931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:36.855931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:36.855931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:36.855931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:36.855931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:36.855931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:36.857033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:36.857033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:36.857033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:36.857033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:36.857033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:36.857033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:36.857033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:36.857033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:36.857033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:36.857033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:36.857033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:18:36.857033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:36.857033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 393/781] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:18:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:36.859875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 389/782] 10.222.0.96 () {56 vars in 1251 bytes} [Wed Aug 24 04:18:36 2022] GET /identity/v3/endpoints?service_id=3b3faf2ae07c46ccb386cfc6175c0ba4&interface=public®ion_id=RegionOne => generated 194 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:36.866179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d5cf5-208e-488b-b59e-c531be1a40e8 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:36.866316 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca746c-8eb0-413b-bc52-0e9d5ccd5f7d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:36.993880 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:37.031260 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:37.038572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca746c-8eb0-413b-bc52-0e9d5ccd5f7d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:37.051320 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d5cf5-208e-488b-b59e-c531be1a40e8 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:37.103485 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf1226-f57b-4fd6-b104-f18492841c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:37.104433 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf1226-f57b-4fd6-b104-f18492841c00 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:37.104964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf1226-f57b-4fd6-b104-f18492841c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:37.105447 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf1226-f57b-4fd6-b104-f18492841c00 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:37.106261 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf1226-f57b-4fd6-b104-f18492841c00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:37.108573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf1226-f57b-4fd6-b104-f18492841c00 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:37.116899 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6de84-3a8b-4fe4-b89d-442262b03425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:37.117842 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6de84-3a8b-4fe4-b89d-442262b03425 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:37.118329 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6de84-3a8b-4fe4-b89d-442262b03425 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:37.118816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6de84-3a8b-4fe4-b89d-442262b03425 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:37.119281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 390/783] 10.222.0.96 () {56 vars in 1087 bytes} [Wed Aug 24 04:18:36 2022] GET /identity/v3/services => generated 772 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:37.120259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6de84-3a8b-4fe4-b89d-442262b03425 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:37.120811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6de84-3a8b-4fe4-b89d-442262b03425 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:37.122438 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6de84-3a8b-4fe4-b89d-442262b03425 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:37.140778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 394/784] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:18:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:37.146204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf1226-f57b-4fd6-b104-f18492841c00 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:37.287639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf1226-f57b-4fd6-b104-f18492841c00 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:37.326705 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66174258-0918-4d2e-ab66-aabc6dcfdfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:37.327355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66174258-0918-4d2e-ab66-aabc6dcfdfee None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:37.327643 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66174258-0918-4d2e-ab66-aabc6dcfdfee None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:37.327920 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66174258-0918-4d2e-ab66-aabc6dcfdfee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:37.344502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66174258-0918-4d2e-ab66-aabc6dcfdfee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:37.346008 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66174258-0918-4d2e-ab66-aabc6dcfdfee None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:37.361671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-66174258-0918-4d2e-ab66-aabc6dcfdfee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:37.361671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:37.361671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:37.361671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:37.361671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:37.361671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:37.361671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:37.361671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:37.361671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:37.361671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:37.361671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:37.361671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:37.361671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:37.361671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:37.361671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:37.361671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:37.362641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:37.362641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:37.362641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:37.362641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:37.362641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:37.362641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:37.362641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:37.362641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:37.362641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:37.362641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:37.362641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:37.362641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:37.362641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:37.362641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:37.362641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:37.362641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:37.362641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:37.364256 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:37.364256 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:37.364256 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:37.364256 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 391/785] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:37.369184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6de84-3a8b-4fe4-b89d-442262b03425 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:37.530934 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6de84-3a8b-4fe4-b89d-442262b03425 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:37.570812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:37.581692 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f13b6-049b-4880-b0c5-2249c8a237b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:37.583519 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f13b6-049b-4880-b0c5-2249c8a237b5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:37.583984 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f13b6-049b-4880-b0c5-2249c8a237b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:37.584460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f13b6-049b-4880-b0c5-2249c8a237b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:37.585308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f13b6-049b-4880-b0c5-2249c8a237b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:37.585790 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f13b6-049b-4880-b0c5-2249c8a237b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:37.587328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f13b6-049b-4880-b0c5-2249c8a237b5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:37.600944 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 395/786] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:37.608801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66174258-0918-4d2e-ab66-aabc6dcfdfee None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:37.636642 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:37.713017 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff96ff0-615e-4b82-8d3e-fbc14d7a163d None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:37.713762 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff96ff0-615e-4b82-8d3e-fbc14d7a163d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:37.714331 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff96ff0-615e-4b82-8d3e-fbc14d7a163d None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:37.716348 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 396/787] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:37.725011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be859f74-6543-4395-97e2-d7fa93f93209 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:37.725389 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be859f74-6543-4395-97e2-d7fa93f93209 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:37.725783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be859f74-6543-4395-97e2-d7fa93f93209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:37.751642 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66174258-0918-4d2e-ab66-aabc6dcfdfee None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:37.761800 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-be859f74-6543-4395-97e2-d7fa93f93209 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:37.763264 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-be859f74-6543-4395-97e2-d7fa93f93209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:37.791242 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597cfb1-8ad0-4251-bdde-5dc54fa563e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:37.792188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597cfb1-8ad0-4251-bdde-5dc54fa563e8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:37.792923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597cfb1-8ad0-4251-bdde-5dc54fa563e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:37.793441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597cfb1-8ad0-4251-bdde-5dc54fa563e8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:37.802428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597cfb1-8ad0-4251-bdde-5dc54fa563e8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:37.804249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597cfb1-8ad0-4251-bdde-5dc54fa563e8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:37.818478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-f597cfb1-8ad0-4251-bdde-5dc54fa563e8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:18:37.818478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:37.818478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:37.818478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:37.818478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:37.818478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:37.818478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:37.818478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:37.818478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:37.818478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:37.818478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:37.818478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:37.818478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:37.818478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:37.818478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:37.818478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:37.819469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:37.819469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:37.819469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:37.819469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:37.819469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:37.819469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:37.819469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:37.819469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:37.819469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:37.819469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:37.819469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:37.819469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:37.819469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:37.819469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:37.819469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:37.819469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:37.819469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:37.819469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:37.820407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:37.820407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:37.820407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:37.820407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:37.820407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:37.820407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:37.820407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:37.820407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:37.820407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:18:37.820407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:37.823565 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 392/788] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:18:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:37.829192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597cfb1-8ad0-4251-bdde-5dc54fa563e8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:37.926991 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:37.927523 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 397/789] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:18:37.952040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597cfb1-8ad0-4251-bdde-5dc54fa563e8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:38.005806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5a7b5-fe6c-4b30-ae45-b624c2d2c803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:38.006428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5a7b5-fe6c-4b30-ae45-b624c2d2c803 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:38.006713 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5a7b5-fe6c-4b30-ae45-b624c2d2c803 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:38.006994 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5a7b5-fe6c-4b30-ae45-b624c2d2c803 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:38.007742 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5a7b5-fe6c-4b30-ae45-b624c2d2c803 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:38.008055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5a7b5-fe6c-4b30-ae45-b624c2d2c803 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:38.009572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b5a7b5-fe6c-4b30-ae45-b624c2d2c803 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:38.038598 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 393/790] 10.222.0.96 () {56 vars in 1135 bytes} [Wed Aug 24 04:18:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:38.044212 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be859f74-6543-4395-97e2-d7fa93f93209 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:38.179837 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be859f74-6543-4395-97e2-d7fa93f93209 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:38.202772 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:38.229420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd2d01-174f-4815-93a3-a3d1c017df2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:38.230068 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd2d01-174f-4815-93a3-a3d1c017df2b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:38.230359 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd2d01-174f-4815-93a3-a3d1c017df2b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:38.230645 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd2d01-174f-4815-93a3-a3d1c017df2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:38.244428 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd2d01-174f-4815-93a3-a3d1c017df2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:38.245998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd2d01-174f-4815-93a3-a3d1c017df2b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:38.265972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-eacd2d01-174f-4815-93a3-a3d1c017df2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:38.265972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:38.265972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:38.265972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:38.265972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:38.265972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:38.265972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:38.265972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:38.265972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:38.265972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:38.265972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:38.265972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:38.265972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:38.265972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:38.265972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:38.265972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:38.266965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:38.266965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:38.266965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:38.266965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:38.266965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:38.266965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:38.266965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:38.266965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:38.266965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:38.266965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:38.266965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:38.266965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:38.266965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:38.266965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:38.266965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:38.266965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:38.266965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:38.268453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:38.268453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:38.268453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:38.268453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 398/791] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:38.273397 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5a7b5-fe6c-4b30-ae45-b624c2d2c803 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:38.283739 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd2d01-174f-4815-93a3-a3d1c017df2b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:38.400948 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5a7b5-fe6c-4b30-ae45-b624c2d2c803 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:38.404250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd2d01-174f-4815-93a3-a3d1c017df2b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:38.436307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1de8c4-0d22-4143-ac4a-09c2fe97460c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:38.436877 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1de8c4-0d22-4143-ac4a-09c2fe97460c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:38.437154 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1de8c4-0d22-4143-ac4a-09c2fe97460c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:38.437430 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1de8c4-0d22-4143-ac4a-09c2fe97460c None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:38.438133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1de8c4-0d22-4143-ac4a-09c2fe97460c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:38.438402 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1de8c4-0d22-4143-ac4a-09c2fe97460c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:38.439765 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1de8c4-0d22-4143-ac4a-09c2fe97460c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:38.439986 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca3b9b-d186-49b7-9652-707915c9bcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:38.440608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca3b9b-d186-49b7-9652-707915c9bcfb None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:38.440916 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca3b9b-d186-49b7-9652-707915c9bcfb None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:38.441189 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca3b9b-d186-49b7-9652-707915c9bcfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:38.443112 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:38.452653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca3b9b-d186-49b7-9652-707915c9bcfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:38.458480 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 394/792] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:38.458480 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9a6f2-78bc-4ced-8dc5-a79808c2a1a3 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:38.458480 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9a6f2-78bc-4ced-8dc5-a79808c2a1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:38.458480 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9a6f2-78bc-4ced-8dc5-a79808c2a1a3 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:38.458840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-40ca3b9b-d186-49b7-9652-707915c9bcfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:18:38.458840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:38.458840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:38.458840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:38.458840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:38.458840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:38.458840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:38.458840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:38.458840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:38.458840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:38.458840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:38.458840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:38.458840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:38.458840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:38.458840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:38.458840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:38.459737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:38.459737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:38.459737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:38.459737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:38.459737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:38.459737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:38.459737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:38.459737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:38.459737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:38.459737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:38.459737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:38.459737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:38.459737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:38.459737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:38.459737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:38.459737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:38.460608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:38.460608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:38.460608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:38.460608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:38.460608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:38.460608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:38.460608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:38.460608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:38.460608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:38.460608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:38.460608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:18:38.460608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:38.461317 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 395/793] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:38.462197 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e348b9-f3b0-49f0-978e-4596790cfb55 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:38.462489 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e348b9-f3b0-49f0-978e-4596790cfb55 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:38.462763 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e348b9-f3b0-49f0-978e-4596790cfb55 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:38.468302 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 396/795] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:38.468426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 399/795] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:18:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:38.468505 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e348b9-f3b0-49f0-978e-4596790cfb55 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:38.468609 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd6e80-7d0a-4ba7-a78d-1d90c2ef42fe None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:38.468609 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd6e80-7d0a-4ba7-a78d-1d90c2ef42fe None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:38.468609 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd6e80-7d0a-4ba7-a78d-1d90c2ef42fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:38.485033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f2bd6e80-7d0a-4ba7-a78d-1d90c2ef42fe None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:38.486224 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f2bd6e80-7d0a-4ba7-a78d-1d90c2ef42fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:38.510934 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:38.564492 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 400/796] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:18:38.565965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b79b8-6fb5-4ae8-b47b-981bb1e234fd None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:38.566334 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b79b8-6fb5-4ae8-b47b-981bb1e234fd None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:38.567145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b79b8-6fb5-4ae8-b47b-981bb1e234fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:38.586358 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-767b79b8-6fb5-4ae8-b47b-981bb1e234fd None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:38.587891 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-767b79b8-6fb5-4ae8-b47b-981bb1e234fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:38.596640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e348b9-f3b0-49f0-978e-4596790cfb55 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:38.631520 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafc0e0-f822-4f26-adc9-4a4e444823f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:38.632154 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafc0e0-f822-4f26-adc9-4a4e444823f4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:38.632410 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafc0e0-f822-4f26-adc9-4a4e444823f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:38.632712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafc0e0-f822-4f26-adc9-4a4e444823f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:38.639668 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafc0e0-f822-4f26-adc9-4a4e444823f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:38.641157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafc0e0-f822-4f26-adc9-4a4e444823f4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:38.652729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-5bafc0e0-f822-4f26-adc9-4a4e444823f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:38.652729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:38.652729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:38.652729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:38.652729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:38.652729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:38.652729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:38.652729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:38.652729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:38.652729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:38.652729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:38.652729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:38.652729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:38.652729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:38.652729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:38.653650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:38.653650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:38.653650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:38.653650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:38.653650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:38.653650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:38.653650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:38.653650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:38.653650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:38.653650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:38.653650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:38.653650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:38.653650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:38.653650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:38.653650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:38.653650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:38.653650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:38.654583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:38.654583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:38.654583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:38.654583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:38.654583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:38.654583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:38.654583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:38.654583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:38.658616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 397/797] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:38.659460 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafc0e0-f822-4f26-adc9-4a4e444823f4 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:38.688790 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 401/798] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:18:38.688790 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b79b8-6fb5-4ae8-b47b-981bb1e234fd None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:38.753731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:38.836420 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafc0e0-f822-4f26-adc9-4a4e444823f4 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:38.849387 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:38.865192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b79b8-6fb5-4ae8-b47b-981bb1e234fd None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:38.902888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a25c4-485c-48fc-9c77-a68b03b83768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:38.903494 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a25c4-485c-48fc-9c77-a68b03b83768 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:38.903772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a25c4-485c-48fc-9c77-a68b03b83768 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:38.904146 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a25c4-485c-48fc-9c77-a68b03b83768 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:38.904930 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a25c4-485c-48fc-9c77-a68b03b83768 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:38.905235 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a25c4-485c-48fc-9c77-a68b03b83768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:38.906660 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a25c4-485c-48fc-9c77-a68b03b83768 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:38.913263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cb846-f612-4071-9a00-80dd36e0957f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:38.913876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cb846-f612-4071-9a00-80dd36e0957f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:38.914158 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cb846-f612-4071-9a00-80dd36e0957f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:38.914432 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cb846-f612-4071-9a00-80dd36e0957f None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:38.915123 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cb846-f612-4071-9a00-80dd36e0957f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:38.915430 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cb846-f612-4071-9a00-80dd36e0957f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:38.916896 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cb846-f612-4071-9a00-80dd36e0957f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:38.920828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 398/799] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:18:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:38.921676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a25c4-485c-48fc-9c77-a68b03b83768 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:38.929811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 402/800] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:38.930643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cb846-f612-4071-9a00-80dd36e0957f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:39.058273 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cb846-f612-4071-9a00-80dd36e0957f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:39.059984 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a25c4-485c-48fc-9c77-a68b03b83768 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:39.077898 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:39.093884 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de252b6c-9b28-4f6a-8d5c-160198e02f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:39.094595 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de252b6c-9b28-4f6a-8d5c-160198e02f57 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:39.094811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de252b6c-9b28-4f6a-8d5c-160198e02f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:39.095090 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de252b6c-9b28-4f6a-8d5c-160198e02f57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:39.099038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a038f-0224-4b16-9db3-6e3a9a4ac3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:39.099665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a038f-0224-4b16-9db3-6e3a9a4ac3df None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:39.099945 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a038f-0224-4b16-9db3-6e3a9a4ac3df None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:39.100218 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a038f-0224-4b16-9db3-6e3a9a4ac3df None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:39.100875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a038f-0224-4b16-9db3-6e3a9a4ac3df None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:39.102234 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a038f-0224-4b16-9db3-6e3a9a4ac3df None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:39.106494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de252b6c-9b28-4f6a-8d5c-160198e02f57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:39.107937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de252b6c-9b28-4f6a-8d5c-160198e02f57 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:39.111502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-e82a038f-0224-4b16-9db3-6e3a9a4ac3df None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:18:39.111502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:39.111502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:18:39.111502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:18:39.111502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:18:39.111502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:18:39.111502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:18:39.111502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:39.111502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:18:39.111502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:39.111502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:18:39.111502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:39.111502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:39.111502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:39.111502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:39.111502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:39.111502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:39.112461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:39.112461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:39.112461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:39.112461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:39.112461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:39.112461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:39.112461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:18:39.112461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:18:39.112461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:18:39.112461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:18:39.112461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:39.112461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:39.112461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:39.112461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:39.112461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:39.112461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:39.117914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:39.117914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:39.117914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:39.117914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:39.117914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:39.117914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:39.117914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:39.117914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:39.117914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:39.117914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:39.117914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:18:39.117914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:39.117914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:18:39.117914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:39.117914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 399/801] 10.222.0.96 () {56 vars in 1129 bytes} [Wed Aug 24 04:18:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:39.118687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a038f-0224-4b16-9db3-6e3a9a4ac3df None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:39.119325 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:39.125222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-de252b6c-9b28-4f6a-8d5c-160198e02f57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:39.125222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:39.125222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:39.125222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:39.125222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:39.125222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:39.125222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:39.125222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:39.125222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:39.125222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:39.125222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:39.125222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:39.125222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:39.125222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:39.125222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:39.125222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:39.126137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:39.126137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:39.126137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:39.126137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:39.126137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:39.126137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:39.126137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:39.126137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:39.126137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:39.126137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:39.126137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:39.126137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:39.126137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:39.126137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:39.126137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:39.126137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:39.126137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:39.131824 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:39.131824 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:39.131824 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:39.131824 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 403/802] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:39.131824 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de252b6c-9b28-4f6a-8d5c-160198e02f57 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:39.230452 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a038f-0224-4b16-9db3-6e3a9a4ac3df None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:39.254936 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de252b6c-9b28-4f6a-8d5c-160198e02f57 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:39.267354 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a2f1d-354b-40aa-81c3-a2ffa6ee6f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:39.268022 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a2f1d-354b-40aa-81c3-a2ffa6ee6f7a None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:39.268399 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a2f1d-354b-40aa-81c3-a2ffa6ee6f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:39.268576 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a2f1d-354b-40aa-81c3-a2ffa6ee6f7a None admin] PATH_INFO: `/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/953d2dbd5e7d435f9148fd043b4ce7a7/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:39.271217 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a2f1d-354b-40aa-81c3-a2ffa6ee6f7a None admin] RBAC: Authorizing `identity:create_grant(project_id=d76b6cd68a7f4613a8e921781495f256, user_id=953d2dbd5e7d435f9148fd043b4ce7a7, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:39.272650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a2f1d-354b-40aa-81c3-a2ffa6ee6f7a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:39.287765 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 400/803] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:18:39 2022] PUT /identity/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/953d2dbd5e7d435f9148fd043b4ce7a7/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:18:39.288579 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a2f1d-354b-40aa-81c3-a2ffa6ee6f7a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:39.302033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9479f-85be-4564-bed5-95df30ae8b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:39.303041 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9479f-85be-4564-bed5-95df30ae8b83 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:39.303515 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9479f-85be-4564-bed5-95df30ae8b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:39.303977 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9479f-85be-4564-bed5-95df30ae8b83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:39.320802 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9479f-85be-4564-bed5-95df30ae8b83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:39.335201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-ded9479f-85be-4564-bed5-95df30ae8b83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:39.335201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:39.335201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:39.335201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:39.335201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:39.335201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:39.335201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:39.335201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:39.335201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:39.335201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:39.335201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:39.335201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:39.335201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:39.335201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:39.335201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:39.335201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:39.336207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:39.336207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:39.336207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:39.336207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:39.336207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:39.336207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:39.336207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:39.336207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:39.336207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:39.336207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:39.336207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:39.336207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:39.336207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:39.336207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:39.336207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:39.336207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:39.337524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:39.337524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:39.337524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:39.337524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:39.337524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:39.337524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:39.337524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:39.337524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:39.337524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:39.337524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:39.337524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:39.337524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:39.341039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 404/804] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:18:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:39.342098 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9479f-85be-4564-bed5-95df30ae8b83 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:39.348751 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:39.426102 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:39.437883 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a2f1d-354b-40aa-81c3-a2ffa6ee6f7a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:39.481712 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9479f-85be-4564-bed5-95df30ae8b83 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:39.487047 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8395ec-41ea-43b6-bfc2-5046c5d5c270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:39.487664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8395ec-41ea-43b6-bfc2-5046c5d5c270 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:39.487947 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8395ec-41ea-43b6-bfc2-5046c5d5c270 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:39.488323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8395ec-41ea-43b6-bfc2-5046c5d5c270 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:39.489465 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8395ec-41ea-43b6-bfc2-5046c5d5c270 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:39.489778 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8395ec-41ea-43b6-bfc2-5046c5d5c270 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:39.491592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8395ec-41ea-43b6-bfc2-5046c5d5c270 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:39.497572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 401/805] 10.222.0.96 () {56 vars in 1124 bytes} [Wed Aug 24 04:18:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:39.498539 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8395ec-41ea-43b6-bfc2-5046c5d5c270 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:39.525323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4bbc7-84c8-4a48-a430-fa7b96d8cba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:39.526190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4bbc7-84c8-4a48-a430-fa7b96d8cba1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:39.527041 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4bbc7-84c8-4a48-a430-fa7b96d8cba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:39.527504 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4bbc7-84c8-4a48-a430-fa7b96d8cba1 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:39.528564 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4bbc7-84c8-4a48-a430-fa7b96d8cba1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:39.529197 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4bbc7-84c8-4a48-a430-fa7b96d8cba1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:39.531362 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4bbc7-84c8-4a48-a430-fa7b96d8cba1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:39.551068 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 405/806] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:39.552308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4bbc7-84c8-4a48-a430-fa7b96d8cba1 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:39.621714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8395ec-41ea-43b6-bfc2-5046c5d5c270 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:39.625075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:39.668590 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1bccd-0904-45de-a8bc-a5a4be465037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:39.669502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1bccd-0904-45de-a8bc-a5a4be465037 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:39.669794 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1bccd-0904-45de-a8bc-a5a4be465037 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:39.670434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1bccd-0904-45de-a8bc-a5a4be465037 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:39.671201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1bccd-0904-45de-a8bc-a5a4be465037 None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:39.671438 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1bccd-0904-45de-a8bc-a5a4be465037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:39.672848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1bccd-0904-45de-a8bc-a5a4be465037 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:39.679759 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4bbc7-84c8-4a48-a430-fa7b96d8cba1 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:39.681342 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 402/807] 10.222.0.96 () {56 vars in 1103 bytes} [Wed Aug 24 04:18:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:39.681999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1bccd-0904-45de-a8bc-a5a4be465037 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:39.708099 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:39.724118 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8029759-3bdb-469c-aa0a-b0cabff794f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:39.724762 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8029759-3bdb-469c-aa0a-b0cabff794f4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:39.725048 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8029759-3bdb-469c-aa0a-b0cabff794f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:39.725325 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8029759-3bdb-469c-aa0a-b0cabff794f4 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:39.725960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8029759-3bdb-469c-aa0a-b0cabff794f4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:39.726265 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8029759-3bdb-469c-aa0a-b0cabff794f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:39.727771 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8029759-3bdb-469c-aa0a-b0cabff794f4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:39.733175 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 406/808] 10.222.0.96 () {56 vars in 1124 bytes} [Wed Aug 24 04:18:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:39.734430 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7d733-c4ad-47c4-a089-581de91706a5 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:39.734724 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7d733-c4ad-47c4-a089-581de91706a5 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:39.735003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7d733-c4ad-47c4-a089-581de91706a5 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:39.736813 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 407/809] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:39.737884 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7d733-c4ad-47c4-a089-581de91706a5 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:39.803641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1bccd-0904-45de-a8bc-a5a4be465037 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:39.844662 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aefb2d-565b-49d5-82c0-0a1848dbaf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:39.845327 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aefb2d-565b-49d5-82c0-0a1848dbaf57 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:39.845606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aefb2d-565b-49d5-82c0-0a1848dbaf57 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:39.845878 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aefb2d-565b-49d5-82c0-0a1848dbaf57 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:39.853630 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aefb2d-565b-49d5-82c0-0a1848dbaf57 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:39.855061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aefb2d-565b-49d5-82c0-0a1848dbaf57 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:39.856438 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7d733-c4ad-47c4-a089-581de91706a5 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:39.867573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-e7aefb2d-565b-49d5-82c0-0a1848dbaf57 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:18:39.867573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:39.867573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:39.867573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:39.867573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:39.867573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:39.867573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:39.867573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:39.867573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:39.867573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:39.867573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:39.867573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:39.867573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:39.867573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:39.867573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:39.867573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:39.868615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:39.868615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:39.868615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:39.868615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:39.868615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:39.868615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:39.868615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:39.868615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:39.868615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:39.868615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:39.868615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:39.868615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:39.868615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:39.868615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:39.868615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:39.868615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:39.868615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:39.868615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:39.874738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:39.874738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:39.874738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:39.874738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:39.874738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:39.874738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:39.874738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:39.874738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:39.874738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:18:39.874738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:39.874738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 403/810] 10.222.0.96 () {56 vars in 1093 bytes} [Wed Aug 24 04:18:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:39.874738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aefb2d-565b-49d5-82c0-0a1848dbaf57 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:39.898577 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41601404-22cb-4a78-9f02-c7f0e0332886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:39.899217 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41601404-22cb-4a78-9f02-c7f0e0332886 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:39.899511 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41601404-22cb-4a78-9f02-c7f0e0332886 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:39.899773 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41601404-22cb-4a78-9f02-c7f0e0332886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:39.900647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:39.911725 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41601404-22cb-4a78-9f02-c7f0e0332886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:39.913212 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41601404-22cb-4a78-9f02-c7f0e0332886 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:39.931023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-41601404-22cb-4a78-9f02-c7f0e0332886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:39.931023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:39.931023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:39.931023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:39.931023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:39.931023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:39.931023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:39.931023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:39.931023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:39.931023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:39.931023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:39.931023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:39.931023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:39.931023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:39.931023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:39.931023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:39.932016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:39.932016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:39.932016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:39.932016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:39.932016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:39.932016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:39.932016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:39.932016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:39.932016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:39.932016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:39.932016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:39.932016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:39.932016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:39.932016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:39.932016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:39.932016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:39.932016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:39.932932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:39.932932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:39.932932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:39.932932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 408/811] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:39.933795 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0074628-a15f-4c66-aba6-a305cf0ab6f1 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:39.933795 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0074628-a15f-4c66-aba6-a305cf0ab6f1 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:39.933945 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0074628-a15f-4c66-aba6-a305cf0ab6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:39.954151 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-c0074628-a15f-4c66-aba6-a305cf0ab6f1 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:39.955356 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c0074628-a15f-4c66-aba6-a305cf0ab6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:39.984060 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aefb2d-565b-49d5-82c0-0a1848dbaf57 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:39.991043 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:40.023672 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfda218-7550-4473-84e8-9f966a48ddaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:40.024436 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfda218-7550-4473-84e8-9f966a48ddaa None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:40.024855 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfda218-7550-4473-84e8-9f966a48ddaa None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:40.025234 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfda218-7550-4473-84e8-9f966a48ddaa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:40.026000 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfda218-7550-4473-84e8-9f966a48ddaa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:40.027495 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfda218-7550-4473-84e8-9f966a48ddaa None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:40.034550 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 409/812] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:18:40.035572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0074628-a15f-4c66-aba6-a305cf0ab6f1 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:40.069785 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 404/813] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:18:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:18:40.071328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfda218-7550-4473-84e8-9f966a48ddaa None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:40.166486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:40.181838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0074628-a15f-4c66-aba6-a305cf0ab6f1 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:40.198705 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfda218-7550-4473-84e8-9f966a48ddaa None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:40.235547 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd152a5a-56bf-4e98-8614-8cb60f26967a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:40.236623 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd152a5a-56bf-4e98-8614-8cb60f26967a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:40.237071 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd152a5a-56bf-4e98-8614-8cb60f26967a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:40.237571 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd152a5a-56bf-4e98-8614-8cb60f26967a None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:40.239190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd152a5a-56bf-4e98-8614-8cb60f26967a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:40.239657 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd152a5a-56bf-4e98-8614-8cb60f26967a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:40.239851 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507075bb-4d1d-48ba-b979-b58eee6c672b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:40.240564 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507075bb-4d1d-48ba-b979-b58eee6c672b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:40.240962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507075bb-4d1d-48ba-b979-b58eee6c672b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:40.241333 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507075bb-4d1d-48ba-b979-b58eee6c672b None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:40.241973 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd152a5a-56bf-4e98-8614-8cb60f26967a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:40.242172 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507075bb-4d1d-48ba-b979-b58eee6c672b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:40.242571 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507075bb-4d1d-48ba-b979-b58eee6c672b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:40.244067 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507075bb-4d1d-48ba-b979-b58eee6c672b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:40.257700 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 405/814] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:40.263520 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507075bb-4d1d-48ba-b979-b58eee6c672b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:40.271685 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 410/815] 10.222.0.96 () {56 vars in 1133 bytes} [Wed Aug 24 04:18:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:40.273864 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd152a5a-56bf-4e98-8614-8cb60f26967a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:40.302121 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:40.400617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507075bb-4d1d-48ba-b979-b58eee6c672b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:40.403037 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd152a5a-56bf-4e98-8614-8cb60f26967a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:40.438823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae15d32-ee76-4e2b-b3cc-09c4537ae514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:40.439362 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae15d32-ee76-4e2b-b3cc-09c4537ae514 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:40.439645 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae15d32-ee76-4e2b-b3cc-09c4537ae514 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:40.439921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae15d32-ee76-4e2b-b3cc-09c4537ae514 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:40.448879 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce319921-225c-469b-b414-8305b9bbd505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:40.450295 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce319921-225c-469b-b414-8305b9bbd505 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:40.450818 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce319921-225c-469b-b414-8305b9bbd505 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:40.451312 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce319921-225c-469b-b414-8305b9bbd505 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:40.462517 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce319921-225c-469b-b414-8305b9bbd505 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:40.464310 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce319921-225c-469b-b414-8305b9bbd505 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:40.467376 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:40.482647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-ce319921-225c-469b-b414-8305b9bbd505 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:18:40.482647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:40.482647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:40.482647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:40.482647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:40.482647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:40.482647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:40.482647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:40.482647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:40.482647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:40.482647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:40.482647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:40.482647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:40.482647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:40.482647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:40.482647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:40.483676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:40.483676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:40.483676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:40.483676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:40.483676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:40.483676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:40.483676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:40.483676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:40.483676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:40.483676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:40.483676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:40.483676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:40.483676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:40.483676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:40.483676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:40.483676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:40.483676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:40.483676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:40.484646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:40.484646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:40.484646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:40.484646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:40.484646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:40.484646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:40.484646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:40.484646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:40.484646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:18:40.484646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:40.487913 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 406/816] 10.222.0.96 () {56 vars in 1117 bytes} [Wed Aug 24 04:18:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:18:40.489948 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce319921-225c-469b-b414-8305b9bbd505 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:40.520265 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae15d32-ee76-4e2b-b3cc-09c4537ae514 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:40.521949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae15d32-ee76-4e2b-b3cc-09c4537ae514 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:40.561107 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:40.621278 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce319921-225c-469b-b414-8305b9bbd505 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:40.654054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 411/817] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:18:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:18:40.655295 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae15d32-ee76-4e2b-b3cc-09c4537ae514 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:40.666220 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7ddaf-eaf4-4fb9-901e-ee42b8cf42ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:40.666867 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7ddaf-eaf4-4fb9-901e-ee42b8cf42ac None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:40.667150 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7ddaf-eaf4-4fb9-901e-ee42b8cf42ac None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:40.667427 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7ddaf-eaf4-4fb9-901e-ee42b8cf42ac None admin] PATH_INFO: `/v3/services/network` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:40.668317 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7ddaf-eaf4-4fb9-901e-ee42b8cf42ac None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:40.669411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7ddaf-eaf4-4fb9-901e-ee42b8cf42ac None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:40.679077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-c2a7ddaf-eaf4-4fb9-901e-ee42b8cf42ac None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:18:40.679077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:40.679077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:18:40.679077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:18:40.679077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:18:40.679077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:18:40.679077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:18:40.679077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:40.679077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:18:40.679077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:40.679077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:18:40.679077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:40.679077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:40.679077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:40.679077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:40.679077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:40.679077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:40.680110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:40.680110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:40.680110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:40.680110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:40.680110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:40.680110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:40.680110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:18:40.680110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:18:40.680110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:18:40.680110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:18:40.680110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:40.680110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:40.680110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:40.680110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:40.680110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:40.680110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:40.681014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:40.681014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:40.681014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:40.681014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:40.681014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:40.681014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:40.681014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:40.681014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:40.681014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:40.681014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:40.681014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:18:40.681014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:40.681014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:18:40.681014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:40.685053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 407/818] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:40 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:40.686332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7ddaf-eaf4-4fb9-901e-ee42b8cf42ac None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:40.764789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:40.801703 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae15d32-ee76-4e2b-b3cc-09c4537ae514 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:40.810329 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7ddaf-eaf4-4fb9-901e-ee42b8cf42ac None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:40.836840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:40.857906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac07fa5-a487-47c7-a883-d6181c23cb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:40.858878 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac07fa5-a487-47c7-a883-d6181c23cb6a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:40.859299 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac07fa5-a487-47c7-a883-d6181c23cb6a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:40.859703 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac07fa5-a487-47c7-a883-d6181c23cb6a None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:40.860825 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac07fa5-a487-47c7-a883-d6181c23cb6a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:40.861276 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac07fa5-a487-47c7-a883-d6181c23cb6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:40.861659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af208fb-5822-46e4-8892-eea014fbcc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:40.862287 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af208fb-5822-46e4-8892-eea014fbcc8a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:40.862567 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af208fb-5822-46e4-8892-eea014fbcc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:40.862840 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af208fb-5822-46e4-8892-eea014fbcc8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:40.863015 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac07fa5-a487-47c7-a883-d6181c23cb6a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:40.874579 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af208fb-5822-46e4-8892-eea014fbcc8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:40.876033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af208fb-5822-46e4-8892-eea014fbcc8a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:40.891386 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 412/819] 10.222.0.96 () {56 vars in 1149 bytes} [Wed Aug 24 04:18:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:40.892421 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac07fa5-a487-47c7-a883-d6181c23cb6a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:40.898326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-0af208fb-5822-46e4-8892-eea014fbcc8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:40.898326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:40.898326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:40.898326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:40.898326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:40.898326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:40.898326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:40.898326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:40.898326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:40.898326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:40.898326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:40.898326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:40.898326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:40.898326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:40.898326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:40.898326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:40.899294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:40.899294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:40.899294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:40.899294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:40.899294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:40.899294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:40.899294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:40.899294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:40.899294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:40.899294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:40.899294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:40.899294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:40.899294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:40.899294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:40.899294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:40.899294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:40.899294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:40.900273 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:40.900273 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:40.900273 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:40.900273 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 408/820] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:40.900970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af208fb-5822-46e4-8892-eea014fbcc8a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:41.007076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac07fa5-a487-47c7-a883-d6181c23cb6a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:41.017346 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af208fb-5822-46e4-8892-eea014fbcc8a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:41.032867 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:41.043746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e2feb-e402-44c6-90f2-91a996d839a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:41.044359 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e2feb-e402-44c6-90f2-91a996d839a2 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:41.044637 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e2feb-e402-44c6-90f2-91a996d839a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:41.044938 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e2feb-e402-44c6-90f2-91a996d839a2 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:41.045587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e2feb-e402-44c6-90f2-91a996d839a2 None admin] RBAC: Adding query filter params (name=network) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:41.045916 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e2feb-e402-44c6-90f2-91a996d839a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:41.047235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e2feb-e402-44c6-90f2-91a996d839a2 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:41.057192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 413/821] 10.222.0.96 () {56 vars in 1112 bytes} [Wed Aug 24 04:18:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:41.057192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e2feb-e402-44c6-90f2-91a996d839a2 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:41.064968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c464e-e74c-4a54-9a3c-0f943706dc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:41.065685 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c464e-e74c-4a54-9a3c-0f943706dc4f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:41.066093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c464e-e74c-4a54-9a3c-0f943706dc4f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:41.066512 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c464e-e74c-4a54-9a3c-0f943706dc4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:41.082327 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c464e-e74c-4a54-9a3c-0f943706dc4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:41.084385 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c464e-e74c-4a54-9a3c-0f943706dc4f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:41.104627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-248c464e-e74c-4a54-9a3c-0f943706dc4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:41.104627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:41.104627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:41.104627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:41.104627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:41.104627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:41.104627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:41.104627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:41.104627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:41.104627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:41.104627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:41.104627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:41.104627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:41.104627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:41.104627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:41.104627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:41.105828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:41.105828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:41.105828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:41.105828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:41.105828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:41.105828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:41.105828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:41.105828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:41.105828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:41.105828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:41.105828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:41.105828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:41.105828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:41.105828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:41.105828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:41.105828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:41.105828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:41.106823 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:41.106823 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:41.106823 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:41.112031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 409/822] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:41.113044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c464e-e74c-4a54-9a3c-0f943706dc4f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:41.122264 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:41.196265 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e2feb-e402-44c6-90f2-91a996d839a2 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:41.251820 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538bb9e-5df2-4506-a5c5-d8f0e5eeb179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:41.252834 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538bb9e-5df2-4506-a5c5-d8f0e5eeb179 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:41.253282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538bb9e-5df2-4506-a5c5-d8f0e5eeb179 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:41.253752 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538bb9e-5df2-4506-a5c5-d8f0e5eeb179 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:41.254626 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538bb9e-5df2-4506-a5c5-d8f0e5eeb179 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:41.255119 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538bb9e-5df2-4506-a5c5-d8f0e5eeb179 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:41.256677 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538bb9e-5df2-4506-a5c5-d8f0e5eeb179 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:41.263401 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c464e-e74c-4a54-9a3c-0f943706dc4f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:41.274166 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 414/823] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:41.275312 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538bb9e-5df2-4506-a5c5-d8f0e5eeb179 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:41.314183 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefbbe1-1e94-46ca-ae50-2b5a3095ca2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:41.315178 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefbbe1-1e94-46ca-ae50-2b5a3095ca2d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:41.315531 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefbbe1-1e94-46ca-ae50-2b5a3095ca2d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:41.315878 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefbbe1-1e94-46ca-ae50-2b5a3095ca2d None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:41.316906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefbbe1-1e94-46ca-ae50-2b5a3095ca2d None admin] RBAC: Adding query filter params (type=network) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:41.317323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefbbe1-1e94-46ca-ae50-2b5a3095ca2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:41.319500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefbbe1-1e94-46ca-ae50-2b5a3095ca2d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:41.330891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 410/824] 10.222.0.96 () {56 vars in 1112 bytes} [Wed Aug 24 04:18:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:41.330891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefbbe1-1e94-46ca-ae50-2b5a3095ca2d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:41.365373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:41.399318 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538bb9e-5df2-4506-a5c5-d8f0e5eeb179 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:41.407268 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:41.438654 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b113b1-0c22-4f42-a327-e3c51142af27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:41.439268 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b113b1-0c22-4f42-a327-e3c51142af27 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:41.439544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b113b1-0c22-4f42-a327-e3c51142af27 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:41.439817 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b113b1-0c22-4f42-a327-e3c51142af27 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:41.440460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b113b1-0c22-4f42-a327-e3c51142af27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:41.440786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b113b1-0c22-4f42-a327-e3c51142af27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:41.442171 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b113b1-0c22-4f42-a327-e3c51142af27 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:41.443305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefbbe1-1e94-46ca-ae50-2b5a3095ca2d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:41.456218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 415/825] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:41.457989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b113b1-0c22-4f42-a327-e3c51142af27 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:41.486540 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2104b4-e020-4f53-ab61-ff730c517528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:41.487178 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2104b4-e020-4f53-ab61-ff730c517528 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:41.487458 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2104b4-e020-4f53-ab61-ff730c517528 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:41.487737 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2104b4-e020-4f53-ab61-ff730c517528 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:41.494867 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2104b4-e020-4f53-ab61-ff730c517528 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:41.496310 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2104b4-e020-4f53-ab61-ff730c517528 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:41.507795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-df2104b4-e020-4f53-ab61-ff730c517528 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:41.507795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:41.507795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:41.507795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:41.507795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:41.507795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:41.507795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:41.507795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:41.507795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:41.507795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:41.507795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:41.507795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:41.507795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:41.507795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:41.507795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:41.508922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:41.508922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:41.508922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:41.508922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:41.508922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:41.508922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:41.508922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:41.508922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:41.508922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:41.508922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:41.508922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:41.508922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:41.508922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:41.508922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:41.508922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:41.508922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:41.508922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:41.509810 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:41.509810 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:41.509810 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:41.509810 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:41.509810 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:41.509810 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:41.509810 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:41.509810 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:41.509810 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 411/826] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:41.510475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef94c97-f4c4-408f-809b-c6620c20849b None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:41.510767 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef94c97-f4c4-408f-809b-c6620c20849b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:41.511046 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef94c97-f4c4-408f-809b-c6620c20849b None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:41.512259 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 412/827] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:41.516722 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef94c97-f4c4-408f-809b-c6620c20849b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:41.578912 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b113b1-0c22-4f42-a327-e3c51142af27 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:41.612404 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:41.614741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a3d6d-27a2-487c-a00f-ac1929e8e869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:41.615481 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a3d6d-27a2-487c-a00f-ac1929e8e869 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:41.615783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a3d6d-27a2-487c-a00f-ac1929e8e869 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:41.616110 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a3d6d-27a2-487c-a00f-ac1929e8e869 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:41.616802 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a3d6d-27a2-487c-a00f-ac1929e8e869 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:41.618242 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a3d6d-27a2-487c-a00f-ac1929e8e869 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:41.624873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef94c97-f4c4-408f-809b-c6620c20849b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:41.652891 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 416/828] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:18:41 2022] POST /identity/v3/endpoints => generated 337 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:18:41.653975 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a3d6d-27a2-487c-a00f-ac1929e8e869 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:41.674438 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10fefc-22f8-4ed7-b51a-c3e956366379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:41.675146 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10fefc-22f8-4ed7-b51a-c3e956366379 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:41.675520 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10fefc-22f8-4ed7-b51a-c3e956366379 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:41.676010 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10fefc-22f8-4ed7-b51a-c3e956366379 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:41.684930 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10fefc-22f8-4ed7-b51a-c3e956366379 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:41.686627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10fefc-22f8-4ed7-b51a-c3e956366379 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:41.700578 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:41.702548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-dc10fefc-22f8-4ed7-b51a-c3e956366379 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:41.702548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:41.702548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:41.702548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:41.702548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:41.702548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:41.702548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:41.702548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:41.702548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:41.702548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:41.702548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:41.702548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:41.702548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:41.702548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:41.702548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:41.703646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:41.703646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:41.703646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:41.703646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:41.703646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:41.703646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:41.703646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:41.703646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:41.703646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:41.703646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:41.703646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:41.703646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:41.703646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:41.703646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:41.703646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:41.703646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:41.703646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:41.704558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:41.704558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:41.704558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:41.704558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:41.704558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:41.704558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:41.704558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:41.704558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:41.711331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 413/829] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:41.713058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503d7bd-ad02-4dfb-9030-6152206a197f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:41.713397 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503d7bd-ad02-4dfb-9030-6152206a197f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:41.713677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503d7bd-ad02-4dfb-9030-6152206a197f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:41.735562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d503d7bd-ad02-4dfb-9030-6152206a197f None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:41.736939 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d503d7bd-ad02-4dfb-9030-6152206a197f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:41.819477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a3d6d-27a2-487c-a00f-ac1929e8e869 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:41.820995 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 414/830] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:18:41.822225 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503d7bd-ad02-4dfb-9030-6152206a197f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:41.891949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9d549-1b9d-4e4e-9e2d-143e955a1d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:41.893629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9d549-1b9d-4e4e-9e2d-143e955a1d13 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:41.894267 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9d549-1b9d-4e4e-9e2d-143e955a1d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:41.895329 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9d549-1b9d-4e4e-9e2d-143e955a1d13 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:41.896437 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9d549-1b9d-4e4e-9e2d-143e955a1d13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:41.897000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9d549-1b9d-4e4e-9e2d-143e955a1d13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:41.898754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9d549-1b9d-4e4e-9e2d-143e955a1d13 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:41.913901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 417/831] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:41.920086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9d549-1b9d-4e4e-9e2d-143e955a1d13 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:41.934110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:41.964336 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503d7bd-ad02-4dfb-9030-6152206a197f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:42.011858 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d97ce3-c590-4c31-9439-0e7afbfe59a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:42.013420 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d97ce3-c590-4c31-9439-0e7afbfe59a8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:42.013420 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d97ce3-c590-4c31-9439-0e7afbfe59a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:42.013420 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d97ce3-c590-4c31-9439-0e7afbfe59a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:42.014292 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d97ce3-c590-4c31-9439-0e7afbfe59a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:42.014292 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d97ce3-c590-4c31-9439-0e7afbfe59a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:42.015748 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d97ce3-c590-4c31-9439-0e7afbfe59a8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:42.032600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 415/832] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:42.038660 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d97ce3-c590-4c31-9439-0e7afbfe59a8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:42.064510 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:42.092417 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9d549-1b9d-4e4e-9e2d-143e955a1d13 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:42.137475 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167c04c-e7f7-4a1c-a917-7449ef9286ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:42.139529 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167c04c-e7f7-4a1c-a917-7449ef9286ab None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:42.139983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167c04c-e7f7-4a1c-a917-7449ef9286ab None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:42.140413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167c04c-e7f7-4a1c-a917-7449ef9286ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:42.141705 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167c04c-e7f7-4a1c-a917-7449ef9286ab None admin] RBAC: Adding query filter params (role.id=059d2bf5bb8e42939f5f826bfdad6a21, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=3539784b4e91472eb20addc6707dc30d) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:42.142180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167c04c-e7f7-4a1c-a917-7449ef9286ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:42.143892 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167c04c-e7f7-4a1c-a917-7449ef9286ab None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:42.156953 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 418/833] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:18:41 2022] GET /identity/v3/role_assignments?user.id=3539784b4e91472eb20addc6707dc30d&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=059d2bf5bb8e42939f5f826bfdad6a21 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:18:42.157944 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167c04c-e7f7-4a1c-a917-7449ef9286ab None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:42.179415 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d97ce3-c590-4c31-9439-0e7afbfe59a8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:42.249527 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8dc44-ce79-48b1-947e-ac3756be0d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:42.250666 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8dc44-ce79-48b1-947e-ac3756be0d76 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:42.250952 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8dc44-ce79-48b1-947e-ac3756be0d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:42.251236 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8dc44-ce79-48b1-947e-ac3756be0d76 None admin] PATH_INFO: `/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/e9ffc48d1f6d49f49d00d1c2e762b987/roles/f1c5993fc3be47ef98bfd2ae3cdcd6e7` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:42.255271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:42.274307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8dc44-ce79-48b1-947e-ac3756be0d76 None admin] RBAC: Authorizing `identity:create_grant(project_id=d76b6cd68a7f4613a8e921781495f256, user_id=e9ffc48d1f6d49f49d00d1c2e762b987, role_id=f1c5993fc3be47ef98bfd2ae3cdcd6e7)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:42.275807 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8dc44-ce79-48b1-947e-ac3756be0d76 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:42.293518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 416/834] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:18:42 2022] PUT /identity/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/e9ffc48d1f6d49f49d00d1c2e762b987/roles/f1c5993fc3be47ef98bfd2ae3cdcd6e7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:18:42.295708 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2e0b0-e836-4830-ac3b-f78e284eef8b None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:42.296418 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2e0b0-e836-4830-ac3b-f78e284eef8b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:42.297302 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2e0b0-e836-4830-ac3b-f78e284eef8b None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:42.305065 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 417/835] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:42 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:42.307177 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a7fec-b6c6-472e-b6eb-edec44991f37 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:42.307704 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a7fec-b6c6-472e-b6eb-edec44991f37 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:42.308168 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a7fec-b6c6-472e-b6eb-edec44991f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:42.326894 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167c04c-e7f7-4a1c-a917-7449ef9286ab None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:42.334978 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-920a7fec-b6c6-472e-b6eb-edec44991f37 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:42.336753 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-920a7fec-b6c6-472e-b6eb-edec44991f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:42.380523 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b43b4-3e4b-4afe-80bc-bdf781e685ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:42.381110 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b43b4-3e4b-4afe-80bc-bdf781e685ff None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:42.381449 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b43b4-3e4b-4afe-80bc-bdf781e685ff None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:42.381791 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b43b4-3e4b-4afe-80bc-bdf781e685ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:42.400443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b43b4-3e4b-4afe-80bc-bdf781e685ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:42.408366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-051b43b4-3e4b-4afe-80bc-bdf781e685ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:18:42.408366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:42.408366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:42.408366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:42.408366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:42.408366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:42.408366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:42.408366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:42.408366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:42.408366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:42.408366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:42.408366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:42.408366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:42.408366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:42.408366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:42.408366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:42.409539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:42.409539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:42.409539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:42.409539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:42.409539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:42.409539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:42.409539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:42.409539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:42.409539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:42.409539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:42.409539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:42.409539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:42.409539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:42.409539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:42.409539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:42.409539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:42.410918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:42.410918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:42.410918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:42.410918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:42.410918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:42.410918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:42.410918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:42.410918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:42.410918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:42.410918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:42.410918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:18:42.410918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:42.410918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 419/836] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:18:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:42.419955 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b43b4-3e4b-4afe-80bc-bdf781e685ff None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:42.442164 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:42.448733 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 418/837] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:18:42.550019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b43b4-3e4b-4afe-80bc-bdf781e685ff None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:42.590926 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fe30a-b8ef-4435-bfb1-dd8d63369a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:42.591821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fe30a-b8ef-4435-bfb1-dd8d63369a67 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:42.592249 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fe30a-b8ef-4435-bfb1-dd8d63369a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:42.592670 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fe30a-b8ef-4435-bfb1-dd8d63369a67 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:42.593636 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fe30a-b8ef-4435-bfb1-dd8d63369a67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:42.594092 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fe30a-b8ef-4435-bfb1-dd8d63369a67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:42.595630 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fe30a-b8ef-4435-bfb1-dd8d63369a67 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:42.605793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 420/838] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:18:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:18:42.612609 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a7fec-b6c6-472e-b6eb-edec44991f37 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:42.758636 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a7fec-b6c6-472e-b6eb-edec44991f37 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:42.787863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:42.813634 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528c64a-75c0-4b50-b871-da610d40abe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:42.814519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528c64a-75c0-4b50-b871-da610d40abe3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:42.814898 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528c64a-75c0-4b50-b871-da610d40abe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:42.815338 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528c64a-75c0-4b50-b871-da610d40abe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:42.822163 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fe30a-b8ef-4435-bfb1-dd8d63369a67 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:42.834188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528c64a-75c0-4b50-b871-da610d40abe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:42.836167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528c64a-75c0-4b50-b871-da610d40abe3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:42.854729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-8528c64a-75c0-4b50-b871-da610d40abe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:42.854729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:42.854729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:42.854729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:42.854729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:42.854729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:42.854729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:42.854729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:42.854729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:42.854729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:42.854729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:42.854729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:42.854729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:42.854729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:42.854729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:42.854729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:42.855772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:42.855772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:42.855772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:42.855772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:42.855772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:42.855772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:42.855772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:42.855772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:42.855772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:42.855772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:42.855772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:42.855772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:42.855772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:42.855772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:42.855772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:42.855772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:42.855772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:42.857923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:42.857923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:42.857923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:42.857923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 419/839] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:42.864590 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528c64a-75c0-4b50-b871-da610d40abe3 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:42.963567 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:42.994501 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fe30a-b8ef-4435-bfb1-dd8d63369a67 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:43.000915 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528c64a-75c0-4b50-b871-da610d40abe3 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:43.031134 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d75d03-dc1a-4c5b-b885-361c4faf7bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:43.031846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d75d03-dc1a-4c5b-b885-361c4faf7bec None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:43.032229 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d75d03-dc1a-4c5b-b885-361c4faf7bec None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:43.032844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d75d03-dc1a-4c5b-b885-361c4faf7bec None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:43.033317 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d75d03-dc1a-4c5b-b885-361c4faf7bec None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:43.034784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d75d03-dc1a-4c5b-b885-361c4faf7bec None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:43.041766 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca0c12-63a9-48c1-9b75-ee030d0b135b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:43.042610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca0c12-63a9-48c1-9b75-ee030d0b135b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:43.043069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca0c12-63a9-48c1-9b75-ee030d0b135b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:43.043494 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca0c12-63a9-48c1-9b75-ee030d0b135b None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:43.044306 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca0c12-63a9-48c1-9b75-ee030d0b135b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:43.044795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca0c12-63a9-48c1-9b75-ee030d0b135b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:43.045340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-f4d75d03-dc1a-4c5b-b885-361c4faf7bec None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:18:43.045340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:43.045340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:18:43.045340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:18:43.045340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:18:43.045340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:18:43.045340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:18:43.045340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:43.045340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:18:43.045340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:43.045340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:18:43.045340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:43.045340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:43.045340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:43.045340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:43.045340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:43.045340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:43.046517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:43.046517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:43.046517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:43.046517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:43.046517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:43.046517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:43.046517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:18:43.046517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:18:43.046517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:18:43.046517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:18:43.046517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:43.046517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:43.046517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:43.046517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:43.046517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:43.046517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:43.047411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:43.047411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:43.047411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:43.047411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:43.047411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:43.047411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:43.047411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:43.047411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:43.047411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:43.047411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:43.047411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:18:43.047411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:43.047411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:18:43.047411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:43.048162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 421/840] 10.222.0.96 () {56 vars in 1114 bytes} [Wed Aug 24 04:18:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:43.049783 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca0c12-63a9-48c1-9b75-ee030d0b135b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:43.054061 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d75d03-dc1a-4c5b-b885-361c4faf7bec None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:43.064712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 420/841] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:43.072189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca0c12-63a9-48c1-9b75-ee030d0b135b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:43.120607 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:43.211636 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca0c12-63a9-48c1-9b75-ee030d0b135b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:43.239627 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d75d03-dc1a-4c5b-b885-361c4faf7bec None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:43.251311 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b87034-e1fd-4fc8-90c2-54a9855b3d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:43.252167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b87034-e1fd-4fc8-90c2-54a9855b3d2f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:43.252596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b87034-e1fd-4fc8-90c2-54a9855b3d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:43.253488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b87034-e1fd-4fc8-90c2-54a9855b3d2f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:43.263518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b87034-e1fd-4fc8-90c2-54a9855b3d2f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:43.266221 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b87034-e1fd-4fc8-90c2-54a9855b3d2f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:43.290749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-c9b87034-e1fd-4fc8-90c2-54a9855b3d2f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:18:43.290749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:43.290749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:43.290749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:43.290749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:43.290749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:43.290749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:43.290749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:43.290749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:43.290749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:43.290749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:43.290749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:43.290749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:43.290749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:43.290749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:43.290749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:43.291731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:43.291731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:43.291731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:43.291731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:43.291731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:43.291731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:43.291731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:43.291731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:43.291731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:43.291731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:43.291731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:43.291731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:43.291731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:43.291731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:43.291731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:43.291731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:43.291731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:43.291731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:43.293152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:43.293152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:43.293152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:43.293152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:43.293152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:43.293152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:43.293152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:43.293152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:43.293152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:18:43.293152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:43.295475 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:43.297171 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 421/842] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:18:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:43.298337 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b87034-e1fd-4fc8-90c2-54a9855b3d2f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:43.303791 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8c603-07d2-4fdb-bcc9-e386368dc532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:43.304666 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8c603-07d2-4fdb-bcc9-e386368dc532 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:43.305155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8c603-07d2-4fdb-bcc9-e386368dc532 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:43.305610 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8c603-07d2-4fdb-bcc9-e386368dc532 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:43.306449 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc8c603-07d2-4fdb-bcc9-e386368dc532 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:43.306931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc8c603-07d2-4fdb-bcc9-e386368dc532 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:43.308508 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc8c603-07d2-4fdb-bcc9-e386368dc532 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:43.318548 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 422/843] 10.222.0.96 () {56 vars in 1114 bytes} [Wed Aug 24 04:18:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:43.320229 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8c603-07d2-4fdb-bcc9-e386368dc532 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:43.396980 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:43.412039 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b87034-e1fd-4fc8-90c2-54a9855b3d2f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:43.431617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8c603-07d2-4fdb-bcc9-e386368dc532 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:43.450181 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90aef8b-6b72-4791-b85f-325ea1d68717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:43.451043 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90aef8b-6b72-4791-b85f-325ea1d68717 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:43.451543 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90aef8b-6b72-4791-b85f-325ea1d68717 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:43.452001 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90aef8b-6b72-4791-b85f-325ea1d68717 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:43.453078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90aef8b-6b72-4791-b85f-325ea1d68717 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:43.453612 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90aef8b-6b72-4791-b85f-325ea1d68717 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:43.455229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90aef8b-6b72-4791-b85f-325ea1d68717 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:43.469591 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe99cb0-88fc-4d5f-90fb-faaabee6e14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:43.470326 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe99cb0-88fc-4d5f-90fb-faaabee6e14e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:43.470681 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe99cb0-88fc-4d5f-90fb-faaabee6e14e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:43.471031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe99cb0-88fc-4d5f-90fb-faaabee6e14e None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:43.471749 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe99cb0-88fc-4d5f-90fb-faaabee6e14e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:43.472144 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe99cb0-88fc-4d5f-90fb-faaabee6e14e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:43.474245 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe99cb0-88fc-4d5f-90fb-faaabee6e14e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:43.482359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 422/845] 10.222.0.96 () {56 vars in 1135 bytes} [Wed Aug 24 04:18:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:43.485021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 423/845] 10.222.0.96 () {56 vars in 1114 bytes} [Wed Aug 24 04:18:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:18:43.486317 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90aef8b-6b72-4791-b85f-325ea1d68717 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:43.609795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90aef8b-6b72-4791-b85f-325ea1d68717 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:43.647879 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d73fe2-32e5-4dd8-a172-5f8dadb1c084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:43.648499 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d73fe2-32e5-4dd8-a172-5f8dadb1c084 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:43.648810 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d73fe2-32e5-4dd8-a172-5f8dadb1c084 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:43.649086 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d73fe2-32e5-4dd8-a172-5f8dadb1c084 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:43.666143 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:43.721549 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d73fe2-32e5-4dd8-a172-5f8dadb1c084 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:43.723595 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d73fe2-32e5-4dd8-a172-5f8dadb1c084 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:43.834288 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 423/846] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:18:43 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:18:43.835683 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe99cb0-88fc-4d5f-90fb-faaabee6e14e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:43.913259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:43.964986 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe99cb0-88fc-4d5f-90fb-faaabee6e14e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:44.007139 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05995ef2-9a90-4d47-a6de-24b5ae44351a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:44.007823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05995ef2-9a90-4d47-a6de-24b5ae44351a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:44.008104 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05995ef2-9a90-4d47-a6de-24b5ae44351a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:44.008384 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05995ef2-9a90-4d47-a6de-24b5ae44351a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:44.023378 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05995ef2-9a90-4d47-a6de-24b5ae44351a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:44.024934 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05995ef2-9a90-4d47-a6de-24b5ae44351a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:44.041642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-05995ef2-9a90-4d47-a6de-24b5ae44351a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:44.041642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:44.041642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:44.041642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:44.041642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:44.041642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:44.041642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:44.041642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:44.041642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:44.041642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:44.041642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:44.041642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:44.041642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:44.041642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:44.041642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:44.041642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:44.042669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:44.042669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:44.042669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:44.042669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:44.042669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:44.042669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:44.042669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:44.042669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:44.042669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:44.042669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:44.042669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:44.042669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:44.042669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:44.042669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:44.042669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:44.042669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:44.042669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:44.043983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:44.043983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:44.043983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:44.043983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 424/847] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:44.049016 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d73fe2-32e5-4dd8-a172-5f8dadb1c084 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:44.109136 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:44.179046 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d73fe2-32e5-4dd8-a172-5f8dadb1c084 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:44.218456 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc56ec6-3143-40df-8754-613436f650eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:44.221057 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc56ec6-3143-40df-8754-613436f650eb None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:44.221057 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc56ec6-3143-40df-8754-613436f650eb None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:44.221057 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc56ec6-3143-40df-8754-613436f650eb None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:44.221057 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc56ec6-3143-40df-8754-613436f650eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:44.221057 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc56ec6-3143-40df-8754-613436f650eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:44.222147 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc56ec6-3143-40df-8754-613436f650eb None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:44.237753 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 424/848] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:44.243479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05995ef2-9a90-4d47-a6de-24b5ae44351a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:44.403231 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d5781-5494-44a8-a343-59211dc49803 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:44.403522 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d5781-5494-44a8-a343-59211dc49803 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:44.403802 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d5781-5494-44a8-a343-59211dc49803 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:44.405441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 425/849] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:18:44.410661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9d2de-3d37-4648-a95c-6dfff2e6ddd2 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:44.411128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9d2de-3d37-4648-a95c-6dfff2e6ddd2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:44.411591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9d2de-3d37-4648-a95c-6dfff2e6ddd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:44.430220 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c5a9d2de-3d37-4648-a95c-6dfff2e6ddd2 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:44.431329 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c5a9d2de-3d37-4648-a95c-6dfff2e6ddd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:44.477999 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05995ef2-9a90-4d47-a6de-24b5ae44351a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:44.492524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:44.503083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 426/850] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:18:44.504859 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54888054-1bc5-432b-b621-e35ffc3a18ed None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:44.505389 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54888054-1bc5-432b-b621-e35ffc3a18ed None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:44.505872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54888054-1bc5-432b-b621-e35ffc3a18ed None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:44.507332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 427/851] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:44.512667 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c8027-0778-4afe-b8c6-dbabede5d258 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:44.512980 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c8027-0778-4afe-b8c6-dbabede5d258 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:44.513268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c8027-0778-4afe-b8c6-dbabede5d258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:44.531755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-655c8027-0778-4afe-b8c6-dbabede5d258 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:44.531937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d5985-067d-4623-bc07-81812a1b8ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:44.532490 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d5985-067d-4623-bc07-81812a1b8ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:44.532817 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d5985-067d-4623-bc07-81812a1b8ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:44.533031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-655c8027-0778-4afe-b8c6-dbabede5d258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:44.533128 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d5985-067d-4623-bc07-81812a1b8ab8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:44.541304 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d5985-067d-4623-bc07-81812a1b8ab8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:44.542922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d5985-067d-4623-bc07-81812a1b8ab8 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:44.555589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-179d5985-067d-4623-bc07-81812a1b8ab8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:44.555589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:44.555589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:44.555589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:44.555589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:44.555589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:44.555589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:44.555589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:44.555589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:44.555589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:44.555589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:44.555589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:44.555589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:44.555589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:44.555589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:44.556493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:44.556493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:44.556493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:44.556493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:44.556493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:44.556493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:44.556493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:44.556493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:44.556493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:44.556493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:44.556493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:44.556493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:44.556493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:44.556493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:44.556493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:44.556493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:44.556493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:44.557421 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:44.557421 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:44.557421 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:44.557421 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:44.557421 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:44.557421 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:44.557421 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:44.557421 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:44.557421 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 425/852] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:44.564007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d5985-067d-4623-bc07-81812a1b8ab8 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:44.568309 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:44.616721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 428/853] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:18:44.684790 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d5985-067d-4623-bc07-81812a1b8ab8 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:44.720911 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262b769-205c-43c8-9fe1-4ab7b9908324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:44.721583 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262b769-205c-43c8-9fe1-4ab7b9908324 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:44.721868 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262b769-205c-43c8-9fe1-4ab7b9908324 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:44.722144 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262b769-205c-43c8-9fe1-4ab7b9908324 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:44.722923 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262b769-205c-43c8-9fe1-4ab7b9908324 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:44.723238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262b769-205c-43c8-9fe1-4ab7b9908324 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:44.724706 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262b769-205c-43c8-9fe1-4ab7b9908324 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:44.737455 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 426/854] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:44.743703 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c8027-0778-4afe-b8c6-dbabede5d258 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:44.793156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262b769-205c-43c8-9fe1-4ab7b9908324 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:44.837679 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:44.863493 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c8027-0778-4afe-b8c6-dbabede5d258 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:44.900118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e2c8e-283e-48d6-9c60-92e7241a1055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:44.900758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e2c8e-283e-48d6-9c60-92e7241a1055 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:44.901041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e2c8e-283e-48d6-9c60-92e7241a1055 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:44.901316 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e2c8e-283e-48d6-9c60-92e7241a1055 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:44.902052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e2c8e-283e-48d6-9c60-92e7241a1055 None admin] RBAC: Adding query filter params (role.id=059d2bf5bb8e42939f5f826bfdad6a21, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=953d2dbd5e7d435f9148fd043b4ce7a7) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:44.902361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e2c8e-283e-48d6-9c60-92e7241a1055 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:44.903807 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e2c8e-283e-48d6-9c60-92e7241a1055 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:44.913553 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 429/855] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:18:44 2022] GET /identity/v3/role_assignments?user.id=953d2dbd5e7d435f9148fd043b4ce7a7&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=059d2bf5bb8e42939f5f826bfdad6a21 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:44.936103 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262b769-205c-43c8-9fe1-4ab7b9908324 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:44.940206 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e2c8e-283e-48d6-9c60-92e7241a1055 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:44.975010 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:44.983189 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b73c5-b8d5-40a4-ba6a-bf1d11316fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:44.984522 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b73c5-b8d5-40a4-ba6a-bf1d11316fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:44.985012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b73c5-b8d5-40a4-ba6a-bf1d11316fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:44.985509 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b73c5-b8d5-40a4-ba6a-bf1d11316fc8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:44.999881 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b73c5-b8d5-40a4-ba6a-bf1d11316fc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:45.005890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-766b73c5-b8d5-40a4-ba6a-bf1d11316fc8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:45.005890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:45.005890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:45.005890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:45.005890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:45.005890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:45.005890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:45.005890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:45.005890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:45.005890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:45.005890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:45.005890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:45.005890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:45.005890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:45.005890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:45.005890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:45.006918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:45.006918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:45.006918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:45.006918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:45.006918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:45.006918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:45.006918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:45.006918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:45.006918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:45.006918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:45.006918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:45.006918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:45.006918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:45.006918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:45.006918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:45.006918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:45.007786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:45.007786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:45.007786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:45.007786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:45.007786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:45.007786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:45.007786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:45.007786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:45.007786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:45.007786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:45.007786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:18:45.007786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:45.010723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 427/856] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:18:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:18:45.017152 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b73c5-b8d5-40a4-ba6a-bf1d11316fc8 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:45.064232 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e2c8e-283e-48d6-9c60-92e7241a1055 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:45.106228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a06a6-4b54-4841-bc6c-28416634deb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:45.106433 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a06a6-4b54-4841-bc6c-28416634deb3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:45.106704 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a06a6-4b54-4841-bc6c-28416634deb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:45.106982 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a06a6-4b54-4841-bc6c-28416634deb3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:45.108237 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a06a6-4b54-4841-bc6c-28416634deb3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:45.108973 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a06a6-4b54-4841-bc6c-28416634deb3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:45.120538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-9b1a06a6-4b54-4841-bc6c-28416634deb3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:18:45.120538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:45.120538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:18:45.120538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:18:45.120538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:18:45.120538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:18:45.120538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:18:45.120538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:45.120538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:18:45.120538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:45.120538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:18:45.120538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:45.120538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:45.120538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:45.120538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:45.120538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:45.121556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:45.121556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:45.121556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:45.121556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:45.121556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:45.121556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:45.121556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:45.121556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:18:45.121556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:18:45.121556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:18:45.121556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:18:45.121556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:45.121556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:45.121556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:45.121556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:45.121556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:45.121556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:45.122616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:45.122616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:45.122616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:45.122616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:45.122616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:45.122616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:45.122616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:45.122616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:45.122616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:45.122616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:45.122616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:18:45.122616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:45.122616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:18:45.122616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:45.122616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 430/857] 10.222.0.96 () {56 vars in 1132 bytes} [Wed Aug 24 04:18:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:18:45.130330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a06a6-4b54-4841-bc6c-28416634deb3 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:45.135658 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:45.149172 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b73c5-b8d5-40a4-ba6a-bf1d11316fc8 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:45.198178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9b12f-35ec-46b3-8881-8688ba2425c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:45.198852 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9b12f-35ec-46b3-8881-8688ba2425c2 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:45.199138 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9b12f-35ec-46b3-8881-8688ba2425c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:45.199671 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9b12f-35ec-46b3-8881-8688ba2425c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:45.200792 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9b12f-35ec-46b3-8881-8688ba2425c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:45.201431 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9b12f-35ec-46b3-8881-8688ba2425c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:45.202889 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9b12f-35ec-46b3-8881-8688ba2425c2 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:45.214685 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 428/858] 10.222.0.96 () {56 vars in 1103 bytes} [Wed Aug 24 04:18:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:45.219735 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9b12f-35ec-46b3-8881-8688ba2425c2 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:45.245900 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:45.256071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a06a6-4b54-4841-bc6c-28416634deb3 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:45.307362 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41547535-4af0-4821-a2c4-c619d3cbefc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:45.308570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41547535-4af0-4821-a2c4-c619d3cbefc2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:45.309082 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41547535-4af0-4821-a2c4-c619d3cbefc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:45.309779 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41547535-4af0-4821-a2c4-c619d3cbefc2 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:45.310863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41547535-4af0-4821-a2c4-c619d3cbefc2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:45.311314 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41547535-4af0-4821-a2c4-c619d3cbefc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:45.313130 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41547535-4af0-4821-a2c4-c619d3cbefc2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:45.326247 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 431/859] 10.222.0.96 () {56 vars in 1126 bytes} [Wed Aug 24 04:18:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:45.327680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41547535-4af0-4821-a2c4-c619d3cbefc2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:45.356105 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9b12f-35ec-46b3-8881-8688ba2425c2 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:45.399759 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48221e-bf0b-41fb-8303-51b4f5132b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:45.400572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48221e-bf0b-41fb-8303-51b4f5132b42 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:45.401131 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48221e-bf0b-41fb-8303-51b4f5132b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:45.401513 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48221e-bf0b-41fb-8303-51b4f5132b42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:45.416156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48221e-bf0b-41fb-8303-51b4f5132b42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:45.418066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48221e-bf0b-41fb-8303-51b4f5132b42 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:45.437336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-ec48221e-bf0b-41fb-8303-51b4f5132b42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:45.437336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:45.437336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:45.437336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:45.437336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:45.437336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:45.437336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:45.437336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:45.437336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:45.437336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:45.437336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:45.437336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:45.437336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:45.437336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:45.437336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:45.437336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:45.438453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:45.438453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:45.438453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:45.438453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:45.438453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:45.438453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:45.438453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:45.438453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:45.438453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:45.438453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:45.438453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:45.438453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:45.438453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:45.438453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:45.438453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:45.438453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:45.438453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:45.439351 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:45.439351 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:45.439351 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:45.443990 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 429/860] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:18:45.444933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48221e-bf0b-41fb-8303-51b4f5132b42 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:45.454878 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:45.465767 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41547535-4af0-4821-a2c4-c619d3cbefc2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:45.505353 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a534bf-0ec2-47c7-b100-806378a5bd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:45.505979 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a534bf-0ec2-47c7-b100-806378a5bd18 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:45.506256 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a534bf-0ec2-47c7-b100-806378a5bd18 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:45.506552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a534bf-0ec2-47c7-b100-806378a5bd18 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:45.507149 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a534bf-0ec2-47c7-b100-806378a5bd18 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:45.507455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a534bf-0ec2-47c7-b100-806378a5bd18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:45.508846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a534bf-0ec2-47c7-b100-806378a5bd18 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:45.517320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 432/861] 10.222.0.96 () {56 vars in 1126 bytes} [Wed Aug 24 04:18:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:18:45.517320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc3ac0-0f4f-4e69-8e11-7d5dd9a7b7b3 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:45.517320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc3ac0-0f4f-4e69-8e11-7d5dd9a7b7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:45.517320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc3ac0-0f4f-4e69-8e11-7d5dd9a7b7b3 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:45.517320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 433/862] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:45.522044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd50826-f19c-47cb-9440-711660a4fddc None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:45.522329 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd50826-f19c-47cb-9440-711660a4fddc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:45.522600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd50826-f19c-47cb-9440-711660a4fddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:45.542194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3dd50826-f19c-47cb-9440-711660a4fddc None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:45.543484 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3dd50826-f19c-47cb-9440-711660a4fddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:45.565957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:45.587985 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48221e-bf0b-41fb-8303-51b4f5132b42 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:45.633115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 434/863] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:18:45.638930 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc826f6-4cf6-4557-9092-87bc6730b342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:45.639926 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc826f6-4cf6-4557-9092-87bc6730b342 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:45.640494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc826f6-4cf6-4557-9092-87bc6730b342 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:45.641071 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc826f6-4cf6-4557-9092-87bc6730b342 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:45.641920 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc826f6-4cf6-4557-9092-87bc6730b342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:45.642410 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc826f6-4cf6-4557-9092-87bc6730b342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:45.643998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc826f6-4cf6-4557-9092-87bc6730b342 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:45.658368 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 430/864] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:45.664882 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd50826-f19c-47cb-9440-711660a4fddc None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:45.771569 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd50826-f19c-47cb-9440-711660a4fddc None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:45.808027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5601d0-c42a-42aa-b7fb-7374592221cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:45.808992 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5601d0-c42a-42aa-b7fb-7374592221cf None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:45.809480 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5601d0-c42a-42aa-b7fb-7374592221cf None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:45.809953 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5601d0-c42a-42aa-b7fb-7374592221cf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:45.818252 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5601d0-c42a-42aa-b7fb-7374592221cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:45.819903 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5601d0-c42a-42aa-b7fb-7374592221cf None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:45.833033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-6b5601d0-c42a-42aa-b7fb-7374592221cf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:18:45.833033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:45.833033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:45.833033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:45.833033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:45.833033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:45.833033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:45.833033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:45.833033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:45.833033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:45.833033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:45.833033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:45.833033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:45.833033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:45.833033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:45.833033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:45.834025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:45.834025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:45.834025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:45.834025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:45.834025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:45.834025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:45.834025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:45.834025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:45.834025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:45.834025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:45.834025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:45.834025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:45.834025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:45.834025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:45.834025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:45.834025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:45.834025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:45.834025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:45.835015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:45.835015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:45.835015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:45.835015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:45.835015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:45.835015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:45.835015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:45.835015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:45.835015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:18:45.835015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:45.837692 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 435/865] 10.222.0.96 () {56 vars in 1117 bytes} [Wed Aug 24 04:18:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:45.843409 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc826f6-4cf6-4557-9092-87bc6730b342 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:45.907055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5601d0-c42a-42aa-b7fb-7374592221cf None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:45.923210 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:45.933043 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:45.959871 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc826f6-4cf6-4557-9092-87bc6730b342 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:45.997233 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc62588-5349-4e18-80f9-9ed9ac1b9256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:45.997879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc62588-5349-4e18-80f9-9ed9ac1b9256 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:45.998164 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc62588-5349-4e18-80f9-9ed9ac1b9256 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:45.998438 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc62588-5349-4e18-80f9-9ed9ac1b9256 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:45.999225 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc62588-5349-4e18-80f9-9ed9ac1b9256 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:45.999475 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc62588-5349-4e18-80f9-9ed9ac1b9256 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:46.000934 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc62588-5349-4e18-80f9-9ed9ac1b9256 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:46.021895 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 431/866] 10.222.0.96 () {56 vars in 1149 bytes} [Wed Aug 24 04:18:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:18:46.023510 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5601d0-c42a-42aa-b7fb-7374592221cf None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:46.028495 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc62588-5349-4e18-80f9-9ed9ac1b9256 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:46.062796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f151a-80db-438d-92b6-2aa67f0da1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:46.063768 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f151a-80db-438d-92b6-2aa67f0da1f5 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:46.064252 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f151a-80db-438d-92b6-2aa67f0da1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:46.064773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f151a-80db-438d-92b6-2aa67f0da1f5 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:46.065790 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f151a-80db-438d-92b6-2aa67f0da1f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:46.067839 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f151a-80db-438d-92b6-2aa67f0da1f5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:46.092996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 436/867] 10.222.0.96 () {60 vars in 1141 bytes} [Wed Aug 24 04:18:45 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:18:46.158701 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc62588-5349-4e18-80f9-9ed9ac1b9256 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:46.187721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:46.207220 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad50a50-b9b0-413b-88d8-c879eff4f977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:46.207853 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad50a50-b9b0-413b-88d8-c879eff4f977 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:46.208137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad50a50-b9b0-413b-88d8-c879eff4f977 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:46.208413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad50a50-b9b0-413b-88d8-c879eff4f977 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:46.284042 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad50a50-b9b0-413b-88d8-c879eff4f977 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:46.286019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad50a50-b9b0-413b-88d8-c879eff4f977 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:46.396899 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 432/868] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:18:46 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 04:18:46.398406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f151a-80db-438d-92b6-2aa67f0da1f5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:46.476328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:46.508910 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f151a-80db-438d-92b6-2aa67f0da1f5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:46.546972 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13739699-b2f4-4786-aa0b-585faaa8db0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:46.547535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13739699-b2f4-4786-aa0b-585faaa8db0a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:46.547819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13739699-b2f4-4786-aa0b-585faaa8db0a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:46.548109 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13739699-b2f4-4786-aa0b-585faaa8db0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:46.559712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13739699-b2f4-4786-aa0b-585faaa8db0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:46.561225 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13739699-b2f4-4786-aa0b-585faaa8db0a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:46.576248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-13739699-b2f4-4786-aa0b-585faaa8db0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:46.576248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:46.576248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:46.576248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:46.576248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:46.576248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:46.576248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:46.576248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:46.576248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:46.576248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:46.576248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:46.576248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:46.576248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:46.576248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:46.576248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:46.576248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:46.577266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:46.577266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:46.577266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:46.577266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:46.577266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:46.577266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:46.577266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:46.577266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:46.577266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:46.577266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:46.577266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:46.577266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:46.577266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:46.577266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:46.577266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:46.577266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:46.577266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:46.578176 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:46.578176 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:46.578176 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:46.582615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 437/869] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:46.584057 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad50a50-b9b0-413b-88d8-c879eff4f977 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:46.607044 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:46.694074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad50a50-b9b0-413b-88d8-c879eff4f977 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:46.731355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571261d-0825-4e0f-b123-68de8392c9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:46.732350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571261d-0825-4e0f-b123-68de8392c9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:46.732874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571261d-0825-4e0f-b123-68de8392c9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:46.733361 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571261d-0825-4e0f-b123-68de8392c9d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:46.734206 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571261d-0825-4e0f-b123-68de8392c9d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:46.734711 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571261d-0825-4e0f-b123-68de8392c9d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:46.736289 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571261d-0825-4e0f-b123-68de8392c9d7 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:46.748853 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 433/870] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:46.754444 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13739699-b2f4-4786-aa0b-585faaa8db0a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:46.861879 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13739699-b2f4-4786-aa0b-585faaa8db0a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:46.889084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:46.898946 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457edeb-ee06-4377-8b42-36f0d5fd6003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:46.899593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457edeb-ee06-4377-8b42-36f0d5fd6003 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:46.899881 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457edeb-ee06-4377-8b42-36f0d5fd6003 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:46.900165 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457edeb-ee06-4377-8b42-36f0d5fd6003 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:46.907315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457edeb-ee06-4377-8b42-36f0d5fd6003 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:46.908807 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457edeb-ee06-4377-8b42-36f0d5fd6003 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:46.921120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-b457edeb-ee06-4377-8b42-36f0d5fd6003 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:46.921120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:46.921120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:46.921120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:46.921120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:46.921120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:46.921120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:46.921120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:46.921120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:46.921120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:46.921120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:46.921120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:46.921120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:46.921120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:46.921120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:46.922007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:46.922007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:46.922007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:46.922007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:46.922007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:46.922007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:46.922007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:46.922007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:46.922007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:46.922007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:46.922007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:46.922007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:46.922007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:46.922007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:46.922007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:46.922007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:46.922007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:46.922893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:46.922893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:46.922893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:46.922893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:46.922893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:46.922893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:46.922893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:46.922893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:46.927154 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 438/871] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:46.928561 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571261d-0825-4e0f-b123-68de8392c9d7 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:46.965187 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502566d-96b2-4bfd-93a3-50d3e88a9d2e None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:46.965495 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502566d-96b2-4bfd-93a3-50d3e88a9d2e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:46.965752 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502566d-96b2-4bfd-93a3-50d3e88a9d2e None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:46.967357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 439/872] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:18:46.972260 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dcd9e-b08e-49ef-a920-4818b825ecf8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:46.972633 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dcd9e-b08e-49ef-a920-4818b825ecf8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:46.972964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dcd9e-b08e-49ef-a920-4818b825ecf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:46.991618 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-082dcd9e-b08e-49ef-a920-4818b825ecf8 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:46.992900 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-082dcd9e-b08e-49ef-a920-4818b825ecf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:47.028002 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:47.055511 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571261d-0825-4e0f-b123-68de8392c9d7 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:47.085047 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 440/873] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:18:47.097664 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75d5ab-99ba-4575-8d7a-2f3b878b8b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:47.098536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75d5ab-99ba-4575-8d7a-2f3b878b8b96 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:47.099046 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75d5ab-99ba-4575-8d7a-2f3b878b8b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:47.099523 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75d5ab-99ba-4575-8d7a-2f3b878b8b96 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:47.100417 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75d5ab-99ba-4575-8d7a-2f3b878b8b96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:47.100978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75d5ab-99ba-4575-8d7a-2f3b878b8b96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:47.102618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75d5ab-99ba-4575-8d7a-2f3b878b8b96 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:47.120802 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 434/874] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:47.122626 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dcd9e-b08e-49ef-a920-4818b825ecf8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:47.234462 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dcd9e-b08e-49ef-a920-4818b825ecf8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:47.250448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:47.273395 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e16f83-661d-4b8b-a1fa-76a52a60e519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:47.274458 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e16f83-661d-4b8b-a1fa-76a52a60e519 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:47.274964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e16f83-661d-4b8b-a1fa-76a52a60e519 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:47.275446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e16f83-661d-4b8b-a1fa-76a52a60e519 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:47.276435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e16f83-661d-4b8b-a1fa-76a52a60e519 None admin] RBAC: Adding query filter params (role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=e9ffc48d1f6d49f49d00d1c2e762b987) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:47.276982 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e16f83-661d-4b8b-a1fa-76a52a60e519 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:47.278702 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e16f83-661d-4b8b-a1fa-76a52a60e519 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:47.292825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 441/875] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:18:47 2022] GET /identity/v3/role_assignments?user.id=e9ffc48d1f6d49f49d00d1c2e762b987&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:47.385199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75d5ab-99ba-4575-8d7a-2f3b878b8b96 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:47.494733 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75d5ab-99ba-4575-8d7a-2f3b878b8b96 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:47.530871 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcd509-69e9-42c9-b0af-20d580eb052d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:47.531931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcd509-69e9-42c9-b0af-20d580eb052d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:47.532432 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcd509-69e9-42c9-b0af-20d580eb052d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:47.532933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcd509-69e9-42c9-b0af-20d580eb052d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:47.533771 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fcd509-69e9-42c9-b0af-20d580eb052d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:47.535570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fcd509-69e9-42c9-b0af-20d580eb052d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:47.537573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba642a-d2e6-41fe-91b0-9b7fc704a7ae None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:47.537868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba642a-d2e6-41fe-91b0-9b7fc704a7ae None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:47.538151 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba642a-d2e6-41fe-91b0-9b7fc704a7ae None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:47.539499 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 442/876] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:47.544832 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06da176-87e4-4607-9ab9-d08c0d74b722 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:47.545208 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06da176-87e4-4607-9ab9-d08c0d74b722 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:47.545559 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06da176-87e4-4607-9ab9-d08c0d74b722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:47.548292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-16fcd509-69e9-42c9-b0af-20d580eb052d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:18:47.548292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:47.548292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:18:47.548292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:18:47.548292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:18:47.548292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:18:47.548292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:18:47.548292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:47.548292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:18:47.548292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:47.548292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:18:47.548292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:47.548292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:47.548292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:47.548292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:47.548292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:47.548292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:47.549422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:47.549422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:47.549422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:47.549422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:47.549422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:47.549422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:47.549422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:18:47.549422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:18:47.549422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:18:47.549422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:18:47.549422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:47.549422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:47.549422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:47.549422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:47.549422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:47.549422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:47.550287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:47.550287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:47.550287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:47.550287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:47.550287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:47.550287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:47.550287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:47.550287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:47.550287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:47.550287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:47.550287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:18:47.550287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:47.550287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:18:47.550287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:47.551965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 435/877] 10.222.0.96 () {56 vars in 1126 bytes} [Wed Aug 24 04:18:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:47.558201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcd509-69e9-42c9-b0af-20d580eb052d None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:47.568209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c06da176-87e4-4607-9ab9-d08c0d74b722 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:47.568921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:47.569458 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c06da176-87e4-4607-9ab9-d08c0d74b722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:47.651740 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 443/878] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:47 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:18:47.692114 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcd509-69e9-42c9-b0af-20d580eb052d None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:47.728100 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ffaba-5fd6-47eb-a91b-af8624242e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:47.728818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ffaba-5fd6-47eb-a91b-af8624242e31 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:47.729110 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ffaba-5fd6-47eb-a91b-af8624242e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:47.729392 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ffaba-5fd6-47eb-a91b-af8624242e31 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:47.730035 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ffaba-5fd6-47eb-a91b-af8624242e31 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:47.730348 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ffaba-5fd6-47eb-a91b-af8624242e31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:47.731732 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ffaba-5fd6-47eb-a91b-af8624242e31 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:47.736950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 436/879] 10.222.0.96 () {56 vars in 1122 bytes} [Wed Aug 24 04:18:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:18:47.743361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06da176-87e4-4607-9ab9-d08c0d74b722 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:47.864362 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06da176-87e4-4607-9ab9-d08c0d74b722 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:47.874646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:47.903762 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ec28c-3051-462a-9ea8-cb74540db00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:47.904298 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ec28c-3051-462a-9ea8-cb74540db00a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:47.904581 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ec28c-3051-462a-9ea8-cb74540db00a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:47.904886 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ec28c-3051-462a-9ea8-cb74540db00a None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:47.905527 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ec28c-3051-462a-9ea8-cb74540db00a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:47.905834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ec28c-3051-462a-9ea8-cb74540db00a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:47.907201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ec28c-3051-462a-9ea8-cb74540db00a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:47.912808 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 444/880] 10.222.0.96 () {56 vars in 1122 bytes} [Wed Aug 24 04:18:47 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:47.934816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ffaba-5fd6-47eb-a91b-af8624242e31 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:48.012648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:48.051809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ffaba-5fd6-47eb-a91b-af8624242e31 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:48.095068 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1367e4-6dd2-42ab-b9a6-40bc2aa41c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:48.096061 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1367e4-6dd2-42ab-b9a6-40bc2aa41c06 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:48.096562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1367e4-6dd2-42ab-b9a6-40bc2aa41c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:48.097087 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1367e4-6dd2-42ab-b9a6-40bc2aa41c06 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:48.098520 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1367e4-6dd2-42ab-b9a6-40bc2aa41c06 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:48.100079 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1367e4-6dd2-42ab-b9a6-40bc2aa41c06 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:48.119335 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 437/881] 10.222.0.96 () {60 vars in 1141 bytes} [Wed Aug 24 04:18:47 2022] POST /identity/v3/services => generated 269 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:18:48.249340 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d12217-f542-4bfa-88bc-137d0652576a None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:48.249645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d12217-f542-4bfa-88bc-137d0652576a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:48.249826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d12217-f542-4bfa-88bc-137d0652576a None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:48.251460 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 445/882] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:48.258484 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633debd-7ef7-4a06-be8c-461fe9b0a5eb None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:48.258484 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633debd-7ef7-4a06-be8c-461fe9b0a5eb None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:48.258484 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633debd-7ef7-4a06-be8c-461fe9b0a5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:48.277059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4633debd-7ef7-4a06-be8c-461fe9b0a5eb None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:48.278256 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4633debd-7ef7-4a06-be8c-461fe9b0a5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:48.356024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 438/883] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:18:48.627890 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d12217-f542-4bfa-88bc-137d0652576a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:48.733200 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d12217-f542-4bfa-88bc-137d0652576a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:48.768838 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8bfe2-7b10-49dd-9f37-512e80f8bf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:48.770020 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8bfe2-7b10-49dd-9f37-512e80f8bf21 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:48.770306 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8bfe2-7b10-49dd-9f37-512e80f8bf21 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:48.770581 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8bfe2-7b10-49dd-9f37-512e80f8bf21 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:48.771167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8bfe2-7b10-49dd-9f37-512e80f8bf21 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:48.772529 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8bfe2-7b10-49dd-9f37-512e80f8bf21 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:48.781675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-bbe8bfe2-7b10-49dd-9f37-512e80f8bf21 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:18:48.781675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:48.781675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:18:48.781675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:18:48.781675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:18:48.781675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:18:48.781675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:18:48.781675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:48.781675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:18:48.781675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:48.781675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:18:48.781675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:48.781675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:48.781675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:48.781675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:48.781675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:48.781675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:48.782646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:48.782646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:48.782646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:48.782646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:48.782646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:48.782646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:48.782646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:18:48.782646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:18:48.782646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:18:48.782646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:18:48.782646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:48.782646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:48.782646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:48.782646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:48.782646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:48.782646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:48.783474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:48.783474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:48.783474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:48.783474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:48.783474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:48.783474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:48.783474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:48.783474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:48.783474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:48.783474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:48.783474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:18:48.783474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:48.783474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:18:48.783474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:48.783474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 446/884] 10.222.0.96 () {56 vars in 1114 bytes} [Wed Aug 24 04:18:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:48.789182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633debd-7ef7-4a06-be8c-461fe9b0a5eb None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:48.849822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:48.900356 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633debd-7ef7-4a06-be8c-461fe9b0a5eb None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:48.939499 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8774e3-9560-4bfa-a259-796e8bf009e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:48.940484 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8774e3-9560-4bfa-a259-796e8bf009e5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:48.940982 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8774e3-9560-4bfa-a259-796e8bf009e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:48.941979 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8774e3-9560-4bfa-a259-796e8bf009e5 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:48.942838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8774e3-9560-4bfa-a259-796e8bf009e5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:48.943339 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8774e3-9560-4bfa-a259-796e8bf009e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:48.944922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8774e3-9560-4bfa-a259-796e8bf009e5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:48.954848 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 439/885] 10.222.0.96 () {56 vars in 1114 bytes} [Wed Aug 24 04:18:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:48.956414 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8bfe2-7b10-49dd-9f37-512e80f8bf21 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:48.994401 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:49.069474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8bfe2-7b10-49dd-9f37-512e80f8bf21 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:49.108347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f253390-9ac4-481f-99eb-1fd2d6d49dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:49.108994 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f253390-9ac4-481f-99eb-1fd2d6d49dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:49.109278 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f253390-9ac4-481f-99eb-1fd2d6d49dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:49.109560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f253390-9ac4-481f-99eb-1fd2d6d49dc6 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:49.110198 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f253390-9ac4-481f-99eb-1fd2d6d49dc6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:49.110509 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f253390-9ac4-481f-99eb-1fd2d6d49dc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:49.111890 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f253390-9ac4-481f-99eb-1fd2d6d49dc6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:49.117414 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 447/886] 10.222.0.96 () {56 vars in 1114 bytes} [Wed Aug 24 04:18:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:49.126130 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8774e3-9560-4bfa-a259-796e8bf009e5 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:49.236121 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8774e3-9560-4bfa-a259-796e8bf009e5 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:49.256411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:49.274268 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32075949-64ff-4669-8c4e-64d77aef443b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:49.274881 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32075949-64ff-4669-8c4e-64d77aef443b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:49.275160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32075949-64ff-4669-8c4e-64d77aef443b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:49.275433 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32075949-64ff-4669-8c4e-64d77aef443b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:49.276133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32075949-64ff-4669-8c4e-64d77aef443b None admin] RBAC: Adding query filter params (interface=public, service_id=d8d9b6b208e04a8f88d468397b143f2a, region_id=RegionOne) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:49.276440 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32075949-64ff-4669-8c4e-64d77aef443b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:49.277890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32075949-64ff-4669-8c4e-64d77aef443b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:49.283317 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 440/887] 10.222.0.96 () {56 vars in 1251 bytes} [Wed Aug 24 04:18:49 2022] GET /identity/v3/endpoints?service_id=d8d9b6b208e04a8f88d468397b143f2a&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:49.289103 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f253390-9ac4-481f-99eb-1fd2d6d49dc6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:49.403391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:49.406401 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f253390-9ac4-481f-99eb-1fd2d6d49dc6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:49.446908 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8edeb-b209-4f21-860e-a7f5ad7c1711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:49.447584 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8edeb-b209-4f21-860e-a7f5ad7c1711 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:49.447874 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8edeb-b209-4f21-860e-a7f5ad7c1711 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:49.448152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8edeb-b209-4f21-860e-a7f5ad7c1711 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:49.448806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8edeb-b209-4f21-860e-a7f5ad7c1711 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:49.450244 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8edeb-b209-4f21-860e-a7f5ad7c1711 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:49.456416 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 448/888] 10.222.0.96 () {56 vars in 1087 bytes} [Wed Aug 24 04:18:49 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:18:49.461278 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64770ac0-a62b-411f-aa86-b5b4084c7703 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:49.461577 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64770ac0-a62b-411f-aa86-b5b4084c7703 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:49.461844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64770ac0-a62b-411f-aa86-b5b4084c7703 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:49.463215 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 441/889] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:49.469118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e63e29-c87d-4271-9f84-0f9b4218d747 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:49.469455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e63e29-c87d-4271-9f84-0f9b4218d747 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:49.469736 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e63e29-c87d-4271-9f84-0f9b4218d747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:49.490161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-47e63e29-c87d-4271-9f84-0f9b4218d747 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:49.491329 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-47e63e29-c87d-4271-9f84-0f9b4218d747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:49.573479 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 449/890] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:18:49.857266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64770ac0-a62b-411f-aa86-b5b4084c7703 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:49.962558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276fb41-f739-47b9-996a-50bb6f17bd57 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:49.963542 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276fb41-f739-47b9-996a-50bb6f17bd57 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:49.964036 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276fb41-f739-47b9-996a-50bb6f17bd57 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:49.968787 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 450/891] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:18:49.971454 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6338b3-0bae-470f-aabf-457e0d546ff2 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:49.971975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6338b3-0bae-470f-aabf-457e0d546ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:49.972097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64770ac0-a62b-411f-aa86-b5b4084c7703 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:49.973195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6338b3-0bae-470f-aabf-457e0d546ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:49.996031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0c6338b3-0bae-470f-aabf-457e0d546ff2 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:49.997864 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0c6338b3-0bae-470f-aabf-457e0d546ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:50.013637 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2472c3-1c56-426e-8502-b14c903b3025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:50.014281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2472c3-1c56-426e-8502-b14c903b3025 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:50.014564 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2472c3-1c56-426e-8502-b14c903b3025 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:50.014840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2472c3-1c56-426e-8502-b14c903b3025 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:50.029593 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2472c3-1c56-426e-8502-b14c903b3025 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:50.037028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-2a2472c3-1c56-426e-8502-b14c903b3025 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:18:50.037028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:50.037028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:50.037028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:50.037028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:50.037028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:50.037028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:50.037028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:50.037028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:50.037028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:50.037028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:50.037028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:50.037028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:50.037028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:50.037028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:50.037028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:50.038088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:50.038088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:50.038088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:50.038088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:50.038088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:50.038088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:50.038088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:50.038088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:50.038088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:50.038088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:50.038088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:50.038088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:50.038088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:50.038088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:50.038088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:50.038088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:50.039801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:50.039801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:50.039801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:50.039801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:50.039801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:50.039801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:50.039801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:50.039801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:50.039801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:50.039801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:50.039801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:18:50.039801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:50.039801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 442/892] 10.222.0.96 () {56 vars in 1120 bytes} [Wed Aug 24 04:18:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:50.044608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2472c3-1c56-426e-8502-b14c903b3025 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:50.096861 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 451/893] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:18:50.112452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:50.174310 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2472c3-1c56-426e-8502-b14c903b3025 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:50.188071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a308b48-c88c-4a17-a18b-0079fe10d1c3 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:50.188410 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a308b48-c88c-4a17-a18b-0079fe10d1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:50.188712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a308b48-c88c-4a17-a18b-0079fe10d1c3 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:50.190065 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 452/894] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:18:50.196929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906fe03-bebe-4a43-b23e-d29b471a6b6f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:50.197371 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906fe03-bebe-4a43-b23e-d29b471a6b6f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:50.197726 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906fe03-bebe-4a43-b23e-d29b471a6b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:50.213958 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba80db-3731-48b5-af20-f5509e4dadca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:50.214611 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba80db-3731-48b5-af20-f5509e4dadca None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:50.215252 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba80db-3731-48b5-af20-f5509e4dadca None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:50.215529 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba80db-3731-48b5-af20-f5509e4dadca None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:50.218250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f906fe03-bebe-4a43-b23e-d29b471a6b6f None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:50.220085 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f906fe03-bebe-4a43-b23e-d29b471a6b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:50.220252 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba80db-3731-48b5-af20-f5509e4dadca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:50.220565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba80db-3731-48b5-af20-f5509e4dadca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:50.222113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba80db-3731-48b5-af20-f5509e4dadca None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:50.234220 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 443/895] 10.222.0.96 () {56 vars in 1115 bytes} [Wed Aug 24 04:18:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:50.243190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba80db-3731-48b5-af20-f5509e4dadca None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:50.248530 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:50.306517 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 453/896] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:18:50.358902 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba80db-3731-48b5-af20-f5509e4dadca None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:50.361214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:50.395234 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa2551-7cd6-4643-b0b9-fb922225cd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:50.395871 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa2551-7cd6-4643-b0b9-fb922225cd5b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:50.396156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa2551-7cd6-4643-b0b9-fb922225cd5b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:50.396432 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa2551-7cd6-4643-b0b9-fb922225cd5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:50.407267 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa2551-7cd6-4643-b0b9-fb922225cd5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:50.408737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa2551-7cd6-4643-b0b9-fb922225cd5b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:50.423466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-d2aa2551-7cd6-4643-b0b9-fb922225cd5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:50.423466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:50.423466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:50.423466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:50.423466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:50.423466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:50.423466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:50.423466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:50.423466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:50.423466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:50.423466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:50.423466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:50.423466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:50.423466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:50.423466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:50.423466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:50.424479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:50.424479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:50.424479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:50.424479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:50.424479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:50.424479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:50.424479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:50.424479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:50.424479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:50.424479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:50.424479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:50.424479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:50.424479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:50.424479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:50.424479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:50.424479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:50.424479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:50.425415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:50.425415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:50.425415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:50.425415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 444/897] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:18:50.431925 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906fe03-bebe-4a43-b23e-d29b471a6b6f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:50.443614 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa2551-7cd6-4643-b0b9-fb922225cd5b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:50.545654 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906fe03-bebe-4a43-b23e-d29b471a6b6f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:50.554728 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa2551-7cd6-4643-b0b9-fb922225cd5b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:50.585887 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49bd1b-8843-4350-ae83-835394ca9df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:50.586272 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49bd1b-8843-4350-ae83-835394ca9df3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:50.586556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49bd1b-8843-4350-ae83-835394ca9df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:50.586839 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49bd1b-8843-4350-ae83-835394ca9df3 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:50.587517 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49bd1b-8843-4350-ae83-835394ca9df3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:50.587819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49bd1b-8843-4350-ae83-835394ca9df3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:50.589251 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49bd1b-8843-4350-ae83-835394ca9df3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:50.595977 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce150b18-129e-4ec5-b2af-104e16c5eb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:50.596958 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce150b18-129e-4ec5-b2af-104e16c5eb58 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:50.597530 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce150b18-129e-4ec5-b2af-104e16c5eb58 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:50.598047 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce150b18-129e-4ec5-b2af-104e16c5eb58 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:50.598906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce150b18-129e-4ec5-b2af-104e16c5eb58 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:50.600497 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce150b18-129e-4ec5-b2af-104e16c5eb58 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:50.602340 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 454/898] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:18:50.603170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49bd1b-8843-4350-ae83-835394ca9df3 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:50.625140 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 445/899] 10.222.0.96 () {60 vars in 1141 bytes} [Wed Aug 24 04:18:50 2022] POST /identity/v3/services => generated 241 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:18:50.625934 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:50.626499 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce150b18-129e-4ec5-b2af-104e16c5eb58 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:50.652256 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:50.757266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49bd1b-8843-4350-ae83-835394ca9df3 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:50.769638 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce150b18-129e-4ec5-b2af-104e16c5eb58 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:50.801848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed9897-0ef5-4e04-9389-73277bb85e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:50.802486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed9897-0ef5-4e04-9389-73277bb85e70 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:50.802764 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed9897-0ef5-4e04-9389-73277bb85e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:50.803035 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed9897-0ef5-4e04-9389-73277bb85e70 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:50.803682 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed9897-0ef5-4e04-9389-73277bb85e70 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:50.805777 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed9897-0ef5-4e04-9389-73277bb85e70 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:50.812151 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a595e9-9bc8-4dd2-93e3-5ff4fb167945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:50.813090 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a595e9-9bc8-4dd2-93e3-5ff4fb167945 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:50.813574 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a595e9-9bc8-4dd2-93e3-5ff4fb167945 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:50.814039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a595e9-9bc8-4dd2-93e3-5ff4fb167945 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:50.815837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-4aed9897-0ef5-4e04-9389-73277bb85e70 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:18:50.815837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:50.815837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:18:50.815837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:18:50.815837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:18:50.815837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:18:50.815837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:18:50.815837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:50.815837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:18:50.815837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:50.815837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:18:50.815837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:50.815837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:50.815837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:50.815837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:50.815837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:50.817422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:50.817422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:50.817422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:50.817422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:50.817422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:50.817422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:50.817422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:50.817422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:18:50.817422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:18:50.817422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:18:50.817422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:18:50.817422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:50.817422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:50.817422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:50.817422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:50.817422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:50.817422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:50.818359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:50.818359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:50.818359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:50.818359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:50.818359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:50.818359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:50.818359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:50.818359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:50.818359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:50.818359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:50.818359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:18:50.818359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:50.818359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:18:50.818359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:50.818359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 455/900] 10.222.0.96 () {56 vars in 1132 bytes} [Wed Aug 24 04:18:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:50.824818 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed9897-0ef5-4e04-9389-73277bb85e70 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:50.824980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a595e9-9bc8-4dd2-93e3-5ff4fb167945 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:50.828461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a595e9-9bc8-4dd2-93e3-5ff4fb167945 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:50.842350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-e3a595e9-9bc8-4dd2-93e3-5ff4fb167945 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:18:50.842350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:50.842350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:50.842350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:50.842350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:50.842350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:50.842350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:50.842350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:50.842350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:50.842350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:50.842350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:50.842350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:50.842350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:50.842350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:50.842350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:50.842350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:50.843346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:50.843346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:50.843346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:50.843346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:50.843346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:50.843346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:50.843346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:50.843346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:50.843346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:50.843346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:50.843346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:50.843346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:50.843346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:50.843346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:50.843346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:50.843346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:50.843346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:50.843346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:50.844294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:50.844294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:50.844294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:50.844294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:50.844294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:50.844294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:50.844294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:50.844294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:50.844294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:18:50.844294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:50.845824 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 446/901] 10.222.0.96 () {56 vars in 1117 bytes} [Wed Aug 24 04:18:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:50.851600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a595e9-9bc8-4dd2-93e3-5ff4fb167945 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:50.930787 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:50.937342 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:50.956677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed9897-0ef5-4e04-9389-73277bb85e70 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:50.983384 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a595e9-9bc8-4dd2-93e3-5ff4fb167945 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:50.994318 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bcb0a-dc46-48a5-9eba-f53019dc128b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:50.995024 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bcb0a-dc46-48a5-9eba-f53019dc128b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:50.995372 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bcb0a-dc46-48a5-9eba-f53019dc128b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:50.995714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bcb0a-dc46-48a5-9eba-f53019dc128b None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:50.996416 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4bcb0a-dc46-48a5-9eba-f53019dc128b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:50.996844 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4bcb0a-dc46-48a5-9eba-f53019dc128b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:50.998279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4bcb0a-dc46-48a5-9eba-f53019dc128b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:51.008797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 456/902] 10.222.0.96 () {56 vars in 1126 bytes} [Wed Aug 24 04:18:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:18:51.009934 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bcb0a-dc46-48a5-9eba-f53019dc128b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:51.030833 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d23f2b-7c70-479b-9d03-8e54bf3b6dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:51.031960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d23f2b-7c70-479b-9d03-8e54bf3b6dbc None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:51.032781 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d23f2b-7c70-479b-9d03-8e54bf3b6dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:51.033226 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d23f2b-7c70-479b-9d03-8e54bf3b6dbc None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:51.034165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d23f2b-7c70-479b-9d03-8e54bf3b6dbc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:51.034632 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d23f2b-7c70-479b-9d03-8e54bf3b6dbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:51.037467 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d23f2b-7c70-479b-9d03-8e54bf3b6dbc None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:51.064480 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 447/903] 10.222.0.96 () {56 vars in 1149 bytes} [Wed Aug 24 04:18:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:51.070435 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d23f2b-7c70-479b-9d03-8e54bf3b6dbc None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:51.132035 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bcb0a-dc46-48a5-9eba-f53019dc128b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:51.178200 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e947fd-9364-4dc8-ac8d-dbd7d281f75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:51.179323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e947fd-9364-4dc8-ac8d-dbd7d281f75b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:51.179791 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e947fd-9364-4dc8-ac8d-dbd7d281f75b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:51.180729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e947fd-9364-4dc8-ac8d-dbd7d281f75b None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:51.181865 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e947fd-9364-4dc8-ac8d-dbd7d281f75b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:51.182340 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e947fd-9364-4dc8-ac8d-dbd7d281f75b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:51.184536 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e947fd-9364-4dc8-ac8d-dbd7d281f75b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:51.192076 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 457/904] 10.222.0.96 () {56 vars in 1126 bytes} [Wed Aug 24 04:18:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:51.197295 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e947fd-9364-4dc8-ac8d-dbd7d281f75b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:51.206409 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d23f2b-7c70-479b-9d03-8e54bf3b6dbc None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:51.212632 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:51.242774 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:51.250143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c9ef4-26a9-408f-a018-adfcc3113459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:51.250757 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c9ef4-26a9-408f-a018-adfcc3113459 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:51.251045 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c9ef4-26a9-408f-a018-adfcc3113459 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:51.251321 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c9ef4-26a9-408f-a018-adfcc3113459 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:51.326848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e947fd-9364-4dc8-ac8d-dbd7d281f75b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:51.341568 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c9ef4-26a9-408f-a018-adfcc3113459 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:51.343552 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c9ef4-26a9-408f-a018-adfcc3113459 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:51.376985 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7c53d-39db-4416-8179-d45414b1ffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:51.378060 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7c53d-39db-4416-8179-d45414b1ffe5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:51.378611 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7c53d-39db-4416-8179-d45414b1ffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:51.379216 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7c53d-39db-4416-8179-d45414b1ffe5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:51.380135 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7c53d-39db-4416-8179-d45414b1ffe5 None admin] RBAC: Adding query filter params (interface=public, service_id=1b15842cd90f4f0293d68ac5ab4f5f02, region_id=RegionOne) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:51.380768 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7c53d-39db-4416-8179-d45414b1ffe5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:51.382453 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7c53d-39db-4416-8179-d45414b1ffe5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:51.393169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 458/905] 10.222.0.96 () {56 vars in 1251 bytes} [Wed Aug 24 04:18:51 2022] GET /identity/v3/endpoints?service_id=1b15842cd90f4f0293d68ac5ab4f5f02&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:18:51.394971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7c53d-39db-4416-8179-d45414b1ffe5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:51.462384 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 448/906] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:18:51 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 04:18:51.462384 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a51d4-938e-45bc-8659-e8ede32ca7b1 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:51.462384 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a51d4-938e-45bc-8659-e8ede32ca7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:51.462384 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a51d4-938e-45bc-8659-e8ede32ca7b1 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:51.465254 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 449/907] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:51.465254 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a51d4-938e-45bc-8659-e8ede32ca7b1 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:51.476597 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:51.496667 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:51.511333 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7c53d-39db-4416-8179-d45414b1ffe5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:51.549466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb0a3a-1554-4940-8086-67377409e7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:51.550194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb0a3a-1554-4940-8086-67377409e7db None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:51.550721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb0a3a-1554-4940-8086-67377409e7db None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:51.550969 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb0a3a-1554-4940-8086-67377409e7db None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:51.551596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb0a3a-1554-4940-8086-67377409e7db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:51.553023 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb0a3a-1554-4940-8086-67377409e7db None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:51.559240 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 459/908] 10.222.0.96 () {56 vars in 1087 bytes} [Wed Aug 24 04:18:51 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:18:51.560402 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd635210-b3f1-4ecd-b3a8-6b018cdb89b7 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:51.560710 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd635210-b3f1-4ecd-b3a8-6b018cdb89b7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:51.560992 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd635210-b3f1-4ecd-b3a8-6b018cdb89b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:51.580764 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-dd635210-b3f1-4ecd-b3a8-6b018cdb89b7 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:51.583008 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-dd635210-b3f1-4ecd-b3a8-6b018cdb89b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:51.584137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a51d4-938e-45bc-8659-e8ede32ca7b1 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:51.629573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d3234-0957-4f0d-b683-ea5e5f9dddd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:51.630499 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d3234-0957-4f0d-b683-ea5e5f9dddd9 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:51.630943 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d3234-0957-4f0d-b683-ea5e5f9dddd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:51.631369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d3234-0957-4f0d-b683-ea5e5f9dddd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:51.647782 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d3234-0957-4f0d-b683-ea5e5f9dddd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:51.650026 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d3234-0957-4f0d-b683-ea5e5f9dddd9 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:51.668988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-a28d3234-0957-4f0d-b683-ea5e5f9dddd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:51.668988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:51.668988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:51.668988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:51.668988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:51.668988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:51.668988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:51.668988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:51.668988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:51.668988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:51.668988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:51.668988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:51.668988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:51.668988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:51.668988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:51.668988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:51.670003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:51.670003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:51.670003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:51.670003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:51.670003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:51.670003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:51.670003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:51.670003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:51.670003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:51.670003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:51.670003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:51.670003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:51.670003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:51.670003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:51.670003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:51.670003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:51.670003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:51.670890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:51.670890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:51.670890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:51.677520 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 460/910] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:18:51.677891 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 450/910] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:51.678675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd635210-b3f1-4ecd-b3a8-6b018cdb89b7 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:51.757561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:51.802035 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd635210-b3f1-4ecd-b3a8-6b018cdb89b7 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:51.850382 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd9823-464e-4800-bdc5-b03c4315a6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:51.851005 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd9823-464e-4800-bdc5-b03c4315a6c5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:51.851289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd9823-464e-4800-bdc5-b03c4315a6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:51.851568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd9823-464e-4800-bdc5-b03c4315a6c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:51.852219 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd9823-464e-4800-bdc5-b03c4315a6c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:51.852525 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd9823-464e-4800-bdc5-b03c4315a6c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:51.854041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd9823-464e-4800-bdc5-b03c4315a6c5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:51.866970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 461/911] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:18:51.872352 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d3234-0957-4f0d-b683-ea5e5f9dddd9 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:51.957820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd9823-464e-4800-bdc5-b03c4315a6c5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:51.962554 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:51.985282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d3234-0957-4f0d-b683-ea5e5f9dddd9 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:52.024074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef0cd2-0392-41f4-ab46-443fea52cda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:52.024635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef0cd2-0392-41f4-ab46-443fea52cda4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:52.024950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef0cd2-0392-41f4-ab46-443fea52cda4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:52.025230 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef0cd2-0392-41f4-ab46-443fea52cda4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:52.032448 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef0cd2-0392-41f4-ab46-443fea52cda4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:52.033929 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef0cd2-0392-41f4-ab46-443fea52cda4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:52.046959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-5bef0cd2-0392-41f4-ab46-443fea52cda4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:52.046959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:52.046959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:52.046959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:52.046959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:52.046959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:52.046959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:52.046959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:52.046959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:52.046959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:52.046959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:52.046959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:52.046959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:52.046959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:52.046959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:52.047931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:52.047931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:52.047931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:52.047931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:52.047931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:52.047931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:52.047931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:52.047931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:52.047931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:52.047931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:52.047931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:52.047931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:52.047931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:52.047931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:52.047931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:52.047931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:52.047931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:52.048920 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:52.048920 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:52.048920 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:52.048920 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:52.048920 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:52.048920 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:52.048920 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:52.048920 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:52.048920 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 451/912] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:52.056651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef0cd2-0392-41f4-ab46-443fea52cda4 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:52.084880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd9823-464e-4800-bdc5-b03c4315a6c5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:52.119051 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:52.139617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0374c8-251c-4520-a15c-25b0c71f0225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:52.140585 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0374c8-251c-4520-a15c-25b0c71f0225 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:52.140914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0374c8-251c-4520-a15c-25b0c71f0225 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:52.141330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0374c8-251c-4520-a15c-25b0c71f0225 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:52.142200 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0374c8-251c-4520-a15c-25b0c71f0225 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:52.144833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0374c8-251c-4520-a15c-25b0c71f0225 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:52.157589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-2e0374c8-251c-4520-a15c-25b0c71f0225 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:18:52.157589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:52.157589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:18:52.157589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:18:52.157589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:18:52.157589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:18:52.157589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:18:52.157589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:52.157589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:18:52.157589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:52.157589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:18:52.157589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:52.157589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:52.157589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:52.157589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:52.157589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:52.157589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:52.158639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:52.158639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:52.158639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:52.158639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:52.158639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:52.158639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:52.158639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:18:52.158639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:18:52.158639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:18:52.158639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:18:52.158639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:52.158639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:52.158639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:52.158639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:52.158639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:52.158639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:52.159471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:52.159471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:52.159471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:52.159471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:52.159471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:52.159471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:52.159471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:52.159471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:52.159471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:52.159471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:52.159471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:18:52.159471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:52.159471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:18:52.159471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:52.159471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 462/913] 10.222.0.96 () {56 vars in 1114 bytes} [Wed Aug 24 04:18:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:18:52.167356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0374c8-251c-4520-a15c-25b0c71f0225 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:52.195230 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef0cd2-0392-41f4-ab46-443fea52cda4 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:52.234815 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63571a-f0ff-405f-b143-e3a6ec385043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:52.235492 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63571a-f0ff-405f-b143-e3a6ec385043 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:52.235726 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63571a-f0ff-405f-b143-e3a6ec385043 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:52.236004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63571a-f0ff-405f-b143-e3a6ec385043 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:52.236917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63571a-f0ff-405f-b143-e3a6ec385043 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:52.237233 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63571a-f0ff-405f-b143-e3a6ec385043 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:52.239135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63571a-f0ff-405f-b143-e3a6ec385043 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:52.254074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 452/914] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:52.259551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63571a-f0ff-405f-b143-e3a6ec385043 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:52.262446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:52.280200 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0374c8-251c-4520-a15c-25b0c71f0225 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:52.317363 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed374e-878c-43c9-80fe-9ba3b31b1805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:52.318395 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed374e-878c-43c9-80fe-9ba3b31b1805 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:52.318893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed374e-878c-43c9-80fe-9ba3b31b1805 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:52.319391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed374e-878c-43c9-80fe-9ba3b31b1805 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:52.320234 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed374e-878c-43c9-80fe-9ba3b31b1805 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:52.320773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed374e-878c-43c9-80fe-9ba3b31b1805 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:52.322642 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed374e-878c-43c9-80fe-9ba3b31b1805 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:52.333359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 463/915] 10.222.0.96 () {56 vars in 1114 bytes} [Wed Aug 24 04:18:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:18:52.334488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed374e-878c-43c9-80fe-9ba3b31b1805 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:52.374248 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63571a-f0ff-405f-b143-e3a6ec385043 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:52.389577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:52.414971 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac6b5e-92a6-4d5c-a796-fa85fde41da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:52.415319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac6b5e-92a6-4d5c-a796-fa85fde41da1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:52.415531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac6b5e-92a6-4d5c-a796-fa85fde41da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:52.415815 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac6b5e-92a6-4d5c-a796-fa85fde41da1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:52.416559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac6b5e-92a6-4d5c-a796-fa85fde41da1 None admin] RBAC: Adding query filter params (role.id=e760dc89dca8425fa560d31c5a0fec8d, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=e9ffc48d1f6d49f49d00d1c2e762b987) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:52.416921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac6b5e-92a6-4d5c-a796-fa85fde41da1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:52.418368 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac6b5e-92a6-4d5c-a796-fa85fde41da1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:52.424418 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 453/916] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:18:52 2022] GET /identity/v3/role_assignments?user.id=e9ffc48d1f6d49f49d00d1c2e762b987&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=e760dc89dca8425fa560d31c5a0fec8d => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:18:52.444410 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed374e-878c-43c9-80fe-9ba3b31b1805 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:52.485310 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8c7d7-6426-4a9d-8cfe-ebf6783b3bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:52.486363 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8c7d7-6426-4a9d-8cfe-ebf6783b3bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:52.486861 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8c7d7-6426-4a9d-8cfe-ebf6783b3bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:52.487343 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8c7d7-6426-4a9d-8cfe-ebf6783b3bf9 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:52.488278 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8c7d7-6426-4a9d-8cfe-ebf6783b3bf9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:52.488993 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8c7d7-6426-4a9d-8cfe-ebf6783b3bf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:52.490742 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8c7d7-6426-4a9d-8cfe-ebf6783b3bf9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:52.497388 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 464/917] 10.222.0.96 () {56 vars in 1114 bytes} [Wed Aug 24 04:18:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:52.504081 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac6b5e-92a6-4d5c-a796-fa85fde41da1 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:52.579033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:52.620105 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac6b5e-92a6-4d5c-a796-fa85fde41da1 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:52.645870 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a72f76-1050-4ddc-a5cb-759e5ae17eca None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:52.646537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a72f76-1050-4ddc-a5cb-759e5ae17eca None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:52.647029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a72f76-1050-4ddc-a5cb-759e5ae17eca None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:52.649448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 465/918] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:18:52.656438 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bd118-4894-40e6-8e33-7b8df9751012 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:52.657131 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bd118-4894-40e6-8e33-7b8df9751012 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:52.657640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bd118-4894-40e6-8e33-7b8df9751012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:52.665303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d036e-5450-40b9-9354-6f2544d30f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:52.666517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d036e-5450-40b9-9354-6f2544d30f4b None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:52.666517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d036e-5450-40b9-9354-6f2544d30f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:52.666517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d036e-5450-40b9-9354-6f2544d30f4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:52.667124 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d036e-5450-40b9-9354-6f2544d30f4b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:52.668497 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d036e-5450-40b9-9354-6f2544d30f4b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:52.678419 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a51bd118-4894-40e6-8e33-7b8df9751012 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:52.680154 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a51bd118-4894-40e6-8e33-7b8df9751012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:52.694141 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 454/919] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:18:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:18:52.777553 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 466/920] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:18:53.056451 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d036e-5450-40b9-9354-6f2544d30f4b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:53.167151 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d036e-5450-40b9-9354-6f2544d30f4b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:53.191758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:53.205405 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26e449-4c18-4956-ae36-549d4a3a468e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:53.206365 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26e449-4c18-4956-ae36-549d4a3a468e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:53.207545 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26e449-4c18-4956-ae36-549d4a3a468e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:53.208094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26e449-4c18-4956-ae36-549d4a3a468e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:53.208995 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26e449-4c18-4956-ae36-549d4a3a468e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:53.210765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26e449-4c18-4956-ae36-549d4a3a468e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:53.220338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-0a26e449-4c18-4956-ae36-549d4a3a468e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:18:53.220338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:53.220338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:18:53.220338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:18:53.220338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:18:53.220338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:18:53.220338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:18:53.220338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:53.220338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:18:53.220338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:53.220338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:18:53.220338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:53.220338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:53.220338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:53.220338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:53.220338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:53.220338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:53.221413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:53.221413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:53.221413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:53.221413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:53.221413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:53.221413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:53.221413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:18:53.221413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:18:53.221413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:18:53.221413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:18:53.221413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:53.221413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:53.221413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:53.221413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:53.221413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:53.221413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:53.222266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:53.222266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:53.222266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:53.222266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:53.222266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:53.222266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:53.222266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:53.222266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:53.222266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:53.222266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:53.222266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:18:53.222266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:53.222266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:18:53.222266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:53.230621 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 455/921] 10.222.0.96 () {56 vars in 1126 bytes} [Wed Aug 24 04:18:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:53.232241 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bd118-4894-40e6-8e33-7b8df9751012 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:53.278070 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:53.339763 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bd118-4894-40e6-8e33-7b8df9751012 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:53.377112 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871a6e1-947f-44d3-88fb-2a076af5133d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:53.377729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871a6e1-947f-44d3-88fb-2a076af5133d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:53.378012 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871a6e1-947f-44d3-88fb-2a076af5133d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:53.378291 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871a6e1-947f-44d3-88fb-2a076af5133d None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:53.379039 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871a6e1-947f-44d3-88fb-2a076af5133d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:53.379398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871a6e1-947f-44d3-88fb-2a076af5133d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:53.380905 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871a6e1-947f-44d3-88fb-2a076af5133d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:53.387164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 467/922] 10.222.0.96 () {56 vars in 1122 bytes} [Wed Aug 24 04:18:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:53.394297 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26e449-4c18-4956-ae36-549d4a3a468e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:53.503525 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26e449-4c18-4956-ae36-549d4a3a468e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:53.539333 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a26f9a-ba98-4807-9497-641dadce0fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:53.540355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a26f9a-ba98-4807-9497-641dadce0fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:53.540923 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a26f9a-ba98-4807-9497-641dadce0fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:53.541419 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a26f9a-ba98-4807-9497-641dadce0fb4 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:53.542291 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a26f9a-ba98-4807-9497-641dadce0fb4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:53.542822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a26f9a-ba98-4807-9497-641dadce0fb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:53.544532 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a26f9a-ba98-4807-9497-641dadce0fb4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:53.556236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 456/923] 10.222.0.96 () {56 vars in 1122 bytes} [Wed Aug 24 04:18:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:53.558009 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871a6e1-947f-44d3-88fb-2a076af5133d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:53.645971 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f51b96-3fb5-4d9f-aab3-b62b20994189 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:53.646296 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f51b96-3fb5-4d9f-aab3-b62b20994189 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:53.646541 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f51b96-3fb5-4d9f-aab3-b62b20994189 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:53.648144 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 457/924] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:53.653123 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7238ce-aadb-4299-80f5-452977457b65 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:53.653416 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7238ce-aadb-4299-80f5-452977457b65 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:53.653699 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7238ce-aadb-4299-80f5-452977457b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:53.672407 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9c7238ce-aadb-4299-80f5-452977457b65 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:53.673662 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9c7238ce-aadb-4299-80f5-452977457b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:53.676150 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871a6e1-947f-44d3-88fb-2a076af5133d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:53.684163 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:53.713373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396a053-0949-4913-9fc3-3109b9a1ff77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:53.713991 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396a053-0949-4913-9fc3-3109b9a1ff77 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:53.714274 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396a053-0949-4913-9fc3-3109b9a1ff77 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:53.714554 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396a053-0949-4913-9fc3-3109b9a1ff77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:53.715366 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396a053-0949-4913-9fc3-3109b9a1ff77 None admin] RBAC: Adding query filter params (interface=public, service_id=62028c0a24534856aa9a492ee0a07482, region_id=RegionOne) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:53.715573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396a053-0949-4913-9fc3-3109b9a1ff77 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:53.717213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396a053-0949-4913-9fc3-3109b9a1ff77 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:53.727475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 468/925] 10.222.0.96 () {56 vars in 1251 bytes} [Wed Aug 24 04:18:53 2022] GET /identity/v3/endpoints?service_id=62028c0a24534856aa9a492ee0a07482&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:53.729606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396a053-0949-4913-9fc3-3109b9a1ff77 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:53.758612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 458/926] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:18:53.761076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:53.849423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396a053-0949-4913-9fc3-3109b9a1ff77 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:53.887863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788a039-554a-430e-987b-0dc9241ec281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:53.888503 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788a039-554a-430e-987b-0dc9241ec281 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:53.888819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788a039-554a-430e-987b-0dc9241ec281 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:53.889099 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788a039-554a-430e-987b-0dc9241ec281 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:53.889731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788a039-554a-430e-987b-0dc9241ec281 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:53.891275 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788a039-554a-430e-987b-0dc9241ec281 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:53.902991 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 469/927] 10.222.0.96 () {56 vars in 1087 bytes} [Wed Aug 24 04:18:53 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:18:54.053145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7238ce-aadb-4299-80f5-452977457b65 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:54.158196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7238ce-aadb-4299-80f5-452977457b65 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:54.197146 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f41f3-2866-4163-90d7-adf5e0caec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:54.198196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f41f3-2866-4163-90d7-adf5e0caec3b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:54.198684 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f41f3-2866-4163-90d7-adf5e0caec3b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:54.199170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f41f3-2866-4163-90d7-adf5e0caec3b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:54.199965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f41f3-2866-4163-90d7-adf5e0caec3b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:54.201566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f41f3-2866-4163-90d7-adf5e0caec3b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:54.210856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-500f41f3-2866-4163-90d7-adf5e0caec3b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:18:54.210856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:54.210856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:18:54.210856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:18:54.210856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:18:54.210856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:18:54.210856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:18:54.210856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:54.210856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:18:54.210856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:54.210856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:18:54.210856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:54.210856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:54.210856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:54.210856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:54.210856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:54.211809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:54.211809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:54.211809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:54.211809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:54.211809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:54.211809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:54.211809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:54.211809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:18:54.211809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:18:54.211809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:18:54.211809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:18:54.211809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:54.211809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:54.211809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:54.211809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:54.211809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:54.211809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:54.212707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:54.212707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:54.212707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:54.212707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:54.212707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:54.212707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:54.212707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:54.212707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:54.212707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:54.212707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:54.212707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:18:54.212707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:54.212707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:18:54.212707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:54.215562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 459/928] 10.222.0.96 () {56 vars in 1132 bytes} [Wed Aug 24 04:18:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:54.221703 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788a039-554a-430e-987b-0dc9241ec281 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:54.263298 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:54.334548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788a039-554a-430e-987b-0dc9241ec281 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:54.371008 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7596e-f722-4ae3-b0bf-9fa4e035653b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:54.371624 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7596e-f722-4ae3-b0bf-9fa4e035653b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:54.371907 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7596e-f722-4ae3-b0bf-9fa4e035653b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:54.372181 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7596e-f722-4ae3-b0bf-9fa4e035653b None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:54.372849 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7596e-f722-4ae3-b0bf-9fa4e035653b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:54.373158 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7596e-f722-4ae3-b0bf-9fa4e035653b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:54.374529 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7596e-f722-4ae3-b0bf-9fa4e035653b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:54.380016 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 470/929] 10.222.0.96 () {56 vars in 1126 bytes} [Wed Aug 24 04:18:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:54.385677 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f41f3-2866-4163-90d7-adf5e0caec3b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:54.407894 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b13d3-5734-4069-92b9-9b15f70d6e4d None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:54.408231 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b13d3-5734-4069-92b9-9b15f70d6e4d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:54.408448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b13d3-5734-4069-92b9-9b15f70d6e4d None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:54.410526 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 471/930] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:18:54.415622 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89232e10-d2c4-4450-9100-fab4a45d8395 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:54.415915 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89232e10-d2c4-4450-9100-fab4a45d8395 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:54.416192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89232e10-d2c4-4450-9100-fab4a45d8395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:54.435067 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-89232e10-d2c4-4450-9100-fab4a45d8395 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:54.436336 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-89232e10-d2c4-4450-9100-fab4a45d8395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:54.439752 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:54.524859 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f41f3-2866-4163-90d7-adf5e0caec3b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:54.533504 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 472/931] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:18:54.569131 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80d44e-91c2-4b77-922a-6bd228e83fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:54.570085 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80d44e-91c2-4b77-922a-6bd228e83fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:54.570585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80d44e-91c2-4b77-922a-6bd228e83fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:54.571081 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80d44e-91c2-4b77-922a-6bd228e83fd5 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:54.572229 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80d44e-91c2-4b77-922a-6bd228e83fd5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:54.572764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80d44e-91c2-4b77-922a-6bd228e83fd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:54.574380 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80d44e-91c2-4b77-922a-6bd228e83fd5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:54.579996 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 460/932] 10.222.0.96 () {56 vars in 1126 bytes} [Wed Aug 24 04:18:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:54.585908 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89232e10-d2c4-4450-9100-fab4a45d8395 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:54.615979 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:54.692334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89232e10-d2c4-4450-9100-fab4a45d8395 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:54.728563 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c4ffb-6eb6-47ed-81a6-d178e7f740ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:54.729560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c4ffb-6eb6-47ed-81a6-d178e7f740ec None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:54.730052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c4ffb-6eb6-47ed-81a6-d178e7f740ec None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:54.730552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c4ffb-6eb6-47ed-81a6-d178e7f740ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:54.731440 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c4ffb-6eb6-47ed-81a6-d178e7f740ec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:54.733058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c4ffb-6eb6-47ed-81a6-d178e7f740ec None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:54.752980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23d9dc-eb31-4dd3-ae7d-b4682e85980c None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:54.753328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23d9dc-eb31-4dd3-ae7d-b4682e85980c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:54.754072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23d9dc-eb31-4dd3-ae7d-b4682e85980c None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:54.755729 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 461/933] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:54.757269 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 473/934] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:18:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:18:54.766872 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1111f-3ff7-4f07-b175-178cbd52bc77 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:54.767374 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1111f-3ff7-4f07-b175-178cbd52bc77 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:54.767744 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1111f-3ff7-4f07-b175-178cbd52bc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:54.790185 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d5a1111f-3ff7-4f07-b175-178cbd52bc77 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:54.791604 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d5a1111f-3ff7-4f07-b175-178cbd52bc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:54.836733 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c4ffb-6eb6-47ed-81a6-d178e7f740ec None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:54.881765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 462/935] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:18:54.939207 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:54.960091 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c4ffb-6eb6-47ed-81a6-d178e7f740ec None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:54.995162 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7c0f1-62a6-4c89-968c-1dceee57d626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:54.995805 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7c0f1-62a6-4c89-968c-1dceee57d626 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:54.996092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7c0f1-62a6-4c89-968c-1dceee57d626 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:54.996368 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7c0f1-62a6-4c89-968c-1dceee57d626 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:55.007991 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7c0f1-62a6-4c89-968c-1dceee57d626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:55.013406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-aef7c0f1-62a6-4c89-968c-1dceee57d626 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:18:55.013406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:55.013406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:55.013406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:55.013406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:55.013406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:55.013406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:55.013406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:55.013406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:55.013406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:55.013406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:55.013406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:55.013406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:55.013406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:55.013406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:55.013406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:55.014304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:55.014304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:55.014304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:55.014304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:55.014304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:55.014304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:55.014304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:55.014304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:55.014304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:55.014304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:55.014304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:55.014304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:55.014304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:55.014304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:55.014304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:55.014304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:55.015352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:55.015352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:55.015352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:55.015352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:55.015352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:55.015352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:55.015352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:55.015352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:55.015352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:55.015352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:55.015352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:18:55.015352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:55.015352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 474/936] 10.222.0.96 () {56 vars in 1120 bytes} [Wed Aug 24 04:18:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:55.023459 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1111f-3ff7-4f07-b175-178cbd52bc77 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:55.060965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:55.140264 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1111f-3ff7-4f07-b175-178cbd52bc77 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:55.157514 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7c0f1-62a6-4c89-968c-1dceee57d626 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:55.179889 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfcc5a-5f8f-4888-8111-f62c87af29c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:55.180507 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfcc5a-5f8f-4888-8111-f62c87af29c6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:55.180826 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfcc5a-5f8f-4888-8111-f62c87af29c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:55.181138 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfcc5a-5f8f-4888-8111-f62c87af29c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:55.181819 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfcc5a-5f8f-4888-8111-f62c87af29c6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:55.182130 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfcc5a-5f8f-4888-8111-f62c87af29c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:55.183490 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfcc5a-5f8f-4888-8111-f62c87af29c6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:55.196862 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 463/937] 10.222.0.96 () {56 vars in 1115 bytes} [Wed Aug 24 04:18:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:55.198906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfcc5a-5f8f-4888-8111-f62c87af29c6 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:55.277880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7c0f1-62a6-4c89-968c-1dceee57d626 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:55.303483 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:55.310347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfcc5a-5f8f-4888-8111-f62c87af29c6 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:55.319899 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19211ee5-2d92-4ac4-9d8e-3c5626712acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:55.320659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19211ee5-2d92-4ac4-9d8e-3c5626712acd None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:55.321086 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19211ee5-2d92-4ac4-9d8e-3c5626712acd None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:55.321948 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19211ee5-2d92-4ac4-9d8e-3c5626712acd None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:55.322498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19211ee5-2d92-4ac4-9d8e-3c5626712acd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:55.324118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19211ee5-2d92-4ac4-9d8e-3c5626712acd None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:55.326971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: WARNING keystone.server.flask.common [None req-19211ee5-2d92-4ac4-9d8e-3c5626712acd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 04:18:55.342935 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:55.349840 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.sql.core [None req-19211ee5-2d92-4ac4-9d8e-3c5626712acd None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 04:18:55.349840 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 04:18:55.349840 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [parameters: {'id': 'ac520aeca5da450a8b6ef88cdd78fe54', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 04:18:55.349840 dv-cinder-854263-1-smb devstack@keystone.service[81517]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81517) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 04:18:55.350885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1b752-cdf7-4144-bfff-659f69b7881e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:55.351974 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1b752-cdf7-4144-bfff-659f69b7881e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:55.353707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1b752-cdf7-4144-bfff-659f69b7881e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:55.354128 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1b752-cdf7-4144-bfff-659f69b7881e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:55.361344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-19211ee5-2d92-4ac4-9d8e-3c5626712acd None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ac520aeca5da450a8b6ef88cdd78fe54.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ac520aeca5da450a8b6ef88cdd78fe54. Aug 24 04:18:55.361344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:55.361344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:18:55.361344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:18:55.361344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:18:55.361344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:18:55.361344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:18:55.361344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:18:55.361344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:18:55.361344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:18:55.361344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:18:55.361344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:18:55.361344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:18:55.362169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application result.read() Aug 24 04:18:55.362169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:18:55.362169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:18:55.362169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:18:55.362169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:18:55.362169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:18:55.362169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:18:55.362169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:18:55.362169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:18:55.362169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 04:18:55.362169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:55.362169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 04:18:55.362169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:55.362169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:55.362169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 04:18:55.362169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 04:18:55.362169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 04:18:55.362169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 04:18:55.363826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:18:55.363826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:18:55.363826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 04:18:55.363826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application yield resource Aug 24 04:18:55.363826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:18:55.363826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:18:55.363826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 04:18:55.363826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 04:18:55.363826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 04:18:55.363826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 04:18:55.363826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 04:18:55.363826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise self.value Aug 24 04:18:55.363826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 04:18:55.363826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 04:18:55.363826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 04:18:55.363826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application session.commit() Aug 24 04:18:55.363826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 04:18:55.364747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 04:18:55.364747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 04:18:55.364747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 04:18:55.364747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 04:18:55.364747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self.session.flush() Aug 24 04:18:55.364747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 04:18:55.364747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 04:18:55.364747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 04:18:55.364747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 04:18:55.364747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 04:18:55.364747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application compat.raise_( Aug 24 04:18:55.364747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:18:55.364747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception Aug 24 04:18:55.364747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 04:18:55.364747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 04:18:55.364747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 04:18:55.364747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 04:18:55.365638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 04:18:55.365638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 04:18:55.365638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 04:18:55.365638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 04:18:55.365638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 04:18:55.365638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 04:18:55.365638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 04:18:55.365638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 04:18:55.365638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 04:18:55.365638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 04:18:55.365638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 04:18:55.365638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 04:18:55.365638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 04:18:55.365638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 04:18:55.365638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 04:18:55.366448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 04:18:55.366448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:18:55.366448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception Aug 24 04:18:55.366448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:18:55.366448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:18:55.366448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:18:55.366448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:18:55.366448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:18:55.366448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:18:55.366448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:18:55.366448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:18:55.366448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:18:55.366448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:18:55.366448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:18:55.366448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application result.read() Aug 24 04:18:55.366448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:18:55.366448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:18:55.367308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:18:55.367308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:18:55.367308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:18:55.367308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:18:55.367308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:18:55.367308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:18:55.367308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 04:18:55.367308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 04:18:55.367308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [parameters: {'id': 'ac520aeca5da450a8b6ef88cdd78fe54', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 04:18:55.367308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 04:18:55.367308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:55.367308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:18:55.367308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:55.367308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:55.367308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 04:18:55.368078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 04:18:55.368078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 04:18:55.368078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 04:18:55.368078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 04:18:55.368078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:55.368078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:18:55.368078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:55.368078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:55.368078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:55.368078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:55.368078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:55.368078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:55.368078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:55.368078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:55.368078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:55.368078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:55.368078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:55.371878 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:55.371878 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 04:18:55.371878 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 04:18:55.371878 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:55.371878 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:55.371878 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 04:18:55.371878 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 04:18:55.371878 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ac520aeca5da450a8b6ef88cdd78fe54. Aug 24 04:18:55.371878 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:55.371878 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 475/938] 10.222.0.96 () {60 vars in 1140 bytes} [Wed Aug 24 04:18:55 2022] POST /identity/v3/projects => generated 262 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:55.373482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19211ee5-2d92-4ac4-9d8e-3c5626712acd None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:55.374421 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1b752-cdf7-4144-bfff-659f69b7881e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:55.376302 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb1b752-cdf7-4144-bfff-659f69b7881e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:55.396823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-bcb1b752-cdf7-4144-bfff-659f69b7881e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:55.396823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:55.396823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:55.396823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:55.396823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:55.396823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:55.396823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:55.396823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:55.396823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:55.396823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:55.396823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:55.396823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:55.396823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:55.396823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:55.396823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:55.396823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:55.397991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:55.397991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:55.397991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:55.397991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:55.397991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:55.397991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:55.397991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:55.397991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:55.397991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:55.397991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:55.397991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:55.397991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:55.397991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:55.397991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:55.397991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:55.397991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:55.397991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:55.399087 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:55.399087 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:55.399087 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:55.403670 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 464/939] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:55.404778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1b752-cdf7-4144-bfff-659f69b7881e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:55.499236 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19211ee5-2d92-4ac4-9d8e-3c5626712acd None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:55.524381 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1b752-cdf7-4144-bfff-659f69b7881e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:55.536298 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087636df-25a8-4cdd-9185-6c1e6e30a386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:55.536960 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087636df-25a8-4cdd-9185-6c1e6e30a386 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:55.537246 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087636df-25a8-4cdd-9185-6c1e6e30a386 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:55.537532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087636df-25a8-4cdd-9185-6c1e6e30a386 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:55.544637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087636df-25a8-4cdd-9185-6c1e6e30a386 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:55.546318 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087636df-25a8-4cdd-9185-6c1e6e30a386 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:55.558756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-087636df-25a8-4cdd-9185-6c1e6e30a386 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:55.558756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:55.558756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:55.558756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:55.558756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:55.558756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:55.558756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:55.558756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:55.558756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:55.558756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:55.558756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:55.558756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:55.558756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:55.558756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:55.558756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:55.559677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:55.559677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:55.559677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:55.559677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:55.559677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:55.559677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:55.559677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:55.559677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:55.559677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:55.559677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:55.559677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:55.559677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:55.559677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:55.559677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:55.559677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:55.559677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:55.559677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:55.560611 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:55.560611 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:55.560611 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:55.560611 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:55.560611 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:55.560611 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:55.560611 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:55.560611 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:55.560611 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 476/940] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:55.568139 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087636df-25a8-4cdd-9185-6c1e6e30a386 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:55.573000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb5fe1-bba5-476c-aa33-30b261493f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:55.573898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb5fe1-bba5-476c-aa33-30b261493f01 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:55.574386 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb5fe1-bba5-476c-aa33-30b261493f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:55.574856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb5fe1-bba5-476c-aa33-30b261493f01 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:55.575817 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb5fe1-bba5-476c-aa33-30b261493f01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:55.576318 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb5fe1-bba5-476c-aa33-30b261493f01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:55.578024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb5fe1-bba5-476c-aa33-30b261493f01 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:55.592230 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 465/941] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:55.598311 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb5fe1-bba5-476c-aa33-30b261493f01 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:55.617604 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:55.653639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:55.701788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087636df-25a8-4cdd-9185-6c1e6e30a386 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:55.739106 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e899d76-f17d-4db4-8489-2dac018845a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:55.739728 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e899d76-f17d-4db4-8489-2dac018845a6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:55.740020 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e899d76-f17d-4db4-8489-2dac018845a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:55.740301 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e899d76-f17d-4db4-8489-2dac018845a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:55.741016 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e899d76-f17d-4db4-8489-2dac018845a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:55.741330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e899d76-f17d-4db4-8489-2dac018845a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:55.741844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb5fe1-bba5-476c-aa33-30b261493f01 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:55.742842 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e899d76-f17d-4db4-8489-2dac018845a6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:55.773121 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 477/942] 10.222.0.96 () {56 vars in 1112 bytes} [Wed Aug 24 04:18:55 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:55.783518 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f1cb5-fcd3-4ced-b501-19e73233fafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:55.784596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f1cb5-fcd3-4ced-b501-19e73233fafe None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:55.785285 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f1cb5-fcd3-4ced-b501-19e73233fafe None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:55.785854 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f1cb5-fcd3-4ced-b501-19e73233fafe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:55.794916 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f1cb5-fcd3-4ced-b501-19e73233fafe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:55.796813 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f1cb5-fcd3-4ced-b501-19e73233fafe None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:55.810585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-f73f1cb5-fcd3-4ced-b501-19e73233fafe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:18:55.810585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:55.810585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:55.810585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:55.810585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:55.810585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:55.810585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:55.810585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:55.810585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:55.810585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:55.810585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:55.810585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:55.810585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:55.810585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:55.810585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:55.810585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:55.811612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:55.811612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:55.811612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:55.811612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:55.811612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:55.811612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:55.811612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:55.811612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:55.811612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:55.811612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:55.811612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:55.811612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:55.811612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:55.811612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:55.811612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:55.811612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:55.811612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:55.811612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:55.812565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:55.812565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:55.812565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:55.812565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:55.812565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:55.812565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:55.812565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:55.812565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:55.812565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:18:55.812565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:55.815343 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 466/943] 10.222.0.96 () {56 vars in 1117 bytes} [Wed Aug 24 04:18:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:55.822066 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e899d76-f17d-4db4-8489-2dac018845a6 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:55.939827 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e899d76-f17d-4db4-8489-2dac018845a6 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:55.964477 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:55.980539 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5354f-e975-44cc-b883-cec21d6c3cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:55.981388 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5354f-e975-44cc-b883-cec21d6c3cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:55.981767 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5354f-e975-44cc-b883-cec21d6c3cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:55.982149 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5354f-e975-44cc-b883-cec21d6c3cc0 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:55.983014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5354f-e975-44cc-b883-cec21d6c3cc0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:55.983425 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5354f-e975-44cc-b883-cec21d6c3cc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:55.984888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5354f-e975-44cc-b883-cec21d6c3cc0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:56.004822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e717e8-8b4c-456d-9103-f74d749ec63b None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:56.005261 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e717e8-8b4c-456d-9103-f74d749ec63b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:56.005647 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e717e8-8b4c-456d-9103-f74d749ec63b None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:56.006851 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 478/944] 10.222.0.96 () {56 vars in 1149 bytes} [Wed Aug 24 04:18:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:56.008162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 467/945] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:56.012556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5354f-e975-44cc-b883-cec21d6c3cc0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:56.015700 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dd5e3-3748-4073-9126-d08a003b6671 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:56.016089 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dd5e3-3748-4073-9126-d08a003b6671 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:56.016467 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dd5e3-3748-4073-9126-d08a003b6671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:56.038058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-468dd5e3-3748-4073-9126-d08a003b6671 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:56.039493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-468dd5e3-3748-4073-9126-d08a003b6671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:56.115666 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:56.129201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 468/946] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:18:56.139425 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5354f-e975-44cc-b883-cec21d6c3cc0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:56.174991 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8392db-1335-453f-829e-4e8a381c3a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:56.176169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8392db-1335-453f-829e-4e8a381c3a74 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:56.176471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8392db-1335-453f-829e-4e8a381c3a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:56.176725 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8392db-1335-453f-829e-4e8a381c3a74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:56.187654 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8392db-1335-453f-829e-4e8a381c3a74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:56.189185 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8392db-1335-453f-829e-4e8a381c3a74 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:56.205297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-2a8392db-1335-453f-829e-4e8a381c3a74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:56.205297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:56.205297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:56.205297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:56.205297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:56.205297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:56.205297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:56.205297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:56.205297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:56.205297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:56.205297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:56.205297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:56.205297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:56.205297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:56.205297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:56.205297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:56.206245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:56.206245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:56.206245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:56.206245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:56.206245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:56.206245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:56.206245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:56.206245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:56.206245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:56.206245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:56.206245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:56.206245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:56.206245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:56.206245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:56.206245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:56.206245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:56.206245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:56.208422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:56.208422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:56.208422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:56.208422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 479/947] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:56.212657 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468dd5e3-3748-4073-9126-d08a003b6671 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:56.321988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468dd5e3-3748-4073-9126-d08a003b6671 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:56.358185 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0fa5b-aa6a-44be-ae3b-2dd1ca874dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:56.358802 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0fa5b-aa6a-44be-ae3b-2dd1ca874dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:56.359085 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0fa5b-aa6a-44be-ae3b-2dd1ca874dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:56.359367 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0fa5b-aa6a-44be-ae3b-2dd1ca874dc1 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:56.360023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0fa5b-aa6a-44be-ae3b-2dd1ca874dc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:56.360332 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0fa5b-aa6a-44be-ae3b-2dd1ca874dc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:56.361746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0fa5b-aa6a-44be-ae3b-2dd1ca874dc1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:56.374607 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 469/948] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:56.379980 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8392db-1335-453f-829e-4e8a381c3a74 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:56.410918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0fa5b-aa6a-44be-ae3b-2dd1ca874dc1 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:56.413482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:56.474997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:56.485249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8392db-1335-453f-829e-4e8a381c3a74 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:56.523179 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f3030-c7e2-42d0-92dd-fd259af3bc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:56.523815 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f3030-c7e2-42d0-92dd-fd259af3bc67 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:56.524093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f3030-c7e2-42d0-92dd-fd259af3bc67 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:56.524363 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f3030-c7e2-42d0-92dd-fd259af3bc67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:56.524946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0fa5b-aa6a-44be-ae3b-2dd1ca874dc1 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:56.532339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f3030-c7e2-42d0-92dd-fd259af3bc67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:56.533824 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f3030-c7e2-42d0-92dd-fd259af3bc67 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:56.546124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-958f3030-c7e2-42d0-92dd-fd259af3bc67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:56.546124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:56.546124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:56.546124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:56.546124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:56.546124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:56.546124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:56.546124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:56.546124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:56.546124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:56.546124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:56.546124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:56.546124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:18:56.546124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:18:56.546124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:18:56.547056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:18:56.547056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:56.547056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:56.547056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:56.547056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:56.547056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:56.547056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:56.547056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:56.547056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:56.547056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:56.547056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:56.547056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:56.547056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:56.547056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:56.547056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:56.547056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:56.547056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:56.548709 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:18:56.548709 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:18:56.548709 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:18:56.548709 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:18:56.548709 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:18:56.548709 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:18:56.548709 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:18:56.548709 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:56.552647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 480/949] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:56.553565 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f3030-c7e2-42d0-92dd-fd259af3bc67 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:56.565044 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d477ee4-365a-4f42-b1a2-fce4096ea2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:56.566105 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d477ee4-365a-4f42-b1a2-fce4096ea2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:56.566409 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d477ee4-365a-4f42-b1a2-fce4096ea2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:56.566695 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d477ee4-365a-4f42-b1a2-fce4096ea2f6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:56.567310 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d477ee4-365a-4f42-b1a2-fce4096ea2f6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:56.569334 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d477ee4-365a-4f42-b1a2-fce4096ea2f6 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:56.581288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-1d477ee4-365a-4f42-b1a2-fce4096ea2f6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:18:56.581288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:56.581288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:18:56.581288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:18:56.581288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:18:56.581288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:18:56.581288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:18:56.581288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:56.581288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:18:56.581288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:56.581288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:18:56.581288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:56.581288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:56.581288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:56.581288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:56.581288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:56.581288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:56.582494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:56.582494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:56.582494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:56.582494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:56.582494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:56.582494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:56.582494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:18:56.582494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:18:56.582494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:18:56.582494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:18:56.582494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:56.582494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:56.582494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:56.582494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:56.582494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:56.582494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:56.584009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:56.584009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:56.584009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:56.584009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:56.584009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:56.584009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:56.584009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:56.584009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:56.584009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:56.584009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:56.584009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:18:56.584009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:56.584009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:18:56.584009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:56.584009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 470/950] 10.222.0.96 () {56 vars in 1126 bytes} [Wed Aug 24 04:18:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:18:56.591058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d477ee4-365a-4f42-b1a2-fce4096ea2f6 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:56.656412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:56.671128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f3030-c7e2-42d0-92dd-fd259af3bc67 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:56.709271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96197ef-5156-4c2a-a9a2-6a0a5f71391d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:56.710047 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96197ef-5156-4c2a-a9a2-6a0a5f71391d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:56.710162 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96197ef-5156-4c2a-a9a2-6a0a5f71391d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:56.710430 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96197ef-5156-4c2a-a9a2-6a0a5f71391d None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:56.711126 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96197ef-5156-4c2a-a9a2-6a0a5f71391d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:56.711441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96197ef-5156-4c2a-a9a2-6a0a5f71391d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:56.712892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96197ef-5156-4c2a-a9a2-6a0a5f71391d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:56.726751 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 481/951] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:18:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:56.732001 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96197ef-5156-4c2a-a9a2-6a0a5f71391d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:56.742702 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d477ee4-365a-4f42-b1a2-fce4096ea2f6 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:56.768355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:56.783368 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaf0a1-d294-466d-a08d-d3f2e2a40028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:56.784297 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaf0a1-d294-466d-a08d-d3f2e2a40028 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:56.785633 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaf0a1-d294-466d-a08d-d3f2e2a40028 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:56.786182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaf0a1-d294-466d-a08d-d3f2e2a40028 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:56.786994 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aaf0a1-d294-466d-a08d-d3f2e2a40028 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:56.787499 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aaf0a1-d294-466d-a08d-d3f2e2a40028 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:56.789211 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aaf0a1-d294-466d-a08d-d3f2e2a40028 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:56.795279 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 471/952] 10.222.0.96 () {56 vars in 1122 bytes} [Wed Aug 24 04:18:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:56.803381 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaf0a1-d294-466d-a08d-d3f2e2a40028 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:56.849534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96197ef-5156-4c2a-a9a2-6a0a5f71391d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:56.886519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed41e6-989e-447e-855c-2091860a8382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:56.887224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed41e6-989e-447e-855c-2091860a8382 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:56.887511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed41e6-989e-447e-855c-2091860a8382 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:56.887788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed41e6-989e-447e-855c-2091860a8382 None admin] PATH_INFO: `/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/e9ffc48d1f6d49f49d00d1c2e762b987/roles/e760dc89dca8425fa560d31c5a0fec8d` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:56.890354 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed41e6-989e-447e-855c-2091860a8382 None admin] RBAC: Authorizing `identity:create_grant(project_id=d76b6cd68a7f4613a8e921781495f256, user_id=e9ffc48d1f6d49f49d00d1c2e762b987, role_id=e760dc89dca8425fa560d31c5a0fec8d)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:56.891793 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed41e6-989e-447e-855c-2091860a8382 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:56.907234 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 482/953] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:18:56 2022] PUT /identity/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/e9ffc48d1f6d49f49d00d1c2e762b987/roles/e760dc89dca8425fa560d31c5a0fec8d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:18:56.908401 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f445b90-3653-43c5-a560-0998514f7af7 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:56.908721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f445b90-3653-43c5-a560-0998514f7af7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:56.909053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f445b90-3653-43c5-a560-0998514f7af7 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:56.910945 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 483/954] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:56.913087 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaf0a1-d294-466d-a08d-d3f2e2a40028 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:56.919468 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e575b9f-371a-481b-b21c-9d0fe5083674 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:56.920051 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e575b9f-371a-481b-b21c-9d0fe5083674 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:56.920443 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e575b9f-371a-481b-b21c-9d0fe5083674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:56.947497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6e575b9f-371a-481b-b21c-9d0fe5083674 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:56.949862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6e575b9f-371a-481b-b21c-9d0fe5083674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:56.954834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:56.963676 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041fb0a-fa07-4cb6-9466-e025d4f9973f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:56.965334 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041fb0a-fa07-4cb6-9466-e025d4f9973f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:56.965866 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041fb0a-fa07-4cb6-9466-e025d4f9973f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:56.966288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041fb0a-fa07-4cb6-9466-e025d4f9973f None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:56.967583 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041fb0a-fa07-4cb6-9466-e025d4f9973f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:56.968088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041fb0a-fa07-4cb6-9466-e025d4f9973f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:56.970530 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041fb0a-fa07-4cb6-9466-e025d4f9973f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:56.984842 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 472/955] 10.222.0.96 () {56 vars in 1122 bytes} [Wed Aug 24 04:18:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:18:56.986667 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041fb0a-fa07-4cb6-9466-e025d4f9973f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:57.056490 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 484/956] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:18:57.066665 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:57.123294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041fb0a-fa07-4cb6-9466-e025d4f9973f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:57.158667 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0462f71-1663-4481-871e-a7f15845edea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:57.159280 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0462f71-1663-4481-871e-a7f15845edea None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:57.159619 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0462f71-1663-4481-871e-a7f15845edea None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:57.159932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0462f71-1663-4481-871e-a7f15845edea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:57.160644 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0462f71-1663-4481-871e-a7f15845edea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:57.162058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0462f71-1663-4481-871e-a7f15845edea None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:57.183379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 473/957] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:18:56 2022] POST /identity/v3/endpoints => generated 349 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:18:57.338047 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e575b9f-371a-481b-b21c-9d0fe5083674 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:57.448107 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e575b9f-371a-481b-b21c-9d0fe5083674 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:57.490262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845f345-1d46-44ff-baa7-7310163786d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:57.490906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845f345-1d46-44ff-baa7-7310163786d3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:57.491190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845f345-1d46-44ff-baa7-7310163786d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:57.491466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845f345-1d46-44ff-baa7-7310163786d3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:57.492053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845f345-1d46-44ff-baa7-7310163786d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:57.493495 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845f345-1d46-44ff-baa7-7310163786d3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:57.502562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-f845f345-1d46-44ff-baa7-7310163786d3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:18:57.502562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:57.502562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:18:57.502562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:18:57.502562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:18:57.502562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:18:57.502562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:18:57.502562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:57.502562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:18:57.502562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:57.502562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:18:57.502562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:57.502562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:57.502562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:57.502562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:57.502562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:57.502562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:57.504164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:57.504164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:57.504164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:57.504164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:57.504164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:57.504164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:57.504164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:18:57.504164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:18:57.504164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:18:57.504164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:18:57.504164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:57.504164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:57.504164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:57.504164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:57.504164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:57.504164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:57.505050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:57.505050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:57.505050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:57.505050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:57.505050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:57.505050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:57.505050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:57.505050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:57.505050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:57.505050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:57.505050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:18:57.505050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:57.505050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:18:57.505050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:57.505050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:57.506597 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 485/958] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:18:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:57.511707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0462f71-1663-4481-871e-a7f15845edea None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:57.620623 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0462f71-1663-4481-871e-a7f15845edea None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:57.627940 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:57.657969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202528dd-bd9f-4008-af28-53efc346c77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:57.658594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202528dd-bd9f-4008-af28-53efc346c77d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:57.658875 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202528dd-bd9f-4008-af28-53efc346c77d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:57.659152 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202528dd-bd9f-4008-af28-53efc346c77d None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:57.659830 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202528dd-bd9f-4008-af28-53efc346c77d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:57.660145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202528dd-bd9f-4008-af28-53efc346c77d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:57.661548 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202528dd-bd9f-4008-af28-53efc346c77d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:57.667265 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 474/959] 10.222.0.96 () {56 vars in 1112 bytes} [Wed Aug 24 04:18:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:57.674147 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845f345-1d46-44ff-baa7-7310163786d3 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:57.789485 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845f345-1d46-44ff-baa7-7310163786d3 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:57.828763 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52f7d6-2782-4f66-a06d-1fd7eaa57ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:57.829371 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52f7d6-2782-4f66-a06d-1fd7eaa57ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:57.829654 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52f7d6-2782-4f66-a06d-1fd7eaa57ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:57.829929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52f7d6-2782-4f66-a06d-1fd7eaa57ba2 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:57.830573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52f7d6-2782-4f66-a06d-1fd7eaa57ba2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:57.830880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52f7d6-2782-4f66-a06d-1fd7eaa57ba2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:57.832318 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52f7d6-2782-4f66-a06d-1fd7eaa57ba2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:57.837866 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 486/960] 10.222.0.96 () {56 vars in 1112 bytes} [Wed Aug 24 04:18:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:57.925268 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8eb19-18eb-4a1c-87cf-994b084fb65f None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:57.925946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8eb19-18eb-4a1c-87cf-994b084fb65f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:57.926461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8eb19-18eb-4a1c-87cf-994b084fb65f None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:57.928040 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 475/961] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:57.934445 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aae362-5901-4cfb-a5fb-035ee50b2503 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:57.935048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aae362-5901-4cfb-a5fb-035ee50b2503 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:57.935530 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aae362-5901-4cfb-a5fb-035ee50b2503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:57.958148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-98aae362-5901-4cfb-a5fb-035ee50b2503 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:57.959871 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-98aae362-5901-4cfb-a5fb-035ee50b2503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:58.029678 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:58.039646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 487/962] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:18:58.314346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8eb19-18eb-4a1c-87cf-994b084fb65f None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:58.424472 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8eb19-18eb-4a1c-87cf-994b084fb65f None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:58.460167 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb572743-0a3f-43d8-8664-f25d9ace946e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:58.460805 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb572743-0a3f-43d8-8664-f25d9ace946e None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:58.461093 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb572743-0a3f-43d8-8664-f25d9ace946e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:58.461368 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb572743-0a3f-43d8-8664-f25d9ace946e None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:58.462017 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb572743-0a3f-43d8-8664-f25d9ace946e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:58.463445 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb572743-0a3f-43d8-8664-f25d9ace946e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:58.465984 dv-cinder-854263-1-smb devstack@keystone.service[81516]: WARNING keystone.server.flask.common [None req-eb572743-0a3f-43d8-8664-f25d9ace946e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 04:18:58.478791 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.sql.core [None req-eb572743-0a3f-43d8-8664-f25d9ace946e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 04:18:58.478791 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 04:18:58.478791 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [parameters: {'user_id': '30b68f3b7e0740069ac47ba73552db51', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 04:18:58.478791 dv-cinder-854263-1-smb devstack@keystone.service[81516]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81516) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 04:18:58.496165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-eb572743-0a3f-43d8-8664-f25d9ace946e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 04:18:58.496165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:58.496165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:18:58.496165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:18:58.496165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:18:58.496165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:18:58.496165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:18:58.496165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:18:58.496165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:18:58.496165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:18:58.496165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:18:58.496165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:18:58.496165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:18:58.496165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application result.read() Aug 24 04:18:58.496165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:18:58.497133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:18:58.497133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:18:58.497133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:18:58.497133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:18:58.497133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:18:58.497133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:18:58.497133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:18:58.497133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 04:18:58.497133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:58.497133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 04:18:58.497133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:58.497133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:58.497133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 04:18:58.497133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 04:18:58.497133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 04:18:58.497133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 04:18:58.497133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:18:58.497133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:18:58.498369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 04:18:58.498369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application yield resource Aug 24 04:18:58.498369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:18:58.498369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:18:58.498369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 04:18:58.498369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 04:18:58.498369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 04:18:58.498369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 04:18:58.498369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 04:18:58.498369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise self.value Aug 24 04:18:58.498369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 04:18:58.498369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 04:18:58.498369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 04:18:58.498369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application session.commit() Aug 24 04:18:58.498369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 04:18:58.498369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 04:18:58.498369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 04:18:58.499290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 04:18:58.499290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 04:18:58.499290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self.session.flush() Aug 24 04:18:58.499290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 04:18:58.499290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 04:18:58.499290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 04:18:58.499290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 04:18:58.499290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 04:18:58.499290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application compat.raise_( Aug 24 04:18:58.499290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:18:58.499290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception Aug 24 04:18:58.499290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 04:18:58.499290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 04:18:58.499290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 04:18:58.499290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 04:18:58.499290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 04:18:58.499290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 04:18:58.500190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 04:18:58.500190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 04:18:58.500190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 04:18:58.500190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 04:18:58.500190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 04:18:58.500190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 04:18:58.500190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 04:18:58.500190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 04:18:58.500190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 04:18:58.500190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 04:18:58.500190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 04:18:58.500190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 04:18:58.500190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 04:18:58.500190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 04:18:58.500190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:18:58.500190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception Aug 24 04:18:58.501094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:18:58.501094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:18:58.501094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:18:58.501094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:18:58.501094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:18:58.501094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:18:58.501094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:18:58.501094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:18:58.501094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:18:58.501094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:18:58.501094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:18:58.501094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application result.read() Aug 24 04:18:58.501094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:18:58.501094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:18:58.501094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:18:58.501094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:18:58.502874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:18:58.502874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:18:58.502874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:18:58.502874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:18:58.502874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 04:18:58.502874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 04:18:58.502874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [parameters: {'user_id': '30b68f3b7e0740069ac47ba73552db51', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 04:18:58.502874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 04:18:58.502874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:58.502874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:18:58.502874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:58.502874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:58.502874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:58.502874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:58.502874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:58.505618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:58.505618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:58.505618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:58.505618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:58.505618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:58.505618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:58.505618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:58.505618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 04:18:58.505618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 04:18:58.505618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:58.505618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:58.505618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:58.505618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:58.505618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:58.505618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:58.505618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 04:18:58.505618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 04:18:58.508818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 04:18:58.508818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 04:18:58.508818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 04:18:58.508818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 04:18:58.508818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 04:18:58.508818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:58.508818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 476/963] 10.222.0.96 () {60 vars in 1131 bytes} [Wed Aug 24 04:18:58 2022] POST /identity/v3/users => generated 160 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:58.516761 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aae362-5901-4cfb-a5fb-035ee50b2503 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:58.622446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aae362-5901-4cfb-a5fb-035ee50b2503 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:58.661743 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5cf8e-9a1c-4e28-8914-4cf7b2b18246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:58.662734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5cf8e-9a1c-4e28-8914-4cf7b2b18246 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:58.663281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5cf8e-9a1c-4e28-8914-4cf7b2b18246 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:58.663763 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5cf8e-9a1c-4e28-8914-4cf7b2b18246 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:58.671377 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5cf8e-9a1c-4e28-8914-4cf7b2b18246 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:58.673048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5cf8e-9a1c-4e28-8914-4cf7b2b18246 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:58.685475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-20f5cf8e-9a1c-4e28-8914-4cf7b2b18246 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:18:58.685475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:58.685475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:58.685475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:58.685475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:58.685475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:58.685475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:58.685475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:58.685475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:58.685475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:58.685475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:58.685475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:58.685475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:18:58.685475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:18:58.685475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:18:58.685475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:18:58.686451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:58.686451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:58.686451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:18:58.686451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:58.686451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:18:58.686451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:18:58.686451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:58.686451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:58.686451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:58.686451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:58.686451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:58.686451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:58.686451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:58.686451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:58.686451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:58.686451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:58.686451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:58.686451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:58.687398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:58.687398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:58.687398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:18:58.687398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:18:58.687398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:18:58.687398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:18:58.687398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:18:58.687398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:18:58.687398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:18:58.687398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:58.694386 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 488/964] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:18:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:58.697408 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb572743-0a3f-43d8-8664-f25d9ace946e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:58.734298 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:58.810277 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb572743-0a3f-43d8-8664-f25d9ace946e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:58.847869 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdf4ef-a35e-4ba5-8d3c-54c2dc77fbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:58.848938 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdf4ef-a35e-4ba5-8d3c-54c2dc77fbaf None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:58.849390 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdf4ef-a35e-4ba5-8d3c-54c2dc77fbaf None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:58.849805 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdf4ef-a35e-4ba5-8d3c-54c2dc77fbaf None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:58.850649 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efdf4ef-a35e-4ba5-8d3c-54c2dc77fbaf None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:58.851095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efdf4ef-a35e-4ba5-8d3c-54c2dc77fbaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:58.852901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efdf4ef-a35e-4ba5-8d3c-54c2dc77fbaf None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:58.902846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 477/965] 10.222.0.96 () {56 vars in 1101 bytes} [Wed Aug 24 04:18:58 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:58.942516 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be437e-b5ae-4ffb-b4d3-20659aecdf2b None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:58.942802 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be437e-b5ae-4ffb-b4d3-20659aecdf2b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:58.943090 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be437e-b5ae-4ffb-b4d3-20659aecdf2b None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:58.944858 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 489/966] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:58.951573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca087c1-7ac4-4f14-b568-52f8c9269e96 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:58.951860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca087c1-7ac4-4f14-b568-52f8c9269e96 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:58.952138 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca087c1-7ac4-4f14-b568-52f8c9269e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:58.973700 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9ca087c1-7ac4-4f14-b568-52f8c9269e96 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:58.975316 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9ca087c1-7ac4-4f14-b568-52f8c9269e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:59.052427 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 478/967] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:18:59.248217 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fbc3e-60a2-4fbf-afd4-e40a8f14bfa7 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:59.248422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fbc3e-60a2-4fbf-afd4-e40a8f14bfa7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:59.248720 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fbc3e-60a2-4fbf-afd4-e40a8f14bfa7 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:59.250079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 490/968] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:59.255933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e827df-6c3b-4666-8bf2-f7f5a62b6173 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:59.256234 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e827df-6c3b-4666-8bf2-f7f5a62b6173 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:59.256517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e827df-6c3b-4666-8bf2-f7f5a62b6173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:59.275161 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-27e827df-6c3b-4666-8bf2-f7f5a62b6173 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:59.276362 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-27e827df-6c3b-4666-8bf2-f7f5a62b6173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:59.290790 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:59.326198 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fbc3e-60a2-4fbf-afd4-e40a8f14bfa7 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:59.346083 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 479/969] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:18:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:18:59.384321 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:59.431753 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fbc3e-60a2-4fbf-afd4-e40a8f14bfa7 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:59.471659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aaf799-685a-4604-a31d-7da80828baf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:59.472395 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aaf799-685a-4604-a31d-7da80828baf7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:59.472618 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aaf799-685a-4604-a31d-7da80828baf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:59.473008 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aaf799-685a-4604-a31d-7da80828baf7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:59.483475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aaf799-685a-4604-a31d-7da80828baf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:18:59.488307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-b9aaf799-685a-4604-a31d-7da80828baf7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:18:59.488307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:59.488307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:59.488307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:59.488307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:59.488307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:59.488307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:59.488307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:59.488307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:59.488307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:59.488307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:59.488307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:59.488307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:18:59.488307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:18:59.488307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:18:59.488307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:18:59.489279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:18:59.489279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:18:59.489279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:18:59.489279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:18:59.489279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:59.489279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:59.489279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:59.489279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:59.489279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:59.489279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:59.489279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:59.489279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:59.489279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:59.489279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:59.489279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:59.489279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:59.490180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:59.490180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:59.490180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:59.490180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:59.490180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:18:59.490180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:18:59.490180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:18:59.490180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:18:59.490180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:18:59.490180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:18:59.490180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:18:59.490180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:59.493010 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 491/970] 10.222.0.96 () {56 vars in 1120 bytes} [Wed Aug 24 04:18:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:18:59.495250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e827df-6c3b-4666-8bf2-f7f5a62b6173 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:59.603486 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e827df-6c3b-4666-8bf2-f7f5a62b6173 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:59.618580 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aaf799-685a-4604-a31d-7da80828baf7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:59.639661 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1100bb-f441-4a7a-a52c-4f53cb037744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:59.640284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1100bb-f441-4a7a-a52c-4f53cb037744 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:59.640573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1100bb-f441-4a7a-a52c-4f53cb037744 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:59.640896 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1100bb-f441-4a7a-a52c-4f53cb037744 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:59.641572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1100bb-f441-4a7a-a52c-4f53cb037744 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:59.641884 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1100bb-f441-4a7a-a52c-4f53cb037744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:59.643463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1100bb-f441-4a7a-a52c-4f53cb037744 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:59.657422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 480/971] 10.222.0.96 () {56 vars in 1115 bytes} [Wed Aug 24 04:18:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:59.658432 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1100bb-f441-4a7a-a52c-4f53cb037744 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:59.677791 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:59.731292 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aaf799-685a-4604-a31d-7da80828baf7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:59.749138 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:59.771364 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da375b-7b83-4ba5-9306-b426636605b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:59.772111 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da375b-7b83-4ba5-9306-b426636605b7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:59.772395 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da375b-7b83-4ba5-9306-b426636605b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:59.772712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da375b-7b83-4ba5-9306-b426636605b7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:59.773381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da375b-7b83-4ba5-9306-b426636605b7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:59.774746 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da375b-7b83-4ba5-9306-b426636605b7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:59.778626 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1100bb-f441-4a7a-a52c-4f53cb037744 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:59.784466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-a7da375b-7b83-4ba5-9306-b426636605b7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:18:59.784466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:59.784466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:18:59.784466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:18:59.784466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:18:59.784466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:18:59.784466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:18:59.784466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:59.784466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:18:59.784466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:59.784466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:18:59.784466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:59.784466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:59.784466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:59.784466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:59.784466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:59.784466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:59.786061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:59.786061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:59.786061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:59.786061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:59.786061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:59.786061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:59.786061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:18:59.786061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:18:59.786061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:18:59.786061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:18:59.786061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:59.786061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:59.786061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:59.786061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:59.786061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:59.786061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:59.787105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:59.787105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:59.787105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:59.787105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:59.787105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:59.787105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:59.787105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:59.787105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:59.787105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:59.787105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:59.787105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:18:59.787105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:18:59.787105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:18:59.787105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:18:59.789356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 492/972] 10.222.0.96 () {56 vars in 1126 bytes} [Wed Aug 24 04:18:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:18:59.795094 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da375b-7b83-4ba5-9306-b426636605b7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:59.819010 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89def244-0385-4f6a-9c9b-dbe8d48b267b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:59.819941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89def244-0385-4f6a-9c9b-dbe8d48b267b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:59.820227 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89def244-0385-4f6a-9c9b-dbe8d48b267b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:59.820510 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89def244-0385-4f6a-9c9b-dbe8d48b267b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:59.842585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89def244-0385-4f6a-9c9b-dbe8d48b267b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:59.844164 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89def244-0385-4f6a-9c9b-dbe8d48b267b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:59.860004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-89def244-0385-4f6a-9c9b-dbe8d48b267b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:59.860004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:18:59.860004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:18:59.860004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:18:59.860004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:18:59.860004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:18:59.860004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:18:59.860004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:18:59.860004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:18:59.860004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:18:59.860004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:18:59.860004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:18:59.860004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:18:59.860004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:18:59.860004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:18:59.860004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:18:59.861143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:18:59.861143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:18:59.861143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:18:59.861143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:18:59.861143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:18:59.861143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:18:59.861143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:18:59.861143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:18:59.861143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:18:59.861143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:18:59.861143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:18:59.861143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:18:59.861143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:18:59.861143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:18:59.861143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:18:59.861143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:18:59.861143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:18:59.862069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:18:59.862069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:18:59.862069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:18:59.862069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 481/973] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:18:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:18:59.867402 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89def244-0385-4f6a-9c9b-dbe8d48b267b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:59.904329 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da375b-7b83-4ba5-9306-b426636605b7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:59.935504 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:59.940012 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eec4c4-172b-40fd-98f2-a35c5bba474a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:59.940732 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eec4c4-172b-40fd-98f2-a35c5bba474a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:59.941074 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eec4c4-172b-40fd-98f2-a35c5bba474a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:59.941865 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eec4c4-172b-40fd-98f2-a35c5bba474a None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:59.942503 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eec4c4-172b-40fd-98f2-a35c5bba474a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:18:59.942812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eec4c4-172b-40fd-98f2-a35c5bba474a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:59.944278 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eec4c4-172b-40fd-98f2-a35c5bba474a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:59.949880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 493/974] 10.222.0.96 () {56 vars in 1122 bytes} [Wed Aug 24 04:18:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:18:59.951135 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9b463-3345-4a4b-b3fb-515774c9fa69 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:59.951430 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9b463-3345-4a4b-b3fb-515774c9fa69 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:59.951710 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9b463-3345-4a4b-b3fb-515774c9fa69 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:59.952953 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 494/975] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:18:59.957993 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9b463-3345-4a4b-b3fb-515774c9fa69 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:59.979893 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89def244-0385-4f6a-9c9b-dbe8d48b267b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:00.006861 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:00.017607 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d965087-d0bf-4997-a521-d3c29c8988e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:00.018314 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d965087-d0bf-4997-a521-d3c29c8988e8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:00.018495 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d965087-d0bf-4997-a521-d3c29c8988e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:00.018768 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d965087-d0bf-4997-a521-d3c29c8988e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:00.019467 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d965087-d0bf-4997-a521-d3c29c8988e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:00.019769 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d965087-d0bf-4997-a521-d3c29c8988e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:00.021313 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d965087-d0bf-4997-a521-d3c29c8988e8 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:00.033053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 482/976] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:00.034358 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea196448-0f41-4eef-9db2-d7441c6fcbc3 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:00.034646 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea196448-0f41-4eef-9db2-d7441c6fcbc3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:00.035532 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea196448-0f41-4eef-9db2-d7441c6fcbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:00.053041 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ea196448-0f41-4eef-9db2-d7441c6fcbc3 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:00.054220 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ea196448-0f41-4eef-9db2-d7441c6fcbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:00.071278 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9b463-3345-4a4b-b3fb-515774c9fa69 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:00.105807 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336d1ac-2479-4b73-b2cb-f8042f6ec563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:00.106470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336d1ac-2479-4b73-b2cb-f8042f6ec563 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:00.106746 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336d1ac-2479-4b73-b2cb-f8042f6ec563 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:00.107021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336d1ac-2479-4b73-b2cb-f8042f6ec563 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:00.107696 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336d1ac-2479-4b73-b2cb-f8042f6ec563 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:00.108481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336d1ac-2479-4b73-b2cb-f8042f6ec563 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:00.109906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336d1ac-2479-4b73-b2cb-f8042f6ec563 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:00.117398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 495/977] 10.222.0.96 () {56 vars in 1122 bytes} [Wed Aug 24 04:18:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:00.118919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336d1ac-2479-4b73-b2cb-f8042f6ec563 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:00.126684 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 483/978] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:19:00.127740 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea196448-0f41-4eef-9db2-d7441c6fcbc3 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:00.187079 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:00.237075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea196448-0f41-4eef-9db2-d7441c6fcbc3 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:00.260897 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336d1ac-2479-4b73-b2cb-f8042f6ec563 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:00.269534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:00.274380 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e81f6a-2ba4-4c07-a990-ee46e251bce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:00.275012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e81f6a-2ba4-4c07-a990-ee46e251bce4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:00.275300 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e81f6a-2ba4-4c07-a990-ee46e251bce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:00.275581 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e81f6a-2ba4-4c07-a990-ee46e251bce4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:00.276309 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e81f6a-2ba4-4c07-a990-ee46e251bce4 None admin] RBAC: Adding query filter params (interface=admin, service_id=62028c0a24534856aa9a492ee0a07482, region_id=RegionOne) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:00.276628 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e81f6a-2ba4-4c07-a990-ee46e251bce4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:00.278040 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e81f6a-2ba4-4c07-a990-ee46e251bce4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:00.283548 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 484/979] 10.222.0.96 () {56 vars in 1249 bytes} [Wed Aug 24 04:19:00 2022] GET /identity/v3/endpoints?service_id=62028c0a24534856aa9a492ee0a07482&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:00.289733 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e81f6a-2ba4-4c07-a990-ee46e251bce4 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:00.302420 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c0603-52be-44e3-9731-643b749a3dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:00.303251 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c0603-52be-44e3-9731-643b749a3dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:00.303718 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c0603-52be-44e3-9731-643b749a3dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:00.303999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c0603-52be-44e3-9731-643b749a3dd5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:00.311269 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c0603-52be-44e3-9731-643b749a3dd5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:00.312721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c0603-52be-44e3-9731-643b749a3dd5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:00.324627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-644c0603-52be-44e3-9731-643b749a3dd5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:19:00.324627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:00.324627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:00.324627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:00.324627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:00.324627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:00.324627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:00.324627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:00.324627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:00.324627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:00.324627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:00.324627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:00.324627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:19:00.324627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:19:00.324627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:19:00.324627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:19:00.325706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:00.325706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:00.325706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:19:00.325706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:19:00.325706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:19:00.325706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:19:00.325706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:00.325706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:00.325706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:00.325706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:00.325706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:00.325706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:00.325706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:00.325706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:00.325706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:00.325706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:00.325706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:00.325706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:00.326659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:00.326659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:00.326659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:19:00.326659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:19:00.326659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:19:00.326659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:19:00.326659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:19:00.326659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:19:00.326659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:19:00.326659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:00.326659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 496/980] 10.222.0.96 () {56 vars in 1117 bytes} [Wed Aug 24 04:19:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:19:00.331289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c0603-52be-44e3-9731-643b749a3dd5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:00.406144 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e81f6a-2ba4-4c07-a990-ee46e251bce4 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:00.424588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:00.442378 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48a2a0-5b73-47ff-9493-b2566361c0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:00.442992 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48a2a0-5b73-47ff-9493-b2566361c0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:00.443278 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48a2a0-5b73-47ff-9493-b2566361c0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:00.443558 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48a2a0-5b73-47ff-9493-b2566361c0c0 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:00.444173 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48a2a0-5b73-47ff-9493-b2566361c0c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:00.445588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48a2a0-5b73-47ff-9493-b2566361c0c0 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:00.445734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c0603-52be-44e3-9731-643b749a3dd5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:00.451820 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 485/981] 10.222.0.96 () {56 vars in 1087 bytes} [Wed Aug 24 04:19:00 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:19:00.452597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48a2a0-5b73-47ff-9493-b2566361c0c0 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:00.486837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af5f78-25de-4672-a93c-130951113927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:00.487580 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af5f78-25de-4672-a93c-130951113927 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:00.487911 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af5f78-25de-4672-a93c-130951113927 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:00.488247 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af5f78-25de-4672-a93c-130951113927 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:00.489073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af5f78-25de-4672-a93c-130951113927 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:00.489387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af5f78-25de-4672-a93c-130951113927 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:00.490964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af5f78-25de-4672-a93c-130951113927 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:00.511709 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 497/982] 10.222.0.96 () {56 vars in 1149 bytes} [Wed Aug 24 04:19:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:00.517954 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af5f78-25de-4672-a93c-130951113927 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:00.550768 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:00.567213 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48a2a0-5b73-47ff-9493-b2566361c0c0 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:00.609944 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44aa7e-859f-4553-a3d7-8fc4768a74aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:00.610690 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44aa7e-859f-4553-a3d7-8fc4768a74aa None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:00.610988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44aa7e-859f-4553-a3d7-8fc4768a74aa None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:00.611260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44aa7e-859f-4553-a3d7-8fc4768a74aa None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:00.611923 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44aa7e-859f-4553-a3d7-8fc4768a74aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:00.613619 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44aa7e-859f-4553-a3d7-8fc4768a74aa None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:00.632047 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 486/983] 10.222.0.96 () {60 vars in 1141 bytes} [Wed Aug 24 04:19:00 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:19:00.634393 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af5f78-25de-4672-a93c-130951113927 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:00.683001 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bbc6a9-23ca-410b-9359-25a2c262ef7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:00.683560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbc6a9-23ca-410b-9359-25a2c262ef7e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:00.683889 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbc6a9-23ca-410b-9359-25a2c262ef7e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:00.684196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbc6a9-23ca-410b-9359-25a2c262ef7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:00.765922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bbc6a9-23ca-410b-9359-25a2c262ef7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:00.767426 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bbc6a9-23ca-410b-9359-25a2c262ef7e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:00.793760 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:00.885616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 498/984] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:19:00 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 04:19:00.891399 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44aa7e-859f-4553-a3d7-8fc4768a74aa None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:00.944073 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:01.009760 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44aa7e-859f-4553-a3d7-8fc4768a74aa None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:01.045675 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c05696-403a-4e73-80f1-55faa1258b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:01.046329 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c05696-403a-4e73-80f1-55faa1258b84 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:01.046613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c05696-403a-4e73-80f1-55faa1258b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:01.046941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c05696-403a-4e73-80f1-55faa1258b84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:01.058685 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c05696-403a-4e73-80f1-55faa1258b84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:01.060149 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c05696-403a-4e73-80f1-55faa1258b84 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:01.075469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-03c05696-403a-4e73-80f1-55faa1258b84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:19:01.075469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:01.075469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:01.075469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:01.075469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:01.075469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:01.075469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:01.075469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:01.075469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:01.075469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:01.075469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:01.075469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:01.075469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:19:01.075469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:19:01.075469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:19:01.075469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:19:01.076485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:01.076485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:01.076485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:01.076485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:01.076485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:01.076485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:01.076485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:01.076485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:01.076485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:01.076485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:01.076485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:01.076485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:01.076485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:01.076485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:01.076485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:01.076485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:01.076485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:19:01.083081 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:19:01.083081 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:19:01.083081 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:19:01.083081 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 487/985] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:19:01.083311 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bbc6a9-23ca-410b-9359-25a2c262ef7e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:01.186850 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bbc6a9-23ca-410b-9359-25a2c262ef7e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:01.208657 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:01.227623 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e48a15-a9aa-4d76-9c95-80645786eef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:01.228253 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e48a15-a9aa-4d76-9c95-80645786eef0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:01.228525 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e48a15-a9aa-4d76-9c95-80645786eef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:01.228834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e48a15-a9aa-4d76-9c95-80645786eef0 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:01.229486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e48a15-a9aa-4d76-9c95-80645786eef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:01.229792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e48a15-a9aa-4d76-9c95-80645786eef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:01.231229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e48a15-a9aa-4d76-9c95-80645786eef0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:01.247596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 499/986] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:01.248901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c05696-403a-4e73-80f1-55faa1258b84 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:01.355649 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:01.364652 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c05696-403a-4e73-80f1-55faa1258b84 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:01.407684 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55252ea-38e4-4db8-8456-dce78e19910a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:01.408316 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55252ea-38e4-4db8-8456-dce78e19910a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:01.408627 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55252ea-38e4-4db8-8456-dce78e19910a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:01.408941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55252ea-38e4-4db8-8456-dce78e19910a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:01.416883 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55252ea-38e4-4db8-8456-dce78e19910a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:01.418337 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55252ea-38e4-4db8-8456-dce78e19910a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:01.429950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-d55252ea-38e4-4db8-8456-dce78e19910a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:19:01.429950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:01.429950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:01.429950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:01.429950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:01.429950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:01.429950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:01.429950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:01.429950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:01.429950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:01.429950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:01.429950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:01.429950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:19:01.429950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:19:01.429950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:19:01.431305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:19:01.431305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:01.431305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:01.431305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:01.431305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:01.431305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:01.431305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:01.431305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:01.431305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:01.431305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:01.431305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:01.431305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:01.431305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:01.431305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:01.431305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:01.431305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:01.431305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:01.432656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:19:01.432656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:19:01.432656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:19:01.432656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:19:01.432656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:19:01.432656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:19:01.432656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:19:01.432656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:19:01.434282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 488/987] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:19:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:19:01.437233 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e48a15-a9aa-4d76-9c95-80645786eef0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:01.550112 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e48a15-a9aa-4d76-9c95-80645786eef0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:01.587742 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2a654-363f-47d2-b59b-34af296971de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:01.588357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2a654-363f-47d2-b59b-34af296971de None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:01.588639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2a654-363f-47d2-b59b-34af296971de None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:01.588959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2a654-363f-47d2-b59b-34af296971de None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:01.589998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2a654-363f-47d2-b59b-34af296971de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:01.589998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2a654-363f-47d2-b59b-34af296971de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:01.591390 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2a654-363f-47d2-b59b-34af296971de None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:01.609910 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 500/988] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:19:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:01.611444 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55252ea-38e4-4db8-8456-dce78e19910a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:01.721113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55252ea-38e4-4db8-8456-dce78e19910a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:01.756357 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cddb51-c19f-4034-8067-301f708c7c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:01.757002 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cddb51-c19f-4034-8067-301f708c7c37 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:01.757285 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cddb51-c19f-4034-8067-301f708c7c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:01.757559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cddb51-c19f-4034-8067-301f708c7c37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:01.758302 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cddb51-c19f-4034-8067-301f708c7c37 None admin] RBAC: Adding query filter params (role.id=e760dc89dca8425fa560d31c5a0fec8d, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=e9ffc48d1f6d49f49d00d1c2e762b987) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:01.758615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cddb51-c19f-4034-8067-301f708c7c37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:01.760060 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cddb51-c19f-4034-8067-301f708c7c37 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:01.772722 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 489/989] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:19:01 2022] GET /identity/v3/role_assignments?user.id=e9ffc48d1f6d49f49d00d1c2e762b987&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=e760dc89dca8425fa560d31c5a0fec8d => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:02.410886 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f898e66-8686-4242-a5d2-ab51e4427470 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:02.411413 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f898e66-8686-4242-a5d2-ab51e4427470 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:02.411413 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f898e66-8686-4242-a5d2-ab51e4427470 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:02.413096 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 501/990] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:02.418359 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21f517-39ed-4bd4-9919-d59383c91ed7 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:02.418801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21f517-39ed-4bd4-9919-d59383c91ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:02.418972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21f517-39ed-4bd4-9919-d59383c91ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:02.439985 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-5d21f517-39ed-4bd4-9919-d59383c91ed7 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:02.441436 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5d21f517-39ed-4bd4-9919-d59383c91ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:02.457065 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:02.520755 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 490/991] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:19:02.575772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158ab60-3833-4dc6-9269-ec74c36ab05d None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:02.576079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158ab60-3833-4dc6-9269-ec74c36ab05d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:02.576333 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158ab60-3833-4dc6-9269-ec74c36ab05d None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:02.577827 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 502/992] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:02.583282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f786752-10c6-4fa9-9108-684403c080ef None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:02.583572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f786752-10c6-4fa9-9108-684403c080ef None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:02.583851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f786752-10c6-4fa9-9108-684403c080ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:02.602917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-5f786752-10c6-4fa9-9108-684403c080ef None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:02.604110 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5f786752-10c6-4fa9-9108-684403c080ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:02.684861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 491/993] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:19:02.800218 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158ab60-3833-4dc6-9269-ec74c36ab05d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:02.849698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:02.914228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158ab60-3833-4dc6-9269-ec74c36ab05d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:02.949642 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bc857-5a89-427e-9327-86215f01d83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:02.954081 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bc857-5a89-427e-9327-86215f01d83d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:02.954377 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bc857-5a89-427e-9327-86215f01d83d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:02.954662 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bc857-5a89-427e-9327-86215f01d83d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:02.955280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951bc857-5a89-427e-9327-86215f01d83d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:02.957199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951bc857-5a89-427e-9327-86215f01d83d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:02.959475 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f786752-10c6-4fa9-9108-684403c080ef None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:02.968568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-951bc857-5a89-427e-9327-86215f01d83d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:19:02.968568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:02.968568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:19:02.968568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:19:02.968568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:19:02.968568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:19:02.968568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:19:02.968568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:19:02.968568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:19:02.968568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:02.968568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:19:02.968568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:02.968568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:02.968568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:02.968568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:02.968568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:02.968568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:02.969755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:02.969755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:02.969755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:02.969755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:02.969755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:02.969755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:02.969755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:19:02.969755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:19:02.969755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:19:02.969755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:19:02.969755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:02.969755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:02.969755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:02.969755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:02.969755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:02.969755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:02.970635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:02.970635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:02.970635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:02.970635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:02.970635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:02.970635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:02.970635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:02.970635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:02.970635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:02.970635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:02.970635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:19:02.970635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:19:02.970635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:19:02.970635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:02.973246 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 503/994] 10.222.0.96 () {56 vars in 1126 bytes} [Wed Aug 24 04:19:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:19:02.976726 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bc857-5a89-427e-9327-86215f01d83d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:03.043613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:03.068936 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f786752-10c6-4fa9-9108-684403c080ef None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:03.088936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bc857-5a89-427e-9327-86215f01d83d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:03.091323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:03.113897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63094638-3d5e-42c9-9340-59996f655120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:03.114788 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63094638-3d5e-42c9-9340-59996f655120 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:03.115074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63094638-3d5e-42c9-9340-59996f655120 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:03.115362 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63094638-3d5e-42c9-9340-59996f655120 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:03.115964 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63094638-3d5e-42c9-9340-59996f655120 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:03.117380 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63094638-3d5e-42c9-9340-59996f655120 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:03.126456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-63094638-3d5e-42c9-9340-59996f655120 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:19:03.126456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:03.126456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:19:03.126456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:19:03.126456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:19:03.126456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:19:03.126456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:19:03.126456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:19:03.126456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:19:03.126456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:19:03.126456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:19:03.126456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:19:03.126456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:03.126456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:03.126456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:03.126456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:03.126456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:03.127618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:03.127618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:03.127618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:03.127618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:03.127618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:03.127618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:03.127618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:19:03.127618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:19:03.127618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:19:03.127618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:19:03.127618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:03.127618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:03.127618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:03.127618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:03.127618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:03.127618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:03.129468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:03.129468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:03.129468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:03.129468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:03.129468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:03.129468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:03.129468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:03.129468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:03.129468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:03.129468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:03.129468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:19:03.129468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:19:03.129468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:19:03.129468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:19:03.129468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 492/995] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:19:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:19:03.131102 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc7d68-2460-434e-b372-f2f38e220efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:03.131718 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc7d68-2460-434e-b372-f2f38e220efc None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:03.131998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc7d68-2460-434e-b372-f2f38e220efc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:03.132269 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc7d68-2460-434e-b372-f2f38e220efc None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:03.132945 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc7d68-2460-434e-b372-f2f38e220efc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:03.133255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc7d68-2460-434e-b372-f2f38e220efc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:03.134696 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc7d68-2460-434e-b372-f2f38e220efc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:03.137876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63094638-3d5e-42c9-9340-59996f655120 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:03.140726 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 504/996] 10.222.0.96 () {56 vars in 1122 bytes} [Wed Aug 24 04:19:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:03.146370 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc7d68-2460-434e-b372-f2f38e220efc None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:03.256259 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc7d68-2460-434e-b372-f2f38e220efc None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:03.266058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63094638-3d5e-42c9-9340-59996f655120 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:03.293727 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe77a8a-ab63-4df8-824c-c861892b6f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:03.294341 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe77a8a-ab63-4df8-824c-c861892b6f57 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:03.294625 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe77a8a-ab63-4df8-824c-c861892b6f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:03.294898 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe77a8a-ab63-4df8-824c-c861892b6f57 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:03.295525 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe77a8a-ab63-4df8-824c-c861892b6f57 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:03.295826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe77a8a-ab63-4df8-824c-c861892b6f57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:03.297222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe77a8a-ab63-4df8-824c-c861892b6f57 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:03.302616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 505/997] 10.222.0.96 () {56 vars in 1122 bytes} [Wed Aug 24 04:19:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:03.308406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe77a8a-ab63-4df8-824c-c861892b6f57 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:03.309047 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826765b-c7c1-4cc0-9d06-f0edb01ad162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:03.309742 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826765b-c7c1-4cc0-9d06-f0edb01ad162 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:03.310094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826765b-c7c1-4cc0-9d06-f0edb01ad162 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:03.310440 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826765b-c7c1-4cc0-9d06-f0edb01ad162 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:03.311154 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826765b-c7c1-4cc0-9d06-f0edb01ad162 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:03.311527 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826765b-c7c1-4cc0-9d06-f0edb01ad162 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:03.313003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826765b-c7c1-4cc0-9d06-f0edb01ad162 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:03.323519 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 493/998] 10.222.0.96 () {56 vars in 1112 bytes} [Wed Aug 24 04:19:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:03.330130 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826765b-c7c1-4cc0-9d06-f0edb01ad162 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:03.342158 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:03.349008 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:03.435058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe77a8a-ab63-4df8-824c-c861892b6f57 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:03.443471 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826765b-c7c1-4cc0-9d06-f0edb01ad162 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:03.472553 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a0ee7-c524-4076-97fe-a0f97cf16719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:03.473199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a0ee7-c524-4076-97fe-a0f97cf16719 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:03.473526 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a0ee7-c524-4076-97fe-a0f97cf16719 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:03.473850 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a0ee7-c524-4076-97fe-a0f97cf16719 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:03.474454 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a0ee7-c524-4076-97fe-a0f97cf16719 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:03.475817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a0ee7-c524-4076-97fe-a0f97cf16719 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:03.479535 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b5226-19f1-48ba-9e98-13fa60b3fcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:03.480151 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b5226-19f1-48ba-9e98-13fa60b3fcf7 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:03.480443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b5226-19f1-48ba-9e98-13fa60b3fcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:03.480738 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b5226-19f1-48ba-9e98-13fa60b3fcf7 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:03.481380 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b5226-19f1-48ba-9e98-13fa60b3fcf7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:03.481688 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b5226-19f1-48ba-9e98-13fa60b3fcf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:03.483094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b5226-19f1-48ba-9e98-13fa60b3fcf7 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:03.489312 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 494/999] 10.222.0.96 () {56 vars in 1112 bytes} [Wed Aug 24 04:19:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:03.496723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b5226-19f1-48ba-9e98-13fa60b3fcf7 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:03.507851 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 506/1000] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:19:03 2022] POST /identity/v3/endpoints => generated 325 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:19:03.580904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:03.617912 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b5226-19f1-48ba-9e98-13fa60b3fcf7 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:03.663508 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab7a89-25c9-4b22-9a6f-7dbbbba49643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:03.664382 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab7a89-25c9-4b22-9a6f-7dbbbba49643 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:03.664667 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab7a89-25c9-4b22-9a6f-7dbbbba49643 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:03.664981 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab7a89-25c9-4b22-9a6f-7dbbbba49643 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:03.665691 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab7a89-25c9-4b22-9a6f-7dbbbba49643 None admin] RBAC: Adding query filter params (interface=public, service_id=6b40501cbd554f2bbf158bb8a7b60152, region_id=RegionOne) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:03.666001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab7a89-25c9-4b22-9a6f-7dbbbba49643 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:03.667367 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab7a89-25c9-4b22-9a6f-7dbbbba49643 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:03.673835 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 495/1001] 10.222.0.96 () {56 vars in 1251 bytes} [Wed Aug 24 04:19:03 2022] GET /identity/v3/endpoints?service_id=6b40501cbd554f2bbf158bb8a7b60152&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:03.680237 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a0ee7-c524-4076-97fe-a0f97cf16719 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:03.749804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efe248-6332-46b9-9ad2-65d7a06f2693 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:03.750155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efe248-6332-46b9-9ad2-65d7a06f2693 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:03.750382 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efe248-6332-46b9-9ad2-65d7a06f2693 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:03.751992 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 496/1002] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:19:03.757954 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdcf64-f827-431e-9a2c-191516f9bf2a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:03.758172 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdcf64-f827-431e-9a2c-191516f9bf2a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:03.758453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdcf64-f827-431e-9a2c-191516f9bf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:03.777068 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e4fdcf64-f827-431e-9a2c-191516f9bf2a None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:03.778288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e4fdcf64-f827-431e-9a2c-191516f9bf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:03.780909 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:03.793972 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a0ee7-c524-4076-97fe-a0f97cf16719 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:03.842993 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6e39d-7ae4-4549-9e4c-8fc1c9a68ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:03.843898 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6e39d-7ae4-4549-9e4c-8fc1c9a68ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:03.844330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6e39d-7ae4-4549-9e4c-8fc1c9a68ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:03.844793 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6e39d-7ae4-4549-9e4c-8fc1c9a68ff7 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:03.845679 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6e39d-7ae4-4549-9e4c-8fc1c9a68ff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:03.847925 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6e39d-7ae4-4549-9e4c-8fc1c9a68ff7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:03.851018 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 497/1003] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:03 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:19:03.855219 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 507/1004] 10.222.0.96 () {56 vars in 1087 bytes} [Wed Aug 24 04:19:03 2022] GET /identity/v3/services => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:19:04.121269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdcf64-f827-431e-9a2c-191516f9bf2a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:04.182482 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:04.227596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdcf64-f827-431e-9a2c-191516f9bf2a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:04.261578 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703d57b-3abb-487a-8246-a422e154d5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:04.262220 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703d57b-3abb-487a-8246-a422e154d5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:04.262511 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703d57b-3abb-487a-8246-a422e154d5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:04.262791 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703d57b-3abb-487a-8246-a422e154d5f5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:04.263383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703d57b-3abb-487a-8246-a422e154d5f5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:04.264783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703d57b-3abb-487a-8246-a422e154d5f5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:04.274058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-c703d57b-3abb-487a-8246-a422e154d5f5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:19:04.274058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:04.274058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:19:04.274058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:19:04.274058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:19:04.274058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:19:04.274058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:19:04.274058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:19:04.274058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:19:04.274058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:19:04.274058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:19:04.274058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:19:04.274058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:04.274058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:04.274058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:04.274058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:04.274058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:04.275036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:04.275036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:04.275036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:04.275036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:04.275036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:04.275036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:04.275036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:19:04.275036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:19:04.275036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:19:04.275036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:19:04.275036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:04.275036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:04.275036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:04.275036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:04.275036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:04.275036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:04.275903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:04.275903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:04.275903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:04.275903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:04.275903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:04.275903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:04.275903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:04.275903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:04.275903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:04.275903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:04.275903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:19:04.275903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:19:04.275903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:19:04.275903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:19:04.280034 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 498/1005] 10.222.0.96 () {56 vars in 1105 bytes} [Wed Aug 24 04:19:04 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:19:04.281054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6e39d-7ae4-4549-9e4c-8fc1c9a68ff7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:04.392573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6e39d-7ae4-4549-9e4c-8fc1c9a68ff7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:04.427843 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59936021-59e0-4b44-841f-c7c11ac83417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:04.428455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59936021-59e0-4b44-841f-c7c11ac83417 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:04.428764 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59936021-59e0-4b44-841f-c7c11ac83417 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:04.429043 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59936021-59e0-4b44-841f-c7c11ac83417 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:04.429674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59936021-59e0-4b44-841f-c7c11ac83417 None admin] RBAC: Adding query filter params (name=image) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:04.429981 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59936021-59e0-4b44-841f-c7c11ac83417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:04.431349 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59936021-59e0-4b44-841f-c7c11ac83417 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:04.440899 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 508/1006] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:19:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:04.442005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703d57b-3abb-487a-8246-a422e154d5f5 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:04.550936 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703d57b-3abb-487a-8246-a422e154d5f5 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:04.576719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:04.589903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e050fb-e711-4f04-a2f2-da63a800c414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:04.590539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e050fb-e711-4f04-a2f2-da63a800c414 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:04.590819 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e050fb-e711-4f04-a2f2-da63a800c414 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:04.591091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e050fb-e711-4f04-a2f2-da63a800c414 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:04.591718 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e050fb-e711-4f04-a2f2-da63a800c414 None admin] RBAC: Adding query filter params (type=image) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:04.592022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e050fb-e711-4f04-a2f2-da63a800c414 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:04.593416 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e050fb-e711-4f04-a2f2-da63a800c414 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:04.598219 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 499/1007] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:19:04 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:05.481664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957426c-08a0-4ac4-95dc-c24deaaa66b6 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:05.482188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957426c-08a0-4ac4-95dc-c24deaaa66b6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:05.482298 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957426c-08a0-4ac4-95dc-c24deaaa66b6 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:05.483707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 509/1008] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:05.489457 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c8c7f-6d90-40d2-9d90-cb312c8dd9e4 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:05.489749 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c8c7f-6d90-40d2-9d90-cb312c8dd9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:05.490027 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c8c7f-6d90-40d2-9d90-cb312c8dd9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:05.510810 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e38c8c7f-6d90-40d2-9d90-cb312c8dd9e4 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:05.520440 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e38c8c7f-6d90-40d2-9d90-cb312c8dd9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:05.593399 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 500/1009] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:05 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:19:05.867328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957426c-08a0-4ac4-95dc-c24deaaa66b6 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:05.877635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4b7a6-fbb3-4596-bd4e-52e847851f41 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:05.877922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4b7a6-fbb3-4596-bd4e-52e847851f41 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:05.878196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4b7a6-fbb3-4596-bd4e-52e847851f41 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:05.880352 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 501/1010] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:19:05.886572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19556d4-48f8-4134-8626-5439ee7b8cb1 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:05.886572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19556d4-48f8-4134-8626-5439ee7b8cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:05.886572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19556d4-48f8-4134-8626-5439ee7b8cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:05.890461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:05.907803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d19556d4-48f8-4134-8626-5439ee7b8cb1 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:05.909282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d19556d4-48f8-4134-8626-5439ee7b8cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:05.973449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957426c-08a0-4ac4-95dc-c24deaaa66b6 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:05.986715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 502/1011] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:05 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:19:06.015561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d7393-bcdf-4146-8ab6-878658da3ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:06.016196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d7393-bcdf-4146-8ab6-878658da3ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:06.016474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d7393-bcdf-4146-8ab6-878658da3ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:06.016777 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d7393-bcdf-4146-8ab6-878658da3ad9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:06.017883 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d7393-bcdf-4146-8ab6-878658da3ad9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:06.019636 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d7393-bcdf-4146-8ab6-878658da3ad9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:06.025028 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 510/1012] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:19:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:06.027695 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19556d4-48f8-4134-8626-5439ee7b8cb1 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:06.079254 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:06.133017 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19556d4-48f8-4134-8626-5439ee7b8cb1 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:06.167322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0de04-fd99-4713-9b09-3b56e1f531e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:06.167929 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0de04-fd99-4713-9b09-3b56e1f531e4 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:06.168215 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0de04-fd99-4713-9b09-3b56e1f531e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:06.168487 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0de04-fd99-4713-9b09-3b56e1f531e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:06.169252 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0de04-fd99-4713-9b09-3b56e1f531e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:06.170680 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0de04-fd99-4713-9b09-3b56e1f531e4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:06.199073 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 503/1013] 10.222.0.96 () {60 vars in 1141 bytes} [Wed Aug 24 04:19:06 2022] POST /identity/v3/projects => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:19:06.264698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d7393-bcdf-4146-8ab6-878658da3ad9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:06.372325 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:06.384929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d7393-bcdf-4146-8ab6-878658da3ad9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:06.422866 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6c958-c441-45cf-ab2c-f52ac51a2cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:06.423510 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6c958-c441-45cf-ab2c-f52ac51a2cef None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:06.423789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6c958-c441-45cf-ab2c-f52ac51a2cef None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:06.424068 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6c958-c441-45cf-ab2c-f52ac51a2cef None admin] PATH_INFO: `/v3/services/compute` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:06.424657 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6c958-c441-45cf-ab2c-f52ac51a2cef None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:06.426094 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6c958-c441-45cf-ab2c-f52ac51a2cef None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:06.435488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-34e6c958-c441-45cf-ab2c-f52ac51a2cef None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:19:06.435488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:06.435488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:19:06.435488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:19:06.435488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:19:06.435488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:19:06.435488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:19:06.435488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:19:06.435488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:19:06.435488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:06.435488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:19:06.435488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:06.435488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:06.435488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:06.435488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:06.435488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:06.435488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:06.436496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:06.436496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:06.436496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:06.436496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:06.436496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:06.436496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:06.436496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:19:06.436496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:19:06.436496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:19:06.436496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:19:06.436496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:06.436496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:06.436496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:06.436496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:06.436496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:06.436496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:06.437361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:06.437361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:06.437361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:06.437361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:06.437361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:06.437361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:06.437361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:06.437361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:06.437361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:06.437361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:06.437361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:19:06.437361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:19:06.437361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:19:06.437361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:06.437361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 511/1014] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:19:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:19:06.442913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0de04-fd99-4713-9b09-3b56e1f531e4 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:06.546976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d6f72-4e29-49f2-8b1b-fd9ea6f0943d None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:06.547524 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d6f72-4e29-49f2-8b1b-fd9ea6f0943d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:06.547524 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d6f72-4e29-49f2-8b1b-fd9ea6f0943d None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:06.549067 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:06.549180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 512/1015] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:06.554249 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0de04-fd99-4713-9b09-3b56e1f531e4 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:06.555081 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e28fc-693c-4ccc-9b25-a53a5844fd5b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:06.555375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e28fc-693c-4ccc-9b25-a53a5844fd5b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:06.555657 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e28fc-693c-4ccc-9b25-a53a5844fd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:06.574478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-811e28fc-693c-4ccc-9b25-a53a5844fd5b None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:06.575687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-811e28fc-693c-4ccc-9b25-a53a5844fd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:06.593729 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce5037-d4a7-4db0-bc86-7f6bcad7f22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:06.594346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce5037-d4a7-4db0-bc86-7f6bcad7f22f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:06.594628 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce5037-d4a7-4db0-bc86-7f6bcad7f22f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:06.594909 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce5037-d4a7-4db0-bc86-7f6bcad7f22f None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:06.595557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce5037-d4a7-4db0-bc86-7f6bcad7f22f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:06.595865 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce5037-d4a7-4db0-bc86-7f6bcad7f22f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:06.598181 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce5037-d4a7-4db0-bc86-7f6bcad7f22f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:06.603469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 504/1016] 10.222.0.96 () {56 vars in 1112 bytes} [Wed Aug 24 04:19:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:06.609251 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce5037-d4a7-4db0-bc86-7f6bcad7f22f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:06.660762 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 513/1017] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:06 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:19:06.723893 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce5037-d4a7-4db0-bc86-7f6bcad7f22f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:06.758632 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20035930-f587-463e-a061-f2646503c2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:06.759246 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20035930-f587-463e-a061-f2646503c2e7 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:06.759534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20035930-f587-463e-a061-f2646503c2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:06.759814 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20035930-f587-463e-a061-f2646503c2e7 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:06.760450 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20035930-f587-463e-a061-f2646503c2e7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:06.760785 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20035930-f587-463e-a061-f2646503c2e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:06.762167 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20035930-f587-463e-a061-f2646503c2e7 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:06.772197 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 505/1018] 10.222.0.96 () {56 vars in 1112 bytes} [Wed Aug 24 04:19:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:06.773867 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e28fc-693c-4ccc-9b25-a53a5844fd5b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:06.872420 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:06.892551 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e28fc-693c-4ccc-9b25-a53a5844fd5b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:06.924749 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20035930-f587-463e-a061-f2646503c2e7 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:06.929933 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94877dc8-96ad-4caa-9c5d-7e10704c6db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:06.930555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94877dc8-96ad-4caa-9c5d-7e10704c6db6 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:06.930840 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94877dc8-96ad-4caa-9c5d-7e10704c6db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:06.931117 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94877dc8-96ad-4caa-9c5d-7e10704c6db6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:06.931782 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94877dc8-96ad-4caa-9c5d-7e10704c6db6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:06.933194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94877dc8-96ad-4caa-9c5d-7e10704c6db6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:06.954761 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 514/1019] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:19:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:19:06.958395 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:07.049819 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20035930-f587-463e-a061-f2646503c2e7 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:07.102225 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805201b9-0bb3-4b92-ba7f-303481eb3be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:07.102921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805201b9-0bb3-4b92-ba7f-303481eb3be4 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:07.103236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805201b9-0bb3-4b92-ba7f-303481eb3be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:07.103512 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805201b9-0bb3-4b92-ba7f-303481eb3be4 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:07.104377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805201b9-0bb3-4b92-ba7f-303481eb3be4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:07.105961 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805201b9-0bb3-4b92-ba7f-303481eb3be4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:07.124188 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 506/1020] 10.222.0.96 () {60 vars in 1141 bytes} [Wed Aug 24 04:19:06 2022] POST /identity/v3/services => generated 242 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:19:08.201418 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7f7b9-0cfa-420a-955f-773f9a0a661b None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:08.201936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7f7b9-0cfa-420a-955f-773f9a0a661b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:08.201936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7f7b9-0cfa-420a-955f-773f9a0a661b None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:08.203248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 515/1021] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:08.208870 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea67e1b-813d-4587-8b4a-87185c018b3c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:08.209266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea67e1b-813d-4587-8b4a-87185c018b3c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:08.209437 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea67e1b-813d-4587-8b4a-87185c018b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:08.230827 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-dea67e1b-813d-4587-8b4a-87185c018b3c None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:08.232041 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-dea67e1b-813d-4587-8b4a-87185c018b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:08.308317 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 507/1022] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:19:08.577747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7f7b9-0cfa-420a-955f-773f9a0a661b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:08.684071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7f7b9-0cfa-420a-955f-773f9a0a661b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:08.719073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92036db-3f1c-486e-b438-7f0bd199669d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:08.719707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92036db-3f1c-486e-b438-7f0bd199669d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:08.719989 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92036db-3f1c-486e-b438-7f0bd199669d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:08.720262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92036db-3f1c-486e-b438-7f0bd199669d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:08.721492 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92036db-3f1c-486e-b438-7f0bd199669d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:08.723564 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92036db-3f1c-486e-b438-7f0bd199669d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:08.725332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 516/1023] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:19:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:08.730810 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea67e1b-813d-4587-8b4a-87185c018b3c None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:08.743062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:08.839423 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea67e1b-813d-4587-8b4a-87185c018b3c None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:08.875662 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9dfd65-a403-4a56-b13b-619eafaf49ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:08.876387 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9dfd65-a403-4a56-b13b-619eafaf49ba None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:08.876674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9dfd65-a403-4a56-b13b-619eafaf49ba None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:08.876978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9dfd65-a403-4a56-b13b-619eafaf49ba None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:08.877663 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9dfd65-a403-4a56-b13b-619eafaf49ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:08.879379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9dfd65-a403-4a56-b13b-619eafaf49ba None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:08.908719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 508/1024] 10.222.0.96 () {60 vars in 1132 bytes} [Wed Aug 24 04:19:08 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:19:09.027182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f7705-a97f-40a7-ae49-06052bd95e92 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:09.027519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f7705-a97f-40a7-ae49-06052bd95e92 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:09.027750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f7705-a97f-40a7-ae49-06052bd95e92 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:09.029171 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 517/1025] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:19:09.035849 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5e614-78fa-422f-a9e7-5ba946cb577c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:09.036269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5e614-78fa-422f-a9e7-5ba946cb577c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:09.036580 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5e614-78fa-422f-a9e7-5ba946cb577c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:09.056136 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-45d5e614-78fa-422f-a9e7-5ba946cb577c None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:09.057436 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-45d5e614-78fa-422f-a9e7-5ba946cb577c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:09.082730 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0d582-1913-4649-ae86-5f736f4d1efa None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:09.083047 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0d582-1913-4649-ae86-5f736f4d1efa None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:09.083280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0d582-1913-4649-ae86-5f736f4d1efa None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:09.084704 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 518/1026] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:19:09.089752 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc3867-8370-4091-91a4-546ec6e081d2 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:09.090044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc3867-8370-4091-91a4-546ec6e081d2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:09.090323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc3867-8370-4091-91a4-546ec6e081d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:09.103789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:09.110665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d7fc3867-8370-4091-91a4-546ec6e081d2 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:09.113613 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d7fc3867-8370-4091-91a4-546ec6e081d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:09.126848 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:09.137776 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 509/1027] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:19:09.194802 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 519/1028] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:19:09.418694 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5e614-78fa-422f-a9e7-5ba946cb577c None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:09.463836 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc3867-8370-4091-91a4-546ec6e081d2 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:09.531096 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5e614-78fa-422f-a9e7-5ba946cb577c None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:09.569591 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda46a9-7762-4043-afc6-97b6ec684821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:09.570492 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda46a9-7762-4043-afc6-97b6ec684821 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:09.570778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda46a9-7762-4043-afc6-97b6ec684821 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:09.571096 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda46a9-7762-4043-afc6-97b6ec684821 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:09.572759 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc3867-8370-4091-91a4-546ec6e081d2 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:09.585636 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda46a9-7762-4043-afc6-97b6ec684821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:19:09.590528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-0fda46a9-7762-4043-afc6-97b6ec684821 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:19:09.590528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:09.590528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:09.590528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:09.590528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:09.590528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:09.590528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:09.590528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:09.590528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:09.590528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:09.590528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:09.590528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:09.590528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:19:09.590528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:19:09.590528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:19:09.590528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:19:09.591566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:19:09.591566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:19:09.591566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:19:09.591566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:19:09.591566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:09.591566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:09.591566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:09.591566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:09.591566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:09.591566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:09.591566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:09.591566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:09.591566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:09.591566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:09.591566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:09.591566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:09.592415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:09.592415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:09.592415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:09.592415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:09.592415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:19:09.592415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:19:09.592415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:19:09.592415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:19:09.592415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:19:09.592415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:19:09.592415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:19:09.592415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:19:09.592415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 510/1029] 10.222.0.96 () {56 vars in 1120 bytes} [Wed Aug 24 04:19:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:19:09.599362 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda46a9-7762-4043-afc6-97b6ec684821 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:09.613108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b2c30-cf2a-40ff-9ef4-86465732d254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:09.613847 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b2c30-cf2a-40ff-9ef4-86465732d254 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:09.614134 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b2c30-cf2a-40ff-9ef4-86465732d254 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:09.614411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b2c30-cf2a-40ff-9ef4-86465732d254 None admin] PATH_INFO: `/v3/services/image` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:09.615074 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b2c30-cf2a-40ff-9ef4-86465732d254 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:09.616495 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b2c30-cf2a-40ff-9ef4-86465732d254 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:09.619970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:09.627817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-951b2c30-cf2a-40ff-9ef4-86465732d254 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:19:09.627817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:09.627817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:19:09.627817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:19:09.627817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:19:09.627817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:19:09.627817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:19:09.627817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:19:09.627817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:19:09.627817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:09.627817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:19:09.627817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:09.627817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:09.627817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:09.627817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:09.627817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:09.627817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:09.629014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:09.629014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:09.629014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:09.629014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:09.629014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:09.629014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:09.629014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:19:09.629014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:19:09.629014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:19:09.629014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:19:09.629014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:09.629014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:09.629014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:09.629014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:09.629014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:09.629014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:09.629957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:09.629957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:09.629957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:09.629957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:09.629957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:09.629957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:09.629957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:09.629957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:09.629957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:09.629957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:09.629957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:19:09.629957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:19:09.629957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:19:09.629957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:09.630703 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 520/1030] 10.222.0.96 () {56 vars in 1105 bytes} [Wed Aug 24 04:19:09 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:19:09.635941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b2c30-cf2a-40ff-9ef4-86465732d254 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:09.664235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:09.719089 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda46a9-7762-4043-afc6-97b6ec684821 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:09.752935 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b2c30-cf2a-40ff-9ef4-86465732d254 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:09.755311 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a584b-de46-4a36-a63c-5aab21edb859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:09.755989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a584b-de46-4a36-a63c-5aab21edb859 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:09.756270 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a584b-de46-4a36-a63c-5aab21edb859 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:09.756545 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a584b-de46-4a36-a63c-5aab21edb859 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:09.757314 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a584b-de46-4a36-a63c-5aab21edb859 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:09.757623 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a584b-de46-4a36-a63c-5aab21edb859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:09.758997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a584b-de46-4a36-a63c-5aab21edb859 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:09.767119 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 511/1031] 10.222.0.96 () {56 vars in 1115 bytes} [Wed Aug 24 04:19:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:09.773599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a584b-de46-4a36-a63c-5aab21edb859 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:09.791222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cbba4-0555-44c3-bdf5-01f1d147f435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:09.792342 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cbba4-0555-44c3-bdf5-01f1d147f435 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:09.792718 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cbba4-0555-44c3-bdf5-01f1d147f435 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:09.793119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cbba4-0555-44c3-bdf5-01f1d147f435 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:09.793906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cbba4-0555-44c3-bdf5-01f1d147f435 None admin] RBAC: Adding query filter params (name=image) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:09.794221 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cbba4-0555-44c3-bdf5-01f1d147f435 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:09.795947 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cbba4-0555-44c3-bdf5-01f1d147f435 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:09.806044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 521/1032] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:19:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:09.807204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cbba4-0555-44c3-bdf5-01f1d147f435 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:09.881070 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:09.890684 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a584b-de46-4a36-a63c-5aab21edb859 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:09.910535 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:09.924893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cbba4-0555-44c3-bdf5-01f1d147f435 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:09.932234 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857f908-71d8-485d-9d15-46e36a7ed028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:09.933438 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857f908-71d8-485d-9d15-46e36a7ed028 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:09.933724 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857f908-71d8-485d-9d15-46e36a7ed028 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:09.934003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857f908-71d8-485d-9d15-46e36a7ed028 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:09.946604 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857f908-71d8-485d-9d15-46e36a7ed028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:09.948326 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857f908-71d8-485d-9d15-46e36a7ed028 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:09.965355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-0857f908-71d8-485d-9d15-46e36a7ed028 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:19:09.965355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:09.965355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:09.965355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:09.965355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:09.965355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:09.965355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:09.965355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:09.965355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:09.965355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:09.965355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:09.965355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:09.965355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:19:09.965355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:19:09.965355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:19:09.965355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:19:09.966372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:09.966372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:09.966372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:09.966372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:09.966372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:09.966372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:09.966372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:09.966372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:09.966372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:09.966372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:09.966372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:09.966372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:09.966372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:09.966372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:09.966372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:09.966372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:09.966372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:19:09.972839 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:19:09.972839 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:19:09.972839 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:19:09.973036 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61baa462-cd66-4a84-b504-dff4881668d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:09.973036 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baa462-cd66-4a84-b504-dff4881668d7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:09.973036 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baa462-cd66-4a84-b504-dff4881668d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:09.973260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 512/1033] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:19:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:19:09.973330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baa462-cd66-4a84-b504-dff4881668d7 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:09.973330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61baa462-cd66-4a84-b504-dff4881668d7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:09.973330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61baa462-cd66-4a84-b504-dff4881668d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:09.973330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61baa462-cd66-4a84-b504-dff4881668d7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:09.973566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857f908-71d8-485d-9d15-46e36a7ed028 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:09.977447 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 522/1034] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:19:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:09.982887 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61baa462-cd66-4a84-b504-dff4881668d7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:10.088102 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857f908-71d8-485d-9d15-46e36a7ed028 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:10.094215 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61baa462-cd66-4a84-b504-dff4881668d7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:10.127119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:10.127386 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efb9e7-4c7e-4c12-895b-e5bb05358b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:10.128138 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efb9e7-4c7e-4c12-895b-e5bb05358b67 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:10.129090 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efb9e7-4c7e-4c12-895b-e5bb05358b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:10.129531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efb9e7-4c7e-4c12-895b-e5bb05358b67 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:10.130496 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efb9e7-4c7e-4c12-895b-e5bb05358b67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:10.130855 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efb9e7-4c7e-4c12-895b-e5bb05358b67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:10.132409 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efb9e7-4c7e-4c12-895b-e5bb05358b67 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:10.138334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ea53a-da43-437d-9e72-2a8aa1693249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:10.139188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ea53a-da43-437d-9e72-2a8aa1693249 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:10.139654 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ea53a-da43-437d-9e72-2a8aa1693249 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:10.140130 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ea53a-da43-437d-9e72-2a8aa1693249 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:10.141030 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ea53a-da43-437d-9e72-2a8aa1693249 None admin] RBAC: Adding query filter params (interface=public, service_id=1f3b7458aec4405c8dcc4a31ab2a3ed5, region_id=RegionOne) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:10.141497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ea53a-da43-437d-9e72-2a8aa1693249 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:10.143004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ea53a-da43-437d-9e72-2a8aa1693249 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:10.148730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 513/1035] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:10.153159 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efb9e7-4c7e-4c12-895b-e5bb05358b67 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:10.158194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 523/1036] 10.222.0.96 () {56 vars in 1251 bytes} [Wed Aug 24 04:19:09 2022] GET /identity/v3/endpoints?service_id=1f3b7458aec4405c8dcc4a31ab2a3ed5&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:10.159206 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ea53a-da43-437d-9e72-2a8aa1693249 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:10.188233 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:10.261714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efb9e7-4c7e-4c12-895b-e5bb05358b67 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:10.273434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ea53a-da43-437d-9e72-2a8aa1693249 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:10.297445 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766862a8-9496-49bd-84d4-4852ce6785f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:10.298090 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766862a8-9496-49bd-84d4-4852ce6785f4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:10.298378 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766862a8-9496-49bd-84d4-4852ce6785f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:10.298657 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766862a8-9496-49bd-84d4-4852ce6785f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:10.308365 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766862a8-9496-49bd-84d4-4852ce6785f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:10.309820 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766862a8-9496-49bd-84d4-4852ce6785f4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:10.312293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b9012-d376-4fcc-959a-67f1bf48266d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:10.313029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b9012-d376-4fcc-959a-67f1bf48266d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:10.313310 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b9012-d376-4fcc-959a-67f1bf48266d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:10.313583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b9012-d376-4fcc-959a-67f1bf48266d None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:10.314186 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b9012-d376-4fcc-959a-67f1bf48266d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:10.315544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b9012-d376-4fcc-959a-67f1bf48266d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:10.323214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-766862a8-9496-49bd-84d4-4852ce6785f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:19:10.323214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:10.323214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:10.323214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:10.323214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:10.323214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:10.323214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:10.323214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:10.323214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:10.323214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:10.323214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:10.323214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:10.323214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:19:10.323214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:19:10.323214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:19:10.323214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:19:10.332730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:10.332730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:10.332730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:19:10.332730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:19:10.332730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:19:10.332730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:19:10.332730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:10.332730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:10.332730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:10.332730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:10.332730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:10.332730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:10.332730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:10.332730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:10.332730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:10.332730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:10.332730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:10.332730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:10.334214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:10.334214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:10.334214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:19:10.334214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:19:10.334214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:19:10.334214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:19:10.334214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:19:10.334214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:19:10.334214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:19:10.334214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:19:10.334214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 514/1037] 10.222.0.96 () {56 vars in 1093 bytes} [Wed Aug 24 04:19:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:19:10.334214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766862a8-9496-49bd-84d4-4852ce6785f4 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:10.335709 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 524/1038] 10.222.0.96 () {56 vars in 1087 bytes} [Wed Aug 24 04:19:10 2022] GET /identity/v3/services => generated 1957 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:19:10.439685 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:10.452794 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766862a8-9496-49bd-84d4-4852ce6785f4 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:10.491043 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c40e53-9371-4ac9-aaeb-82909d43b415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:10.491664 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c40e53-9371-4ac9-aaeb-82909d43b415 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:10.491951 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c40e53-9371-4ac9-aaeb-82909d43b415 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:10.492227 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c40e53-9371-4ac9-aaeb-82909d43b415 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:10.492998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c40e53-9371-4ac9-aaeb-82909d43b415 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:10.493310 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c40e53-9371-4ac9-aaeb-82909d43b415 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:10.494837 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c40e53-9371-4ac9-aaeb-82909d43b415 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:10.515026 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 515/1039] 10.222.0.96 () {56 vars in 1133 bytes} [Wed Aug 24 04:19:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:10.522528 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b9012-d376-4fcc-959a-67f1bf48266d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:10.583427 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:10.630014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b9012-d376-4fcc-959a-67f1bf48266d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:10.664235 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ff1ae-1796-451a-88d9-adbc62fa14e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:10.664932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ff1ae-1796-451a-88d9-adbc62fa14e2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:10.665216 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ff1ae-1796-451a-88d9-adbc62fa14e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:10.665540 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ff1ae-1796-451a-88d9-adbc62fa14e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:10.736602 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ff1ae-1796-451a-88d9-adbc62fa14e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:10.738767 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ff1ae-1796-451a-88d9-adbc62fa14e2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:10.802661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:10.859726 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 525/1040] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:19:10 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:19:10.861330 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c40e53-9371-4ac9-aaeb-82909d43b415 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:10.932117 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef97ad8-e79c-4a55-b079-623535521d4d None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:10.932449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef97ad8-e79c-4a55-b079-623535521d4d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:10.932749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef97ad8-e79c-4a55-b079-623535521d4d None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:10.934392 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 526/1041] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:19:10.940459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674e9e5-0c52-494a-b854-eda77ab0a404 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:10.940777 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674e9e5-0c52-494a-b854-eda77ab0a404 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:10.941207 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674e9e5-0c52-494a-b854-eda77ab0a404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:10.960237 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6674e9e5-0c52-494a-b854-eda77ab0a404 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:10.961463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6674e9e5-0c52-494a-b854-eda77ab0a404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:10.973016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c40e53-9371-4ac9-aaeb-82909d43b415 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:11.014398 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2554af1-6473-45dc-be09-f28a83aa5bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:11.015307 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2554af1-6473-45dc-be09-f28a83aa5bfd None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:11.015648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2554af1-6473-45dc-be09-f28a83aa5bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:11.015935 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2554af1-6473-45dc-be09-f28a83aa5bfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:11.030478 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2554af1-6473-45dc-be09-f28a83aa5bfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:11.032139 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2554af1-6473-45dc-be09-f28a83aa5bfd None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:11.033922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 527/1042] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:19:11.042131 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:11.048906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-f2554af1-6473-45dc-be09-f28a83aa5bfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:19:11.048906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:11.048906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:11.048906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:11.048906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:11.048906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:11.048906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:11.048906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:11.048906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:11.048906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:11.048906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:11.048906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:11.048906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:19:11.048906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:19:11.048906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:19:11.048906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:19:11.049989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:11.049989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:11.049989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:11.049989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:11.049989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:11.049989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:11.049989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:11.049989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:11.049989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:11.049989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:11.049989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:11.049989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:11.049989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:11.049989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:11.049989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:11.049989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:11.049989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:19:11.051089 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:19:11.051089 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:19:11.051089 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:19:11.052446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 516/1043] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:19:11.058409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674e9e5-0c52-494a-b854-eda77ab0a404 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:11.146939 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:11.166352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674e9e5-0c52-494a-b854-eda77ab0a404 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:11.203645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d8660-91b6-49c4-971d-870541d64bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:11.204268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d8660-91b6-49c4-971d-870541d64bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:11.204549 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d8660-91b6-49c4-971d-870541d64bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:11.204854 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d8660-91b6-49c4-971d-870541d64bc7 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:11.205484 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d8660-91b6-49c4-971d-870541d64bc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:11.205791 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d8660-91b6-49c4-971d-870541d64bc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:11.207751 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d8660-91b6-49c4-971d-870541d64bc7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:11.224719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 528/1044] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:11.225662 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2554af1-6473-45dc-be09-f28a83aa5bfd None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:11.306286 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d8660-91b6-49c4-971d-870541d64bc7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:11.330026 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2554af1-6473-45dc-be09-f28a83aa5bfd None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:11.367055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e3bb5-44e9-44d1-a737-14389c5d50c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:11.367699 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e3bb5-44e9-44d1-a737-14389c5d50c2 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:11.367981 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e3bb5-44e9-44d1-a737-14389c5d50c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:11.368255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e3bb5-44e9-44d1-a737-14389c5d50c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:11.375229 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e3bb5-44e9-44d1-a737-14389c5d50c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:11.376677 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e3bb5-44e9-44d1-a737-14389c5d50c2 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:11.389000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-c84e3bb5-44e9-44d1-a737-14389c5d50c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:19:11.389000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:11.389000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:11.389000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:11.389000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:11.389000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:11.389000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:11.389000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:11.389000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:11.389000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:11.389000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:11.389000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:11.389000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:19:11.389000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:19:11.389000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:19:11.389932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:19:11.389932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:11.389932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:11.389932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:11.389932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:11.389932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:11.389932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:11.389932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:11.389932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:11.389932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:11.389932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:11.389932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:11.389932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:11.389932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:11.389932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:11.389932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:11.389932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:11.391075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:19:11.391075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:19:11.391075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:19:11.391075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:19:11.391075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:19:11.391075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:19:11.391075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:19:11.391075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:19:11.391075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 517/1045] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:19:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:19:11.396131 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e3bb5-44e9-44d1-a737-14389c5d50c2 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:11.431043 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d8660-91b6-49c4-971d-870541d64bc7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:11.458618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:11.470275 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbecd3-aec5-4033-91bc-2498b463f2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:11.471041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbecd3-aec5-4033-91bc-2498b463f2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:11.471434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbecd3-aec5-4033-91bc-2498b463f2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:11.471714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbecd3-aec5-4033-91bc-2498b463f2f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:11.483446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbecd3-aec5-4033-91bc-2498b463f2f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:19:11.488944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-10cbecd3-aec5-4033-91bc-2498b463f2f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:19:11.488944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:11.488944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:11.488944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:11.488944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:11.488944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:11.488944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:11.488944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:11.488944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:11.488944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:11.488944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:11.488944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:11.488944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:19:11.488944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:19:11.488944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:19:11.488944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:19:11.489919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:19:11.489919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:19:11.489919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:19:11.489919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:19:11.489919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:11.489919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:11.489919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:11.489919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:11.489919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:11.489919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:11.489919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:11.489919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:11.489919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:11.489919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:11.489919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:11.489919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:11.490786 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:11.490786 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:11.490786 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:11.490786 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:11.490786 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:19:11.490786 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:19:11.490786 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:19:11.490786 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:19:11.490786 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:19:11.490786 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:19:11.490786 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:19:11.490786 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:11.495160 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 529/1046] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:19:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:19:11.496008 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbecd3-aec5-4033-91bc-2498b463f2f0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:11.505171 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e3bb5-44e9-44d1-a737-14389c5d50c2 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:11.505593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:11.542639 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953d69b-aa7b-4d8c-92cd-4556938e9c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:11.543260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953d69b-aa7b-4d8c-92cd-4556938e9c72 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:11.543541 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953d69b-aa7b-4d8c-92cd-4556938e9c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:11.543822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953d69b-aa7b-4d8c-92cd-4556938e9c72 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:11.544514 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953d69b-aa7b-4d8c-92cd-4556938e9c72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:11.544857 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953d69b-aa7b-4d8c-92cd-4556938e9c72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:11.546286 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953d69b-aa7b-4d8c-92cd-4556938e9c72 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:11.559329 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 518/1047] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:19:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:11.565428 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953d69b-aa7b-4d8c-92cd-4556938e9c72 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:11.615798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbecd3-aec5-4033-91bc-2498b463f2f0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:11.651820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd9b0d-2c29-4405-9258-7185b72d656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:11.652535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd9b0d-2c29-4405-9258-7185b72d656e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:11.652850 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd9b0d-2c29-4405-9258-7185b72d656e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:11.653126 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd9b0d-2c29-4405-9258-7185b72d656e None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:11.653816 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd9b0d-2c29-4405-9258-7185b72d656e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:11.654119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd9b0d-2c29-4405-9258-7185b72d656e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:11.655481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd9b0d-2c29-4405-9258-7185b72d656e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:11.667008 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 530/1048] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:19:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:11.672480 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd9b0d-2c29-4405-9258-7185b72d656e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:11.690125 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953d69b-aa7b-4d8c-92cd-4556938e9c72 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:11.713521 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:11.730391 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa2034-6a76-4f7c-b872-5c370cfeb2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:11.731007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa2034-6a76-4f7c-b872-5c370cfeb2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:11.731301 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa2034-6a76-4f7c-b872-5c370cfeb2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:11.731610 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa2034-6a76-4f7c-b872-5c370cfeb2c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:11.732461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa2034-6a76-4f7c-b872-5c370cfeb2c0 None admin] RBAC: Adding query filter params (role.id=e760dc89dca8425fa560d31c5a0fec8d, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=3539784b4e91472eb20addc6707dc30d) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:11.732817 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa2034-6a76-4f7c-b872-5c370cfeb2c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:11.734391 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa2034-6a76-4f7c-b872-5c370cfeb2c0 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:11.741039 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:11.749120 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 519/1049] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:19:11 2022] GET /identity/v3/role_assignments?user.id=3539784b4e91472eb20addc6707dc30d&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=e760dc89dca8425fa560d31c5a0fec8d => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:11.788464 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd9b0d-2c29-4405-9258-7185b72d656e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:11.831985 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a9ee7-e86d-4d0c-b9d5-6758cb7d0643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:11.833106 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a9ee7-e86d-4d0c-b9d5-6758cb7d0643 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:11.833609 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a9ee7-e86d-4d0c-b9d5-6758cb7d0643 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:11.834558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a9ee7-e86d-4d0c-b9d5-6758cb7d0643 None admin] PATH_INFO: `/v3/users/d205e313315a436e87607f0c4b8b4122` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:11.851038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a9ee7-e86d-4d0c-b9d5-6758cb7d0643 None admin] RBAC: Authorizing `identity:get_user(user_id=d205e313315a436e87607f0c4b8b4122)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:11.852590 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a9ee7-e86d-4d0c-b9d5-6758cb7d0643 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:11.859064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 531/1050] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:19:11 2022] GET /identity/v3/users/d205e313315a436e87607f0c4b8b4122 => generated 285 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:11.860323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa2034-6a76-4f7c-b872-5c370cfeb2c0 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:11.975192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa2034-6a76-4f7c-b872-5c370cfeb2c0 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:12.013568 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a0868-bb65-4696-9e93-93751d2d30f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:12.014193 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a0868-bb65-4696-9e93-93751d2d30f1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:12.014476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a0868-bb65-4696-9e93-93751d2d30f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:12.014750 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a0868-bb65-4696-9e93-93751d2d30f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:12.073740 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:12.092227 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a0868-bb65-4696-9e93-93751d2d30f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:12.093713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a0868-bb65-4696-9e93-93751d2d30f1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:12.204722 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 520/1051] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:19:11 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:19:12.207335 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a9ee7-e86d-4d0c-b9d5-6758cb7d0643 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:12.257162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6103a2-07fb-4e94-80d8-0a6d39715163 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:12.257337 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6103a2-07fb-4e94-80d8-0a6d39715163 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:12.257618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6103a2-07fb-4e94-80d8-0a6d39715163 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:12.259023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 521/1052] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:19:12.264595 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5270c-27c9-468c-93ea-c17e5d1eb1d7 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:12.265080 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5270c-27c9-468c-93ea-c17e5d1eb1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:12.265508 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5270c-27c9-468c-93ea-c17e5d1eb1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:12.287781 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-fed5270c-27c9-468c-93ea-c17e5d1eb1d7 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:12.289320 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-fed5270c-27c9-468c-93ea-c17e5d1eb1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:12.322708 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a9ee7-e86d-4d0c-b9d5-6758cb7d0643 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:12.349472 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:12.360372 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161f09d-058a-47ed-a092-2569835082c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:12.361039 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161f09d-058a-47ed-a092-2569835082c8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:12.361312 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161f09d-058a-47ed-a092-2569835082c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:12.361628 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161f09d-058a-47ed-a092-2569835082c8 None admin] PATH_INFO: `/v3/projects/e393fa6f7b0a45d08f7c06094bd90886` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:12.363355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161f09d-058a-47ed-a092-2569835082c8 None admin] RBAC: Authorizing `identity:get_project(project_id=e393fa6f7b0a45d08f7c06094bd90886)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:12.364729 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 522/1053] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:19:12.365539 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161f09d-058a-47ed-a092-2569835082c8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:12.368723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 532/1054] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:19:12 2022] GET /identity/v3/projects/e393fa6f7b0a45d08f7c06094bd90886 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:12.373199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5270c-27c9-468c-93ea-c17e5d1eb1d7 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:12.389106 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:12.478452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5270c-27c9-468c-93ea-c17e5d1eb1d7 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:12.511962 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6022c2a-df37-41a1-8cdc-c6d062f8b2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:12.512491 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6022c2a-df37-41a1-8cdc-c6d062f8b2de None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:12.512795 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6022c2a-df37-41a1-8cdc-c6d062f8b2de None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:12.513068 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6022c2a-df37-41a1-8cdc-c6d062f8b2de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:12.513790 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6022c2a-df37-41a1-8cdc-c6d062f8b2de None admin] RBAC: Adding query filter params (role.id=059d2bf5bb8e42939f5f826bfdad6a21, scope.project.id=e393fa6f7b0a45d08f7c06094bd90886, user.id=d205e313315a436e87607f0c4b8b4122) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:12.514096 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6022c2a-df37-41a1-8cdc-c6d062f8b2de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:12.515519 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6022c2a-df37-41a1-8cdc-c6d062f8b2de None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:12.529045 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 523/1055] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:19:12 2022] GET /identity/v3/role_assignments?user.id=d205e313315a436e87607f0c4b8b4122&scope.project.id=e393fa6f7b0a45d08f7c06094bd90886&role.id=059d2bf5bb8e42939f5f826bfdad6a21 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:12.637251 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161f09d-058a-47ed-a092-2569835082c8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:12.755706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161f09d-058a-47ed-a092-2569835082c8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:12.790950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839085c-be89-4fb3-88bf-f5bc51e13025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:12.791507 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839085c-be89-4fb3-88bf-f5bc51e13025 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:12.791785 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839085c-be89-4fb3-88bf-f5bc51e13025 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:12.792061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839085c-be89-4fb3-88bf-f5bc51e13025 None admin] PATH_INFO: `/v3/services/image` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:12.792640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839085c-be89-4fb3-88bf-f5bc51e13025 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:12.794043 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839085c-be89-4fb3-88bf-f5bc51e13025 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:12.802812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-6839085c-be89-4fb3-88bf-f5bc51e13025 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:19:12.802812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:12.802812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:19:12.802812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:19:12.802812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:19:12.802812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:19:12.802812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:19:12.802812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:19:12.802812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:19:12.802812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:12.802812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:19:12.802812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:12.802812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:12.802812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:12.802812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:12.802812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:12.802812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:12.803901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:12.803901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:12.803901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:12.803901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:12.803901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:12.803901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:12.803901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:19:12.803901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:19:12.803901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:19:12.803901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:19:12.803901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:12.803901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:12.803901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:12.803901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:12.803901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:12.803901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:12.804795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:12.804795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:12.804795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:12.804795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:12.804795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:12.804795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:12.804795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:12.804795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:12.804795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:12.804795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:12.804795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:19:12.804795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:19:12.804795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:19:12.804795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:12.810248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 533/1056] 10.222.0.96 () {56 vars in 1105 bytes} [Wed Aug 24 04:19:12 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:19:12.810377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6022c2a-df37-41a1-8cdc-c6d062f8b2de None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:12.900183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:12.923463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6022c2a-df37-41a1-8cdc-c6d062f8b2de None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:12.962486 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421e4f9-e986-46c2-8b16-3768b5036d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:12.963109 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421e4f9-e986-46c2-8b16-3768b5036d8c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:12.963397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421e4f9-e986-46c2-8b16-3768b5036d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:12.963682 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421e4f9-e986-46c2-8b16-3768b5036d8c None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:12.964325 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421e4f9-e986-46c2-8b16-3768b5036d8c None admin] RBAC: Adding query filter params (name=image) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:12.964635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421e4f9-e986-46c2-8b16-3768b5036d8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:12.966049 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421e4f9-e986-46c2-8b16-3768b5036d8c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:12.975809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 524/1057] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:19:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:12.977241 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839085c-be89-4fb3-88bf-f5bc51e13025 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:13.043223 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:13.097877 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839085c-be89-4fb3-88bf-f5bc51e13025 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:13.140381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fc493-eea2-4a9f-87e0-6e9050bdda16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:13.141027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fc493-eea2-4a9f-87e0-6e9050bdda16 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:13.141310 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fc493-eea2-4a9f-87e0-6e9050bdda16 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:13.141588 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fc493-eea2-4a9f-87e0-6e9050bdda16 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:13.142222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25fc493-eea2-4a9f-87e0-6e9050bdda16 None admin] RBAC: Adding query filter params (type=image) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:13.142529 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25fc493-eea2-4a9f-87e0-6e9050bdda16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:13.143918 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25fc493-eea2-4a9f-87e0-6e9050bdda16 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:13.154087 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 534/1058] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:19:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:13.155279 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421e4f9-e986-46c2-8b16-3768b5036d8c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:13.264379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421e4f9-e986-46c2-8b16-3768b5036d8c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:13.298899 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cec50-9a94-4339-a550-c37dfc6fa28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:13.299435 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cec50-9a94-4339-a550-c37dfc6fa28d None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:13.299716 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cec50-9a94-4339-a550-c37dfc6fa28d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:13.299988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cec50-9a94-4339-a550-c37dfc6fa28d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:13.301397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082cec50-9a94-4339-a550-c37dfc6fa28d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:13.302761 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082cec50-9a94-4339-a550-c37dfc6fa28d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:13.319570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:13.328147 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 525/1059] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:19:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:19:13.687385 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04b1c2-3470-4156-9f65-3e05acda4330 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:13.687903 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04b1c2-3470-4156-9f65-3e05acda4330 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:13.687980 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04b1c2-3470-4156-9f65-3e05acda4330 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:13.689717 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 535/1060] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:13.695370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d764c-4b1e-4244-a0a3-a65a8922c981 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:13.695822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d764c-4b1e-4244-a0a3-a65a8922c981 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:13.696000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d764c-4b1e-4244-a0a3-a65a8922c981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:13.714453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-af6d764c-4b1e-4244-a0a3-a65a8922c981 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:13.715634 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-af6d764c-4b1e-4244-a0a3-a65a8922c981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:13.790401 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 526/1061] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:19:14.055084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04b1c2-3470-4156-9f65-3e05acda4330 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:14.163420 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04b1c2-3470-4156-9f65-3e05acda4330 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:14.187631 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:14.200381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb859b1d-9512-43ea-877b-ea22d933436c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:14.201044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb859b1d-9512-43ea-877b-ea22d933436c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:14.201323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb859b1d-9512-43ea-877b-ea22d933436c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:14.201595 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb859b1d-9512-43ea-877b-ea22d933436c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:14.212345 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb859b1d-9512-43ea-877b-ea22d933436c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:19:14.217093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-fb859b1d-9512-43ea-877b-ea22d933436c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:19:14.217093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:14.217093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:14.217093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:14.217093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:14.217093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:14.217093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:14.217093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:14.217093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:14.217093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:14.217093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:14.217093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:14.217093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:19:14.217093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:19:14.217093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:19:14.217093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:19:14.218045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:19:14.218045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:19:14.218045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:19:14.218045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:19:14.218045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:14.218045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:14.218045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:14.218045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:14.218045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:14.218045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:14.218045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:14.218045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:14.218045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:14.218045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:14.218045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:14.218045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:14.218921 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:14.218921 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:14.218921 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:14.218921 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:14.218921 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:19:14.218921 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:19:14.218921 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:19:14.218921 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:19:14.218921 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:19:14.218921 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:19:14.218921 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:19:14.218921 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:14.220861 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 536/1062] 10.222.0.96 () {56 vars in 1120 bytes} [Wed Aug 24 04:19:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:19:14.225432 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d764c-4b1e-4244-a0a3-a65a8922c981 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:14.333522 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d764c-4b1e-4244-a0a3-a65a8922c981 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:14.357933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:14.371006 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6351a4-501c-41d1-9eca-ce5757589a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:14.371661 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6351a4-501c-41d1-9eca-ce5757589a00 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:14.371942 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6351a4-501c-41d1-9eca-ce5757589a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:14.372218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6351a4-501c-41d1-9eca-ce5757589a00 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:14.372959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6351a4-501c-41d1-9eca-ce5757589a00 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:14.373270 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6351a4-501c-41d1-9eca-ce5757589a00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:14.374652 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6351a4-501c-41d1-9eca-ce5757589a00 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:14.383739 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 527/1063] 10.222.0.96 () {56 vars in 1115 bytes} [Wed Aug 24 04:19:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:14.389219 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb859b1d-9512-43ea-877b-ea22d933436c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:14.495069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb859b1d-9512-43ea-877b-ea22d933436c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:14.531201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb5e9c-389b-4e18-9ba0-ee63cd15f953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:14.531836 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb5e9c-389b-4e18-9ba0-ee63cd15f953 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:14.532123 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb5e9c-389b-4e18-9ba0-ee63cd15f953 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:14.532391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb5e9c-389b-4e18-9ba0-ee63cd15f953 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:14.542761 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb5e9c-389b-4e18-9ba0-ee63cd15f953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:14.544216 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb5e9c-389b-4e18-9ba0-ee63cd15f953 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:14.558875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-2eeb5e9c-389b-4e18-9ba0-ee63cd15f953 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:19:14.558875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:14.558875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:14.558875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:14.558875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:14.558875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:14.558875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:14.558875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:14.558875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:14.558875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:14.558875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:14.558875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:14.558875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:19:14.558875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:19:14.558875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:19:14.558875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:19:14.559826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:14.559826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:14.559826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:14.559826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:14.559826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:14.559826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:14.559826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:14.559826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:14.559826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:14.559826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:14.559826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:14.559826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:14.559826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:14.559826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:14.559826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:14.559826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:14.559826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:19:14.560763 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:19:14.560763 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:19:14.560763 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:14.561678 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 537/1064] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:19:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:19:14.566253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6351a4-501c-41d1-9eca-ce5757589a00 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:14.568369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabfd32-509c-42a6-a2e3-c62abf5921fa None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:14.568884 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabfd32-509c-42a6-a2e3-c62abf5921fa None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:14.569361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabfd32-509c-42a6-a2e3-c62abf5921fa None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:14.571072 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 538/1065] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:14.576270 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096136c-b36e-45de-b807-45772c21502f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:14.576556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096136c-b36e-45de-b807-45772c21502f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:14.576869 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096136c-b36e-45de-b807-45772c21502f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:14.597148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6096136c-b36e-45de-b807-45772c21502f None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:14.598583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6096136c-b36e-45de-b807-45772c21502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:14.626744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:14.673914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 539/1066] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:19:14.682700 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6351a4-501c-41d1-9eca-ce5757589a00 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:14.723275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca620de5-93db-46af-a870-40a74d61918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:14.723919 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca620de5-93db-46af-a870-40a74d61918c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:14.724316 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca620de5-93db-46af-a870-40a74d61918c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:14.724439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca620de5-93db-46af-a870-40a74d61918c None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:14.725097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca620de5-93db-46af-a870-40a74d61918c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:14.725404 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca620de5-93db-46af-a870-40a74d61918c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:14.726781 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca620de5-93db-46af-a870-40a74d61918c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:14.744266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 528/1067] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:14.746075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096136c-b36e-45de-b807-45772c21502f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:14.855366 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096136c-b36e-45de-b807-45772c21502f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:14.893552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccad87-ba70-45f4-a76d-d8d91b5f4445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:14.894363 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccad87-ba70-45f4-a76d-d8d91b5f4445 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:14.894702 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccad87-ba70-45f4-a76d-d8d91b5f4445 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:14.894982 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccad87-ba70-45f4-a76d-d8d91b5f4445 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:14.902438 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ccad87-ba70-45f4-a76d-d8d91b5f4445 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:14.903880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ccad87-ba70-45f4-a76d-d8d91b5f4445 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:14.915834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-d2ccad87-ba70-45f4-a76d-d8d91b5f4445 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:19:14.915834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:14.915834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:14.915834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:14.915834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:14.915834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:14.915834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:14.915834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:14.915834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:14.915834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:14.915834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:14.915834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:14.915834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:19:14.915834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:19:14.915834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:19:14.915834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:19:14.922069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:14.922069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:14.922069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:19:14.922069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:19:14.922069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:19:14.922069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:19:14.922069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:14.922069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:14.922069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:14.922069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:14.922069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:14.922069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:14.922069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:14.922069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:14.922069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:14.922069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:14.922069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:14.922069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:14.923033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:14.923033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:14.923033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:19:14.923033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:19:14.923033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:19:14.923033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:19:14.923033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:19:14.923033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:19:14.923033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:19:14.923033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:14.923033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 540/1068] 10.222.0.96 () {56 vars in 1093 bytes} [Wed Aug 24 04:19:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:19:14.925751 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca620de5-93db-46af-a870-40a74d61918c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:14.965690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccad87-ba70-45f4-a76d-d8d91b5f4445 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:14.978844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:14.994481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:15.041481 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca620de5-93db-46af-a870-40a74d61918c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:15.078025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d65e8-bc5a-4f97-8144-ebf71b24cc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:15.078642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d65e8-bc5a-4f97-8144-ebf71b24cc10 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:15.078924 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d65e8-bc5a-4f97-8144-ebf71b24cc10 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:15.079198 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d65e8-bc5a-4f97-8144-ebf71b24cc10 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:15.079938 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d65e8-bc5a-4f97-8144-ebf71b24cc10 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:15.080246 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d65e8-bc5a-4f97-8144-ebf71b24cc10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:15.081796 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d65e8-bc5a-4f97-8144-ebf71b24cc10 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:15.094953 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccad87-ba70-45f4-a76d-d8d91b5f4445 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:15.100558 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 529/1069] 10.222.0.96 () {56 vars in 1133 bytes} [Wed Aug 24 04:19:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:15.106468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d65e8-bc5a-4f97-8144-ebf71b24cc10 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:15.135481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac8845-8902-4b97-913c-1600f273770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:15.136812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac8845-8902-4b97-913c-1600f273770c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:15.137312 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac8845-8902-4b97-913c-1600f273770c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:15.137799 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac8845-8902-4b97-913c-1600f273770c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:15.152720 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac8845-8902-4b97-913c-1600f273770c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:19:15.158245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-55ac8845-8902-4b97-913c-1600f273770c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:19:15.158245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:15.158245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:15.158245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:15.158245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:15.158245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:15.158245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:15.158245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:15.158245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:15.158245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:15.158245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:15.158245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:15.158245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:19:15.158245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:19:15.158245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:19:15.158245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:19:15.159344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:19:15.159344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:19:15.159344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:19:15.159344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:19:15.159344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:15.159344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:15.159344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:15.159344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:15.159344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:15.159344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:15.159344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:15.159344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:15.159344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:15.159344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:15.159344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:15.159344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:15.161446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:15.161446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:15.161446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:15.161446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:15.161446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:19:15.161446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:19:15.161446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:19:15.161446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:19:15.161446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:19:15.161446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:19:15.161446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:19:15.161446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:15.165294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 541/1070] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:19:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:19:15.166340 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac8845-8902-4b97-913c-1600f273770c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:15.230786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d65e8-bc5a-4f97-8144-ebf71b24cc10 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:15.233225 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:15.263574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:15.269272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4b368-3027-4a72-9b8e-0384a6278e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:15.270007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4b368-3027-4a72-9b8e-0384a6278e88 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:15.270286 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4b368-3027-4a72-9b8e-0384a6278e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:15.270559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4b368-3027-4a72-9b8e-0384a6278e88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:15.280095 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac8845-8902-4b97-913c-1600f273770c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:15.280899 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4b368-3027-4a72-9b8e-0384a6278e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:15.282393 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4b368-3027-4a72-9b8e-0384a6278e88 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:15.297597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-e8d4b368-3027-4a72-9b8e-0384a6278e88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:19:15.297597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:15.297597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:15.297597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:15.297597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:15.297597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:15.297597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:15.297597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:15.297597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:15.297597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:15.297597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:15.297597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:15.297597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:19:15.297597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:19:15.297597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:19:15.297597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:19:15.299054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:15.299054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:15.299054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:15.299054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:15.299054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:15.299054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:15.299054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:15.299054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:15.299054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:15.299054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:15.299054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:15.299054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:15.299054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:15.299054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:15.299054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:15.299054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:15.299054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:19:15.301035 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:19:15.301035 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:19:15.301035 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:19:15.301035 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 530/1071] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:19:15.301035 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a28a88-8601-4a12-9edb-84e3d1ba85eb None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:15.301035 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a28a88-8601-4a12-9edb-84e3d1ba85eb None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:15.301469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a28a88-8601-4a12-9edb-84e3d1ba85eb None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:15.302402 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 531/1072] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:15.305455 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a28a88-8601-4a12-9edb-84e3d1ba85eb None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:15.320368 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c6073-b9b1-448b-a290-ca1b180e5119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:15.321009 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c6073-b9b1-448b-a290-ca1b180e5119 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:15.321289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c6073-b9b1-448b-a290-ca1b180e5119 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:15.321558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c6073-b9b1-448b-a290-ca1b180e5119 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:15.322478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c6073-b9b1-448b-a290-ca1b180e5119 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:15.322779 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c6073-b9b1-448b-a290-ca1b180e5119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:15.324132 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c6073-b9b1-448b-a290-ca1b180e5119 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:15.332996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 542/1073] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:19:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:15.334303 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bc73a-7d71-472f-ba3a-6b4214dc7a26 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:15.334587 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bc73a-7d71-472f-ba3a-6b4214dc7a26 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:15.334853 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bc73a-7d71-472f-ba3a-6b4214dc7a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:15.352302 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5e9bc73a-7d71-472f-ba3a-6b4214dc7a26 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:15.353523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5e9bc73a-7d71-472f-ba3a-6b4214dc7a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:15.413665 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a28a88-8601-4a12-9edb-84e3d1ba85eb None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:15.420247 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 543/1074] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:19:15.421119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bc73a-7d71-472f-ba3a-6b4214dc7a26 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:15.452767 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3b6ff-8093-425e-b5c9-5fef68642774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:15.453652 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3b6ff-8093-425e-b5c9-5fef68642774 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:15.453939 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3b6ff-8093-425e-b5c9-5fef68642774 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:15.454220 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3b6ff-8093-425e-b5c9-5fef68642774 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:15.454876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3b6ff-8093-425e-b5c9-5fef68642774 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:15.455343 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3b6ff-8093-425e-b5c9-5fef68642774 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:15.458125 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3b6ff-8093-425e-b5c9-5fef68642774 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:15.476320 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 532/1075] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:15.477335 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3b6ff-8093-425e-b5c9-5fef68642774 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:15.497555 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:15.501323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:15.525198 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bc73a-7d71-472f-ba3a-6b4214dc7a26 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:15.560771 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108eec25-8b31-42c7-a315-9d3778deb92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:15.561402 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108eec25-8b31-42c7-a315-9d3778deb92a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:15.561681 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108eec25-8b31-42c7-a315-9d3778deb92a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:15.561958 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108eec25-8b31-42c7-a315-9d3778deb92a None admin] PATH_INFO: `/v3/users/d205e313315a436e87607f0c4b8b4122` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:15.563104 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108eec25-8b31-42c7-a315-9d3778deb92a None admin] RBAC: Authorizing `identity:get_user(user_id=d205e313315a436e87607f0c4b8b4122)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:15.564533 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108eec25-8b31-42c7-a315-9d3778deb92a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:15.566186 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 544/1076] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:19:15 2022] GET /identity/v3/users/d205e313315a436e87607f0c4b8b4122 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:15.572239 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108eec25-8b31-42c7-a315-9d3778deb92a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:15.594220 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3b6ff-8093-425e-b5c9-5fef68642774 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:15.631851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82912704-9cfc-4d73-9010-deb253d2c8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:15.632506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82912704-9cfc-4d73-9010-deb253d2c8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:15.632812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82912704-9cfc-4d73-9010-deb253d2c8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:15.633083 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82912704-9cfc-4d73-9010-deb253d2c8a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:15.640028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82912704-9cfc-4d73-9010-deb253d2c8a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:15.641506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82912704-9cfc-4d73-9010-deb253d2c8a5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:15.653960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-82912704-9cfc-4d73-9010-deb253d2c8a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:19:15.653960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:15.653960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:15.653960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:15.653960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:15.653960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:15.653960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:15.653960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:15.653960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:15.653960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:15.653960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:15.653960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:15.653960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:19:15.653960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:19:15.653960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:19:15.654998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:19:15.654998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:15.654998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:15.654998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:15.654998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:15.654998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:15.654998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:15.654998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:15.654998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:15.654998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:15.654998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:15.654998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:15.654998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:15.654998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:15.654998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:15.654998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:15.654998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:15.655921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:19:15.655921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:19:15.655921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:19:15.655921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:19:15.655921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:19:15.655921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:19:15.655921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:19:15.655921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:19:15.662773 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 533/1077] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:19:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:19:15.668843 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82912704-9cfc-4d73-9010-deb253d2c8a5 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:15.684984 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108eec25-8b31-42c7-a315-9d3778deb92a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:15.721310 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e7deb-9a89-42cf-8f26-c8c15c52848b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:15.721935 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e7deb-9a89-42cf-8f26-c8c15c52848b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:15.722956 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e7deb-9a89-42cf-8f26-c8c15c52848b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:15.723249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e7deb-9a89-42cf-8f26-c8c15c52848b None admin] PATH_INFO: `/v3/projects/e393fa6f7b0a45d08f7c06094bd90886` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:15.724364 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e7deb-9a89-42cf-8f26-c8c15c52848b None admin] RBAC: Authorizing `identity:get_project(project_id=e393fa6f7b0a45d08f7c06094bd90886)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:15.725824 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e7deb-9a89-42cf-8f26-c8c15c52848b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:15.727448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 545/1078] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:19:15 2022] GET /identity/v3/projects/e393fa6f7b0a45d08f7c06094bd90886 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:15.729114 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e7deb-9a89-42cf-8f26-c8c15c52848b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:15.746851 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:15.753787 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:15.778770 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82912704-9cfc-4d73-9010-deb253d2c8a5 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:15.814045 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6448c25-55eb-4472-806d-a496f9c022bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:15.814651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6448c25-55eb-4472-806d-a496f9c022bd None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:15.814940 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6448c25-55eb-4472-806d-a496f9c022bd None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:15.815220 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6448c25-55eb-4472-806d-a496f9c022bd None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:15.816462 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6448c25-55eb-4472-806d-a496f9c022bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:15.817053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6448c25-55eb-4472-806d-a496f9c022bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:15.818681 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6448c25-55eb-4472-806d-a496f9c022bd None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:15.836096 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 534/1079] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:19:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:15.836972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6448c25-55eb-4472-806d-a496f9c022bd None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:15.846569 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e7deb-9a89-42cf-8f26-c8c15c52848b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:15.881454 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd38402-d372-4230-95e0-0d59d039744a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:15.882065 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd38402-d372-4230-95e0-0d59d039744a None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:15.882353 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd38402-d372-4230-95e0-0d59d039744a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:15.882629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd38402-d372-4230-95e0-0d59d039744a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:15.945470 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6448c25-55eb-4472-806d-a496f9c022bd None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:15.950974 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd38402-d372-4230-95e0-0d59d039744a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:15.952437 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd38402-d372-4230-95e0-0d59d039744a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:15.966918 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:15.983816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7a530-2c8b-4c4c-ae69-1439fcfe2afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:15.984560 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7a530-2c8b-4c4c-ae69-1439fcfe2afb None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:15.984879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7a530-2c8b-4c4c-ae69-1439fcfe2afb None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:15.985159 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7a530-2c8b-4c4c-ae69-1439fcfe2afb None admin] PATH_INFO: `/v3/projects/e393fa6f7b0a45d08f7c06094bd90886/users/d205e313315a436e87607f0c4b8b4122/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:15.987055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7a530-2c8b-4c4c-ae69-1439fcfe2afb None admin] RBAC: Authorizing `identity:create_grant(project_id=e393fa6f7b0a45d08f7c06094bd90886, user_id=d205e313315a436e87607f0c4b8b4122, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:15.988967 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7a530-2c8b-4c4c-ae69-1439fcfe2afb None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:15.992136 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:16.004505 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 535/1080] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:19:15 2022] PUT /identity/v3/projects/e393fa6f7b0a45d08f7c06094bd90886/users/d205e313315a436e87607f0c4b8b4122/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:19:16.005461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7a530-2c8b-4c4c-ae69-1439fcfe2afb None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:16.091582 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 546/1081] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:19:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:19:16.097661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd38402-d372-4230-95e0-0d59d039744a None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:16.148218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7a530-2c8b-4c4c-ae69-1439fcfe2afb None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:16.191532 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0d534-582f-4341-abf7-488c0123a6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:16.192067 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0d534-582f-4341-abf7-488c0123a6e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:16.192491 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0d534-582f-4341-abf7-488c0123a6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:16.192899 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0d534-582f-4341-abf7-488c0123a6e9 None admin] PATH_INFO: `/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/3539784b4e91472eb20addc6707dc30d/roles/e760dc89dca8425fa560d31c5a0fec8d` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:16.195301 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0d534-582f-4341-abf7-488c0123a6e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d76b6cd68a7f4613a8e921781495f256, user_id=3539784b4e91472eb20addc6707dc30d, role_id=e760dc89dca8425fa560d31c5a0fec8d)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:16.196827 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0d534-582f-4341-abf7-488c0123a6e9 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:16.212751 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 536/1082] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:19:16 2022] PUT /identity/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/3539784b4e91472eb20addc6707dc30d/roles/e760dc89dca8425fa560d31c5a0fec8d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:19:16.213968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd38402-d372-4230-95e0-0d59d039744a None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:16.230889 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:16.257493 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495807e1-b379-47b3-9baf-2aca00e0b819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:16.258145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495807e1-b379-47b3-9baf-2aca00e0b819 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:16.258422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495807e1-b379-47b3-9baf-2aca00e0b819 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:16.258690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495807e1-b379-47b3-9baf-2aca00e0b819 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:16.273032 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495807e1-b379-47b3-9baf-2aca00e0b819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:16.275271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495807e1-b379-47b3-9baf-2aca00e0b819 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:16.291888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-495807e1-b379-47b3-9baf-2aca00e0b819 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:19:16.291888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:16.291888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:16.291888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:16.291888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:16.291888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:16.291888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:16.291888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:16.291888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:16.291888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:16.291888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:16.291888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:16.291888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:19:16.291888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:19:16.291888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:19:16.291888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:19:16.292971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:16.292971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:16.292971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:16.292971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:16.292971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:16.292971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:16.292971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:16.292971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:16.292971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:16.292971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:16.292971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:16.292971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:16.292971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:16.292971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:16.292971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:16.292971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:16.292971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:19:16.293890 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:19:16.293890 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:19:16.293890 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:16.293890 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 547/1083] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:19:16.301811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0d534-582f-4341-abf7-488c0123a6e9 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:16.372791 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:16.422220 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0d534-582f-4341-abf7-488c0123a6e9 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:16.460579 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a427a-038e-4d3e-a041-ed9e570bf516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:16.461686 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a427a-038e-4d3e-a041-ed9e570bf516 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:16.461686 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a427a-038e-4d3e-a041-ed9e570bf516 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:16.461686 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a427a-038e-4d3e-a041-ed9e570bf516 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:16.462337 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a427a-038e-4d3e-a041-ed9e570bf516 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:16.462692 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a427a-038e-4d3e-a041-ed9e570bf516 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:16.464028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a427a-038e-4d3e-a041-ed9e570bf516 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:16.479774 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 537/1084] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:17.939184 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1abd52-1b75-406a-8789-6905924a238e None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:17.939736 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1abd52-1b75-406a-8789-6905924a238e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:17.939736 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1abd52-1b75-406a-8789-6905924a238e None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:17.941723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 548/1085] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:17.947454 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07666524-1ade-4eb3-827f-02f2ddb22542 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:17.947845 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07666524-1ade-4eb3-827f-02f2ddb22542 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:17.948012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07666524-1ade-4eb3-827f-02f2ddb22542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:17.966013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-07666524-1ade-4eb3-827f-02f2ddb22542 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:17.967203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-07666524-1ade-4eb3-827f-02f2ddb22542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:18.036171 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 538/1086] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:19:18.167518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85564c70-1c16-44ff-bc80-f4013f82652f None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:18.167728 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85564c70-1c16-44ff-bc80-f4013f82652f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:18.168001 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85564c70-1c16-44ff-bc80-f4013f82652f None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:18.169381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 549/1087] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:18.174653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f91288-f637-4bcd-a0d8-2dec3eed49e8 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:18.174948 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f91288-f637-4bcd-a0d8-2dec3eed49e8 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:18.175781 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f91288-f637-4bcd-a0d8-2dec3eed49e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:18.193657 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-c1f91288-f637-4bcd-a0d8-2dec3eed49e8 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:18.194852 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c1f91288-f637-4bcd-a0d8-2dec3eed49e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:18.237527 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:18.265409 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 539/1088] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:19:18.305942 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85564c70-1c16-44ff-bc80-f4013f82652f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:18.410387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85564c70-1c16-44ff-bc80-f4013f82652f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:18.444491 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e202b36-3645-45ac-b598-8c7c65ee82e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:18.445068 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e202b36-3645-45ac-b598-8c7c65ee82e4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:18.445349 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e202b36-3645-45ac-b598-8c7c65ee82e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:18.445620 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e202b36-3645-45ac-b598-8c7c65ee82e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:18.455761 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e202b36-3645-45ac-b598-8c7c65ee82e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:19:18.460968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-4e202b36-3645-45ac-b598-8c7c65ee82e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:19:18.460968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:18.460968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:18.460968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:18.460968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:18.460968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:18.460968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:18.460968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:18.460968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:18.460968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:18.460968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:18.460968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:18.460968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:19:18.460968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:19:18.460968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:19:18.460968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:19:18.462062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:19:18.462062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:19:18.462062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:19:18.462062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:19:18.462062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:18.462062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:18.462062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:18.462062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:18.462062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:18.462062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:18.462062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:18.462062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:18.462062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:18.462062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:18.462062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:18.462062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:18.463135 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:18.463135 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:18.463135 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:18.463135 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:18.463135 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:19:18.463135 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:19:18.463135 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:19:18.463135 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:19:18.463135 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:19:18.463135 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:19:18.463135 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:19:18.463135 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:18.465089 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 550/1089] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:19:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:19:18.467959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f91288-f637-4bcd-a0d8-2dec3eed49e8 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:18.542369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e202b36-3645-45ac-b598-8c7c65ee82e4 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:18.568519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:18.569526 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f91288-f637-4bcd-a0d8-2dec3eed49e8 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:18.605472 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78b225-3268-4731-bce6-85bd0a02bd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:18.606085 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78b225-3268-4731-bce6-85bd0a02bd00 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:18.606373 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78b225-3268-4731-bce6-85bd0a02bd00 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:18.606654 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78b225-3268-4731-bce6-85bd0a02bd00 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:18.607335 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78b225-3268-4731-bce6-85bd0a02bd00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:18.607646 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78b225-3268-4731-bce6-85bd0a02bd00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:18.609057 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78b225-3268-4731-bce6-85bd0a02bd00 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:18.618212 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 540/1090] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:19:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:18.623926 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78b225-3268-4731-bce6-85bd0a02bd00 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:18.644627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e202b36-3645-45ac-b598-8c7c65ee82e4 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:18.664378 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:18.679017 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdadd3f-4181-48f9-bafb-a1232ea5d2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:18.679643 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdadd3f-4181-48f9-bafb-a1232ea5d2ab None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:18.679926 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdadd3f-4181-48f9-bafb-a1232ea5d2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:18.680197 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdadd3f-4181-48f9-bafb-a1232ea5d2ab None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:18.691651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdadd3f-4181-48f9-bafb-a1232ea5d2ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:19:18.696470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-3bdadd3f-4181-48f9-bafb-a1232ea5d2ab None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:19:18.696470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:18.696470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:18.696470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:18.696470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:18.696470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:18.696470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:18.696470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:18.696470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:18.696470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:18.696470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:18.696470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:18.696470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:19:18.696470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:19:18.696470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:19:18.696470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:19:18.700970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:19:18.700970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:19:18.700970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:19:18.700970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:19:18.700970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:18.700970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:18.700970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:18.700970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:18.700970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:18.700970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:18.700970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:18.700970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:18.700970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:18.700970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:18.700970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:18.700970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:18.701825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:18.701825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:18.701825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:18.701825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:18.701825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:19:18.701825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:19:18.701825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:19:18.701825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:19:18.701825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:19:18.701825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:19:18.701825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:19:18.701825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:18.701825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 551/1091] 10.222.0.96 () {56 vars in 1120 bytes} [Wed Aug 24 04:19:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:19:18.703959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdadd3f-4181-48f9-bafb-a1232ea5d2ab None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:18.728647 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78b225-3268-4731-bce6-85bd0a02bd00 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:18.778963 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db54a0-dd47-428b-8589-00ef577caf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:18.779606 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db54a0-dd47-428b-8589-00ef577caf2b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:18.779890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db54a0-dd47-428b-8589-00ef577caf2b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:18.780167 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db54a0-dd47-428b-8589-00ef577caf2b None admin] PATH_INFO: `/v3/users/d205e313315a436e87607f0c4b8b4122` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:18.781344 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db54a0-dd47-428b-8589-00ef577caf2b None admin] RBAC: Authorizing `identity:get_user(user_id=d205e313315a436e87607f0c4b8b4122)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:18.782788 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db54a0-dd47-428b-8589-00ef577caf2b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:18.784400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 541/1092] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:19:18 2022] GET /identity/v3/users/d205e313315a436e87607f0c4b8b4122 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:18.790263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db54a0-dd47-428b-8589-00ef577caf2b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:18.794761 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:18.812283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdadd3f-4181-48f9-bafb-a1232ea5d2ab None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:18.851690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29447167-1742-46d8-a3d2-b707b174f932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:18.852300 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29447167-1742-46d8-a3d2-b707b174f932 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:18.852577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29447167-1742-46d8-a3d2-b707b174f932 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:18.852879 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29447167-1742-46d8-a3d2-b707b174f932 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:18.853539 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29447167-1742-46d8-a3d2-b707b174f932 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:18.853840 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29447167-1742-46d8-a3d2-b707b174f932 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:18.855199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29447167-1742-46d8-a3d2-b707b174f932 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:18.863407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 552/1093] 10.222.0.96 () {56 vars in 1115 bytes} [Wed Aug 24 04:19:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:18.869350 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29447167-1742-46d8-a3d2-b707b174f932 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:18.901868 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db54a0-dd47-428b-8589-00ef577caf2b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:18.909859 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:18.939314 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc156987-1d9f-4364-ab9c-47d647aa2fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:18.939917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc156987-1d9f-4364-ab9c-47d647aa2fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:18.941443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc156987-1d9f-4364-ab9c-47d647aa2fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:18.941443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc156987-1d9f-4364-ab9c-47d647aa2fa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:18.972232 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29447167-1742-46d8-a3d2-b707b174f932 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:19.007672 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb33ee9-c96a-45f9-9ca3-63b58bb32b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:19.008405 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb33ee9-c96a-45f9-9ca3-63b58bb32b5d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:19.008740 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb33ee9-c96a-45f9-9ca3-63b58bb32b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:19.009016 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb33ee9-c96a-45f9-9ca3-63b58bb32b5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:19.015308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc156987-1d9f-4364-ab9c-47d647aa2fa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:19.016811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc156987-1d9f-4364-ab9c-47d647aa2fa2 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:19.020504 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb33ee9-c96a-45f9-9ca3-63b58bb32b5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:19.021970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb33ee9-c96a-45f9-9ca3-63b58bb32b5d None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:19.028231 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:19.036891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-7bb33ee9-c96a-45f9-9ca3-63b58bb32b5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:19:19.036891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:19.036891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:19.036891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:19.036891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:19.036891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:19.036891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:19.036891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:19.036891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:19.036891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:19.036891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:19.036891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:19.036891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:19:19.036891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:19:19.036891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:19:19.036891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:19:19.038042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:19.038042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:19.038042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:19.038042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:19.038042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:19.038042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:19.038042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:19.038042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:19.038042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:19.038042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:19.038042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:19.038042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:19.038042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:19.038042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:19.038042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:19.038042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:19.038042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:19:19.038961 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:19:19.038961 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:19:19.038961 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:19.038961 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 553/1094] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:19:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:19:19.044521 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb33ee9-c96a-45f9-9ca3-63b58bb32b5d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:19.125851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 542/1095] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:19:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 04:19:19.132301 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc156987-1d9f-4364-ab9c-47d647aa2fa2 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:19.139914 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:19.154430 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb33ee9-c96a-45f9-9ca3-63b58bb32b5d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:19.189397 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e076d-7706-452f-a3c3-02fcf1f514cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:19.190004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e076d-7706-452f-a3c3-02fcf1f514cc None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:19.190292 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e076d-7706-452f-a3c3-02fcf1f514cc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:19.190575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e076d-7706-452f-a3c3-02fcf1f514cc None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:19.191787 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e076d-7706-452f-a3c3-02fcf1f514cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:19.192097 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e076d-7706-452f-a3c3-02fcf1f514cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:19.193498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e076d-7706-452f-a3c3-02fcf1f514cc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:19.206099 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 554/1096] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:19.211864 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e076d-7706-452f-a3c3-02fcf1f514cc None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:19.235600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc156987-1d9f-4364-ab9c-47d647aa2fa2 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:19.271185 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864249fe-f031-47b4-b43e-9cb1077ca211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:19.271820 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864249fe-f031-47b4-b43e-9cb1077ca211 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:19.272178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864249fe-f031-47b4-b43e-9cb1077ca211 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:19.272379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864249fe-f031-47b4-b43e-9cb1077ca211 None admin] PATH_INFO: `/v3/projects/e393fa6f7b0a45d08f7c06094bd90886` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:19.273445 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:19.273558 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864249fe-f031-47b4-b43e-9cb1077ca211 None admin] RBAC: Authorizing `identity:get_project(project_id=e393fa6f7b0a45d08f7c06094bd90886)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:19.275062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864249fe-f031-47b4-b43e-9cb1077ca211 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:19.276819 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 543/1097] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:19:19 2022] GET /identity/v3/projects/e393fa6f7b0a45d08f7c06094bd90886 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:19.282661 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864249fe-f031-47b4-b43e-9cb1077ca211 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:19.319533 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e076d-7706-452f-a3c3-02fcf1f514cc None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:19.354141 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3727df4-bc32-442d-832d-6b2ea4ad35bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:19.354777 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3727df4-bc32-442d-832d-6b2ea4ad35bc None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:19.355058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3727df4-bc32-442d-832d-6b2ea4ad35bc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:19.355339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3727df4-bc32-442d-832d-6b2ea4ad35bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:19.358310 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:19.362459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3727df4-bc32-442d-832d-6b2ea4ad35bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:19.364534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3727df4-bc32-442d-832d-6b2ea4ad35bc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:19.376964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-a3727df4-bc32-442d-832d-6b2ea4ad35bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:19:19.376964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:19.376964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:19.376964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:19.376964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:19.376964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:19.376964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:19.376964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:19.376964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:19.376964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:19.376964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:19.376964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:19.376964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:19:19.376964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:19:19.376964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:19:19.376964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:19:19.378048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:19.378048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:19.378048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:19:19.378048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:19:19.378048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:19:19.378048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:19:19.378048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:19.378048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:19.378048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:19.378048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:19.378048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:19.378048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:19.378048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:19.378048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:19.378048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:19.378048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:19.378048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:19.378048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:19.386355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:19.386355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:19.386355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:19:19.386355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:19:19.386355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:19:19.386355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:19:19.386355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:19:19.386355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:19:19.386355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:19:19.386355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:19.386355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 555/1098] 10.222.0.96 () {56 vars in 1093 bytes} [Wed Aug 24 04:19:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:19:19.387012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864249fe-f031-47b4-b43e-9cb1077ca211 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:19.387092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3727df4-bc32-442d-832d-6b2ea4ad35bc None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:19.421108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652ecf4-1ef0-47c7-b25a-facf71d04ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:19.421707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652ecf4-1ef0-47c7-b25a-facf71d04ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:19.421990 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652ecf4-1ef0-47c7-b25a-facf71d04ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:19.422257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652ecf4-1ef0-47c7-b25a-facf71d04ea1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:19.422986 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652ecf4-1ef0-47c7-b25a-facf71d04ea1 None admin] RBAC: Adding query filter params (role.id=059d2bf5bb8e42939f5f826bfdad6a21, scope.project.id=e393fa6f7b0a45d08f7c06094bd90886, user.id=d205e313315a436e87607f0c4b8b4122) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:19.423293 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652ecf4-1ef0-47c7-b25a-facf71d04ea1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:19.424785 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652ecf4-1ef0-47c7-b25a-facf71d04ea1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:19.431666 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 544/1099] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:19:19 2022] GET /identity/v3/role_assignments?user.id=d205e313315a436e87607f0c4b8b4122&scope.project.id=e393fa6f7b0a45d08f7c06094bd90886&role.id=059d2bf5bb8e42939f5f826bfdad6a21 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:19.498078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3727df4-bc32-442d-832d-6b2ea4ad35bc None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:19.518004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:19.536968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edaa38-ee89-42ee-a517-ba123c7ea86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:19.537591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edaa38-ee89-42ee-a517-ba123c7ea86c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:19.537875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edaa38-ee89-42ee-a517-ba123c7ea86c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:19.538152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edaa38-ee89-42ee-a517-ba123c7ea86c None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:19.538911 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edaa38-ee89-42ee-a517-ba123c7ea86c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:19.539223 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edaa38-ee89-42ee-a517-ba123c7ea86c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:19.540678 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edaa38-ee89-42ee-a517-ba123c7ea86c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:19.560075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 556/1100] 10.222.0.96 () {56 vars in 1133 bytes} [Wed Aug 24 04:19:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:19.566783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652ecf4-1ef0-47c7-b25a-facf71d04ea1 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:19.671684 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652ecf4-1ef0-47c7-b25a-facf71d04ea1 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:19.711714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ede9c-92b2-459e-bf90-d1cab1444d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:19.712330 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ede9c-92b2-459e-bf90-d1cab1444d96 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:19.712613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ede9c-92b2-459e-bf90-d1cab1444d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:19.712914 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ede9c-92b2-459e-bf90-d1cab1444d96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:19.721833 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:19.782301 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ede9c-92b2-459e-bf90-d1cab1444d96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:19.783678 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ede9c-92b2-459e-bf90-d1cab1444d96 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:19.884323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 545/1101] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:19:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:19:19.890105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edaa38-ee89-42ee-a517-ba123c7ea86c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:19.992386 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edaa38-ee89-42ee-a517-ba123c7ea86c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:20.026848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa29846-e8ed-4ecc-b9bb-c8dfcacfb692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:20.027476 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa29846-e8ed-4ecc-b9bb-c8dfcacfb692 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:20.027759 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa29846-e8ed-4ecc-b9bb-c8dfcacfb692 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:20.028026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa29846-e8ed-4ecc-b9bb-c8dfcacfb692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:20.037917 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa29846-e8ed-4ecc-b9bb-c8dfcacfb692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:20.039284 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa29846-e8ed-4ecc-b9bb-c8dfcacfb692 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:20.053950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-6fa29846-e8ed-4ecc-b9bb-c8dfcacfb692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:19:20.053950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:20.053950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:20.053950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:20.053950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:20.053950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:20.053950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:20.053950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:20.053950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:20.053950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:20.053950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:20.053950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:20.053950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:19:20.053950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:19:20.053950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:19:20.053950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:19:20.054940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:20.054940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:20.054940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:20.054940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:20.054940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:20.054940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:20.054940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:20.054940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:20.054940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:20.054940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:20.054940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:20.054940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:20.054940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:20.054940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:20.054940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:20.054940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:20.054940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:19:20.055859 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:19:20.055859 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:19:20.055859 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:20.055859 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 557/1102] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:19:20.060767 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ede9c-92b2-459e-bf90-d1cab1444d96 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:20.101547 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:20.166921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ede9c-92b2-459e-bf90-d1cab1444d96 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:20.202021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d03503-a9b7-4b5b-be69-22c5b1bce44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:20.202626 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d03503-a9b7-4b5b-be69-22c5b1bce44e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:20.202904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d03503-a9b7-4b5b-be69-22c5b1bce44e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:20.203174 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d03503-a9b7-4b5b-be69-22c5b1bce44e None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:20.203802 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d03503-a9b7-4b5b-be69-22c5b1bce44e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:20.204108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d03503-a9b7-4b5b-be69-22c5b1bce44e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:20.205501 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d03503-a9b7-4b5b-be69-22c5b1bce44e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:20.217484 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 546/1103] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:20.223467 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa29846-e8ed-4ecc-b9bb-c8dfcacfb692 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:20.251248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:20.322499 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa29846-e8ed-4ecc-b9bb-c8dfcacfb692 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:20.355966 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3d9f2-2500-479e-bc1a-69fbdda8d665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:20.356590 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3d9f2-2500-479e-bc1a-69fbdda8d665 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:20.356905 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3d9f2-2500-479e-bc1a-69fbdda8d665 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:20.357176 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3d9f2-2500-479e-bc1a-69fbdda8d665 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:20.364567 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3d9f2-2500-479e-bc1a-69fbdda8d665 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:20.366074 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3d9f2-2500-479e-bc1a-69fbdda8d665 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:20.377137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-9cb3d9f2-2500-479e-bc1a-69fbdda8d665 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:19:20.377137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:20.377137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:20.377137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:20.377137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:20.377137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:20.377137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:20.377137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:20.377137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:20.377137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:20.377137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:20.377137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:20.377137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:19:20.377137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:19:20.377137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:19:20.378145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:19:20.378145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:20.378145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:20.378145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:20.378145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:20.378145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:20.378145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:20.378145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:20.378145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:20.378145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:20.378145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:20.378145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:20.378145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:20.378145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:20.378145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:20.378145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:20.378145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:20.379148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:19:20.379148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:19:20.379148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:19:20.379148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:19:20.379148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:19:20.379148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:19:20.379148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:19:20.379148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:20.379612 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 558/1104] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:19:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:19:20.384312 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d03503-a9b7-4b5b-be69-22c5b1bce44e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:20.495595 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:20.499731 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d03503-a9b7-4b5b-be69-22c5b1bce44e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:20.536216 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefd4fd-b3ce-4b4a-92ee-508334e1ce43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:20.536950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefd4fd-b3ce-4b4a-92ee-508334e1ce43 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:20.537280 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefd4fd-b3ce-4b4a-92ee-508334e1ce43 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:20.537610 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefd4fd-b3ce-4b4a-92ee-508334e1ce43 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:20.538417 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefd4fd-b3ce-4b4a-92ee-508334e1ce43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:20.538727 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefd4fd-b3ce-4b4a-92ee-508334e1ce43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:20.540411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefd4fd-b3ce-4b4a-92ee-508334e1ce43 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:20.556403 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 547/1105] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:19:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:20.562642 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3d9f2-2500-479e-bc1a-69fbdda8d665 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:20.655651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:20.668932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3d9f2-2500-479e-bc1a-69fbdda8d665 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:20.702975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bb31f-68ee-4a10-b86a-ab4e3ce15614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:20.703571 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bb31f-68ee-4a10-b86a-ab4e3ce15614 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:20.703848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bb31f-68ee-4a10-b86a-ab4e3ce15614 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:20.704117 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bb31f-68ee-4a10-b86a-ab4e3ce15614 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:20.704866 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bb31f-68ee-4a10-b86a-ab4e3ce15614 None admin] RBAC: Adding query filter params (role.id=e760dc89dca8425fa560d31c5a0fec8d, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=3539784b4e91472eb20addc6707dc30d) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:20.705177 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bb31f-68ee-4a10-b86a-ab4e3ce15614 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:20.707340 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bb31f-68ee-4a10-b86a-ab4e3ce15614 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:20.713334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 559/1106] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:19:20 2022] GET /identity/v3/role_assignments?user.id=3539784b4e91472eb20addc6707dc30d&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=e760dc89dca8425fa560d31c5a0fec8d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:21.419127 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8fa92-34a6-469c-854e-3c98a68a170d None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:21.419666 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8fa92-34a6-469c-854e-3c98a68a170d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:21.419666 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8fa92-34a6-469c-854e-3c98a68a170d None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:21.421110 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 548/1107] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:21.427204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4475f-f4e8-4b22-974e-d0606002fd10 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:21.427695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4475f-f4e8-4b22-974e-d0606002fd10 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:21.427785 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4475f-f4e8-4b22-974e-d0606002fd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:21.447963 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-26f4475f-f4e8-4b22-974e-d0606002fd10 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:21.449245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-26f4475f-f4e8-4b22-974e-d0606002fd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:21.522144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 560/1108] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:19:21.796384 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8fa92-34a6-469c-854e-3c98a68a170d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:21.900961 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8fa92-34a6-469c-854e-3c98a68a170d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:21.934887 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd259907-4643-45b9-a6d0-a146d3635604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:21.935513 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd259907-4643-45b9-a6d0-a146d3635604 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:21.935803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd259907-4643-45b9-a6d0-a146d3635604 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:21.936082 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd259907-4643-45b9-a6d0-a146d3635604 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:21.937232 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd259907-4643-45b9-a6d0-a146d3635604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:21.938666 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd259907-4643-45b9-a6d0-a146d3635604 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:21.940239 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 549/1109] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:19:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:21.946331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4475f-f4e8-4b22-974e-d0606002fd10 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:22.026122 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:22.044400 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4475f-f4e8-4b22-974e-d0606002fd10 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:22.077862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57a7b6-b9fc-4a34-9aa8-52c265c5d89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:22.078460 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57a7b6-b9fc-4a34-9aa8-52c265c5d89a None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:22.078742 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57a7b6-b9fc-4a34-9aa8-52c265c5d89a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:22.079016 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57a7b6-b9fc-4a34-9aa8-52c265c5d89a None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:22.079657 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57a7b6-b9fc-4a34-9aa8-52c265c5d89a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:22.081115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57a7b6-b9fc-4a34-9aa8-52c265c5d89a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:22.103801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 561/1110] 10.222.0.96 () {60 vars in 1132 bytes} [Wed Aug 24 04:19:21 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:19:24.055813 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd07be-0923-4e32-a6a1-629c7d8c71f0 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:24.056355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd07be-0923-4e32-a6a1-629c7d8c71f0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:24.056355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd07be-0923-4e32-a6a1-629c7d8c71f0 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:24.057753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 550/1111] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:24.062831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcf338-940b-498a-8dda-b155ff0480b7 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:24.063249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcf338-940b-498a-8dda-b155ff0480b7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:24.063375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcf338-940b-498a-8dda-b155ff0480b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:24.081393 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ecdcf338-940b-498a-8dda-b155ff0480b7 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:24.082737 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ecdcf338-940b-498a-8dda-b155ff0480b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:24.147861 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 562/1112] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:19:24.420793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd07be-0923-4e32-a6a1-629c7d8c71f0 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:24.448831 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:24.524851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd07be-0923-4e32-a6a1-629c7d8c71f0 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:24.558446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60730cb-f513-4b7f-8f68-f5e0a83ed543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:24.559069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60730cb-f513-4b7f-8f68-f5e0a83ed543 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:24.559352 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60730cb-f513-4b7f-8f68-f5e0a83ed543 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:24.559625 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60730cb-f513-4b7f-8f68-f5e0a83ed543 None admin] PATH_INFO: `/v3/roles/b78ed83a66fe4531900cc02bb745f80f` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:24.561051 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60730cb-f513-4b7f-8f68-f5e0a83ed543 None admin] RBAC: Authorizing `identity:get_role(role_id=b78ed83a66fe4531900cc02bb745f80f)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:24.562416 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60730cb-f513-4b7f-8f68-f5e0a83ed543 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:24.563733 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 551/1113] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:19:24 2022] GET /identity/v3/roles/b78ed83a66fe4531900cc02bb745f80f => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:24.570112 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcf338-940b-498a-8dda-b155ff0480b7 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:24.633700 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:24.672016 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcf338-940b-498a-8dda-b155ff0480b7 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:24.706330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d4316-22e0-48fe-88d0-06e0455f4ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:24.706978 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d4316-22e0-48fe-88d0-06e0455f4ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:24.707268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d4316-22e0-48fe-88d0-06e0455f4ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:24.707545 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d4316-22e0-48fe-88d0-06e0455f4ab0 None admin] PATH_INFO: `/v3/users/30d115d3fd714d69a38c9271567b1cb2` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:24.720200 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d4316-22e0-48fe-88d0-06e0455f4ab0 None admin] RBAC: Authorizing `identity:get_user(user_id=30d115d3fd714d69a38c9271567b1cb2)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:24.721674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d4316-22e0-48fe-88d0-06e0455f4ab0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:24.723315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 563/1114] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:19:24 2022] GET /identity/v3/users/30d115d3fd714d69a38c9271567b1cb2 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:24.730545 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60730cb-f513-4b7f-8f68-f5e0a83ed543 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:24.823728 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:24.832496 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60730cb-f513-4b7f-8f68-f5e0a83ed543 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:24.867861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc9284-882c-4fe0-a269-abea9b2f8cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:24.868467 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc9284-882c-4fe0-a269-abea9b2f8cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:24.868782 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc9284-882c-4fe0-a269-abea9b2f8cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:24.869060 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc9284-882c-4fe0-a269-abea9b2f8cf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:24.936188 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc9284-882c-4fe0-a269-abea9b2f8cf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:24.937593 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc9284-882c-4fe0-a269-abea9b2f8cf8 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:25.026526 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:25.034031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 552/1115] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:19:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:19:25.040662 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d4316-22e0-48fe-88d0-06e0455f4ab0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:25.139561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d4316-22e0-48fe-88d0-06e0455f4ab0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:25.165412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:25.174424 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086c29c-66c6-4b32-ad86-dedfd51eb3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:25.175127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086c29c-66c6-4b32-ad86-dedfd51eb3bd None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:25.175452 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086c29c-66c6-4b32-ad86-dedfd51eb3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:25.175731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086c29c-66c6-4b32-ad86-dedfd51eb3bd None admin] PATH_INFO: `/v3/projects/e393fa6f7b0a45d08f7c06094bd90886` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:25.176886 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086c29c-66c6-4b32-ad86-dedfd51eb3bd None admin] RBAC: Authorizing `identity:get_project(project_id=e393fa6f7b0a45d08f7c06094bd90886)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:25.178313 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086c29c-66c6-4b32-ad86-dedfd51eb3bd None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:25.179955 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 564/1116] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:19:25 2022] GET /identity/v3/projects/e393fa6f7b0a45d08f7c06094bd90886 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:25.186833 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc9284-882c-4fe0-a269-abea9b2f8cf8 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:25.289459 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc9284-882c-4fe0-a269-abea9b2f8cf8 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:25.325220 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c804a2-020b-41a9-9bb8-9e6abcd21830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:25.325848 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c804a2-020b-41a9-9bb8-9e6abcd21830 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:25.326127 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c804a2-020b-41a9-9bb8-9e6abcd21830 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:25.326398 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c804a2-020b-41a9-9bb8-9e6abcd21830 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:25.327134 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c804a2-020b-41a9-9bb8-9e6abcd21830 None admin] RBAC: Adding query filter params (role.id=b78ed83a66fe4531900cc02bb745f80f, scope.project.id=e393fa6f7b0a45d08f7c06094bd90886, user.id=30d115d3fd714d69a38c9271567b1cb2) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:25.327427 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c804a2-020b-41a9-9bb8-9e6abcd21830 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:25.329175 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c804a2-020b-41a9-9bb8-9e6abcd21830 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:25.335525 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 553/1117] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:19:25 2022] GET /identity/v3/role_assignments?user.id=30d115d3fd714d69a38c9271567b1cb2&scope.project.id=e393fa6f7b0a45d08f7c06094bd90886&role.id=b78ed83a66fe4531900cc02bb745f80f => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:27.225055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982e556-79e3-453b-b34e-02cf0914c0ba None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:27.230144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982e556-79e3-453b-b34e-02cf0914c0ba None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:27.230144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982e556-79e3-453b-b34e-02cf0914c0ba None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:27.230144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 565/1118] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:27.234299 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317d5f9-74f6-4828-808f-fbbb38de18d9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:27.234710 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317d5f9-74f6-4828-808f-fbbb38de18d9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:27.234875 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317d5f9-74f6-4828-808f-fbbb38de18d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:27.253459 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d317d5f9-74f6-4828-808f-fbbb38de18d9 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:27.254667 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d317d5f9-74f6-4828-808f-fbbb38de18d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:27.307320 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:27.321656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 554/1119] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:19:27.591015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982e556-79e3-453b-b34e-02cf0914c0ba None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:27.690771 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982e556-79e3-453b-b34e-02cf0914c0ba None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:27.724824 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c921a7-3f4d-4fed-b391-065a396f7c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:27.725446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c921a7-3f4d-4fed-b391-065a396f7c85 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:27.725728 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c921a7-3f4d-4fed-b391-065a396f7c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:27.726002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c921a7-3f4d-4fed-b391-065a396f7c85 None admin] PATH_INFO: `/v3/roles/b78ed83a66fe4531900cc02bb745f80f` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:27.727486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c921a7-3f4d-4fed-b391-065a396f7c85 None admin] RBAC: Authorizing `identity:get_role(role_id=b78ed83a66fe4531900cc02bb745f80f)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:27.728882 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c921a7-3f4d-4fed-b391-065a396f7c85 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:27.730195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 566/1120] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:19:27 2022] GET /identity/v3/roles/b78ed83a66fe4531900cc02bb745f80f => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:27.736075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317d5f9-74f6-4828-808f-fbbb38de18d9 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:27.849634 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317d5f9-74f6-4828-808f-fbbb38de18d9 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:27.883370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8e654-55b1-4fed-abc5-6ba2ccdb84ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:27.883998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8e654-55b1-4fed-abc5-6ba2ccdb84ff None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:27.884281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8e654-55b1-4fed-abc5-6ba2ccdb84ff None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:27.884559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8e654-55b1-4fed-abc5-6ba2ccdb84ff None admin] PATH_INFO: `/v3/users/30d115d3fd714d69a38c9271567b1cb2` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:27.885702 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8e654-55b1-4fed-abc5-6ba2ccdb84ff None admin] RBAC: Authorizing `identity:get_user(user_id=30d115d3fd714d69a38c9271567b1cb2)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:27.887134 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8e654-55b1-4fed-abc5-6ba2ccdb84ff None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:27.888745 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 555/1121] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:19:27 2022] GET /identity/v3/users/30d115d3fd714d69a38c9271567b1cb2 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:27.895139 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c921a7-3f4d-4fed-b391-065a396f7c85 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:27.956911 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:27.995553 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c921a7-3f4d-4fed-b391-065a396f7c85 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:28.029294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b039b6-4913-4034-8c5b-9f91982c7866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:28.029914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b039b6-4913-4034-8c5b-9f91982c7866 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:28.030198 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b039b6-4913-4034-8c5b-9f91982c7866 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:28.030475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b039b6-4913-4034-8c5b-9f91982c7866 None admin] PATH_INFO: `/v3/projects/e393fa6f7b0a45d08f7c06094bd90886` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:28.031588 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b039b6-4913-4034-8c5b-9f91982c7866 None admin] RBAC: Authorizing `identity:get_project(project_id=e393fa6f7b0a45d08f7c06094bd90886)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:28.033046 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b039b6-4913-4034-8c5b-9f91982c7866 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:28.034823 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 567/1122] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:19:27 2022] GET /identity/v3/projects/e393fa6f7b0a45d08f7c06094bd90886 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:28.041000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8e654-55b1-4fed-abc5-6ba2ccdb84ff None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:28.097545 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:28.140563 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8e654-55b1-4fed-abc5-6ba2ccdb84ff None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:28.174080 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c0a1f-3181-479d-85b9-aec86b6164ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:28.174737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c0a1f-3181-479d-85b9-aec86b6164ed None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:28.175638 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c0a1f-3181-479d-85b9-aec86b6164ed None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:28.175882 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c0a1f-3181-479d-85b9-aec86b6164ed None admin] PATH_INFO: `/v3/projects/e393fa6f7b0a45d08f7c06094bd90886/users/30d115d3fd714d69a38c9271567b1cb2/roles/b78ed83a66fe4531900cc02bb745f80f` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:28.178095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c0a1f-3181-479d-85b9-aec86b6164ed None admin] RBAC: Authorizing `identity:create_grant(project_id=e393fa6f7b0a45d08f7c06094bd90886, user_id=30d115d3fd714d69a38c9271567b1cb2, role_id=b78ed83a66fe4531900cc02bb745f80f)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:28.179533 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c0a1f-3181-479d-85b9-aec86b6164ed None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:28.192741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 556/1123] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:19:28 2022] PUT /identity/v3/projects/e393fa6f7b0a45d08f7c06094bd90886/users/30d115d3fd714d69a38c9271567b1cb2/roles/b78ed83a66fe4531900cc02bb745f80f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:19:30.080880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9422e1-e88c-4afb-b14d-43522da10204 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:30.081409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9422e1-e88c-4afb-b14d-43522da10204 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:30.081409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9422e1-e88c-4afb-b14d-43522da10204 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:30.082744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 568/1124] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:30.088137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a020aa4-73ab-40b2-a6ab-f7ea1f6adde1 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:30.088545 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a020aa4-73ab-40b2-a6ab-f7ea1f6adde1 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:30.088721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a020aa4-73ab-40b2-a6ab-f7ea1f6adde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:30.106939 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4a020aa4-73ab-40b2-a6ab-f7ea1f6adde1 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:30.108132 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4a020aa4-73ab-40b2-a6ab-f7ea1f6adde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:30.174643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 557/1125] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:19:30.443949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9422e1-e88c-4afb-b14d-43522da10204 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:30.544910 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9422e1-e88c-4afb-b14d-43522da10204 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:30.573061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:30.579147 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643dbc7-33ba-4830-b83d-78d419f69bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:30.579779 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643dbc7-33ba-4830-b83d-78d419f69bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:30.580056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643dbc7-33ba-4830-b83d-78d419f69bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:30.580336 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643dbc7-33ba-4830-b83d-78d419f69bb3 None admin] PATH_INFO: `/v3/roles/b78ed83a66fe4531900cc02bb745f80f` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:30.582269 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643dbc7-33ba-4830-b83d-78d419f69bb3 None admin] RBAC: Authorizing `identity:get_role(role_id=b78ed83a66fe4531900cc02bb745f80f)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:30.583646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643dbc7-33ba-4830-b83d-78d419f69bb3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:30.585003 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 569/1126] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:19:30 2022] GET /identity/v3/roles/b78ed83a66fe4531900cc02bb745f80f => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:30.592852 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a020aa4-73ab-40b2-a6ab-f7ea1f6adde1 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:30.639988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:30.693824 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a020aa4-73ab-40b2-a6ab-f7ea1f6adde1 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:30.728632 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04891385-f062-403c-9758-f10f09dd4c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:30.729228 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04891385-f062-403c-9758-f10f09dd4c58 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:30.729509 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04891385-f062-403c-9758-f10f09dd4c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:30.729787 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04891385-f062-403c-9758-f10f09dd4c58 None admin] PATH_INFO: `/v3/users/30d115d3fd714d69a38c9271567b1cb2` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:30.731103 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04891385-f062-403c-9758-f10f09dd4c58 None admin] RBAC: Authorizing `identity:get_user(user_id=30d115d3fd714d69a38c9271567b1cb2)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:30.732537 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04891385-f062-403c-9758-f10f09dd4c58 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:30.734161 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 558/1127] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:19:30 2022] GET /identity/v3/users/30d115d3fd714d69a38c9271567b1cb2 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:30.740179 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643dbc7-33ba-4830-b83d-78d419f69bb3 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:30.842937 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643dbc7-33ba-4830-b83d-78d419f69bb3 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:30.877988 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dceb58d-facd-4b0b-90cb-8631c6bb9be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:30.879309 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dceb58d-facd-4b0b-90cb-8631c6bb9be4 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:30.879593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dceb58d-facd-4b0b-90cb-8631c6bb9be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:30.879873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dceb58d-facd-4b0b-90cb-8631c6bb9be4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:30.950537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:30.953774 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dceb58d-facd-4b0b-90cb-8631c6bb9be4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:30.955830 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dceb58d-facd-4b0b-90cb-8631c6bb9be4 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:31.052792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 570/1128] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:19:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:19:31.058673 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04891385-f062-403c-9758-f10f09dd4c58 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:31.159723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04891385-f062-403c-9758-f10f09dd4c58 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:31.173803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:31.196839 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ea12f-9297-4434-b1b3-5385cbcf7bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:31.197744 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ea12f-9297-4434-b1b3-5385cbcf7bff None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:31.198035 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ea12f-9297-4434-b1b3-5385cbcf7bff None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:31.198318 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ea12f-9297-4434-b1b3-5385cbcf7bff None admin] PATH_INFO: `/v3/projects/e393fa6f7b0a45d08f7c06094bd90886` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:31.199457 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ea12f-9297-4434-b1b3-5385cbcf7bff None admin] RBAC: Authorizing `identity:get_project(project_id=e393fa6f7b0a45d08f7c06094bd90886)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:31.200933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ea12f-9297-4434-b1b3-5385cbcf7bff None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:31.202595 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 559/1129] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:19:31 2022] GET /identity/v3/projects/e393fa6f7b0a45d08f7c06094bd90886 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:31.209298 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dceb58d-facd-4b0b-90cb-8631c6bb9be4 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:31.304339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:31.308574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dceb58d-facd-4b0b-90cb-8631c6bb9be4 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:31.342591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60393032-3cc3-4a90-baa7-68a3780a994f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:31.343188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60393032-3cc3-4a90-baa7-68a3780a994f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:31.343470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60393032-3cc3-4a90-baa7-68a3780a994f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:31.343742 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60393032-3cc3-4a90-baa7-68a3780a994f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:31.344454 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60393032-3cc3-4a90-baa7-68a3780a994f None admin] RBAC: Adding query filter params (role.id=b78ed83a66fe4531900cc02bb745f80f, scope.project.id=e393fa6f7b0a45d08f7c06094bd90886, user.id=30d115d3fd714d69a38c9271567b1cb2) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:31.344788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60393032-3cc3-4a90-baa7-68a3780a994f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:31.346220 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60393032-3cc3-4a90-baa7-68a3780a994f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:31.351831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 571/1130] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:19:31 2022] GET /identity/v3/role_assignments?user.id=30d115d3fd714d69a38c9271567b1cb2&scope.project.id=e393fa6f7b0a45d08f7c06094bd90886&role.id=b78ed83a66fe4531900cc02bb745f80f => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:33.290137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44161545-47d4-443e-8332-54f1ccef8c08 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:33.290642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44161545-47d4-443e-8332-54f1ccef8c08 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:33.290642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44161545-47d4-443e-8332-54f1ccef8c08 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:33.291950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 560/1131] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:33.297731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182599-2cef-4c71-b643-6fd73cf15f9f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:33.298147 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182599-2cef-4c71-b643-6fd73cf15f9f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:33.298347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182599-2cef-4c71-b643-6fd73cf15f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:33.323851 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ad182599-2cef-4c71-b643-6fd73cf15f9f None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:33.325653 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ad182599-2cef-4c71-b643-6fd73cf15f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:33.418079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 572/1132] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:19:33.685273 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44161545-47d4-443e-8332-54f1ccef8c08 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:33.787674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44161545-47d4-443e-8332-54f1ccef8c08 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:33.827523 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387dd85-b103-49e9-a6fd-d1de2a9aa285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:33.828238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387dd85-b103-49e9-a6fd-d1de2a9aa285 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:33.828569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387dd85-b103-49e9-a6fd-d1de2a9aa285 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:33.828900 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387dd85-b103-49e9-a6fd-d1de2a9aa285 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:33.830125 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387dd85-b103-49e9-a6fd-d1de2a9aa285 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:33.832593 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387dd85-b103-49e9-a6fd-d1de2a9aa285 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:33.834533 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 561/1133] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:19:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:33.840702 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad182599-2cef-4c71-b643-6fd73cf15f9f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:33.929343 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:33.938360 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad182599-2cef-4c71-b643-6fd73cf15f9f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:33.972936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09a33f-6427-427c-b140-d01c36bcf19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:33.973532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09a33f-6427-427c-b140-d01c36bcf19a None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:33.973810 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09a33f-6427-427c-b140-d01c36bcf19a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:33.974081 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09a33f-6427-427c-b140-d01c36bcf19a None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:33.974721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09a33f-6427-427c-b140-d01c36bcf19a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:33.976139 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09a33f-6427-427c-b140-d01c36bcf19a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:34.001945 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 573/1134] 10.222.0.96 () {60 vars in 1141 bytes} [Wed Aug 24 04:19:33 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:19:35.978340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4e63d-01c4-4af2-af47-e98579af1214 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:35.978855 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4e63d-01c4-4af2-af47-e98579af1214 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:35.978971 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4e63d-01c4-4af2-af47-e98579af1214 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:35.980246 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 562/1135] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:35.985670 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012d2e4-0180-4ddd-923f-8529ba5a21f3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:35.986063 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012d2e4-0180-4ddd-923f-8529ba5a21f3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:35.986238 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012d2e4-0180-4ddd-923f-8529ba5a21f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:36.006055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c012d2e4-0180-4ddd-923f-8529ba5a21f3 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:36.007254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c012d2e4-0180-4ddd-923f-8529ba5a21f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:36.073205 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 574/1136] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:19:36.361343 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4e63d-01c4-4af2-af47-e98579af1214 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:36.414256 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:36.465013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4e63d-01c4-4af2-af47-e98579af1214 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:36.499248 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084d6f3-0b2d-4473-91cb-336ad9dc8863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:36.499874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084d6f3-0b2d-4473-91cb-336ad9dc8863 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:36.500164 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084d6f3-0b2d-4473-91cb-336ad9dc8863 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:36.500440 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084d6f3-0b2d-4473-91cb-336ad9dc8863 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:36.501585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084d6f3-0b2d-4473-91cb-336ad9dc8863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:36.503463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084d6f3-0b2d-4473-91cb-336ad9dc8863 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:36.505540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 563/1137] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:19:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:36.511334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012d2e4-0180-4ddd-923f-8529ba5a21f3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:36.590069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:36.616285 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012d2e4-0180-4ddd-923f-8529ba5a21f3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:36.649665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b40362-a061-41f7-b95d-cc49ecdf3c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:36.650271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b40362-a061-41f7-b95d-cc49ecdf3c91 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:36.650555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b40362-a061-41f7-b95d-cc49ecdf3c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:36.650833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b40362-a061-41f7-b95d-cc49ecdf3c91 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:36.651475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b40362-a061-41f7-b95d-cc49ecdf3c91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:36.652934 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b40362-a061-41f7-b95d-cc49ecdf3c91 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:36.673806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 575/1138] 10.222.0.96 () {60 vars in 1132 bytes} [Wed Aug 24 04:19:36 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:19:38.630795 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaf616-d46d-4063-acb8-3c4d2db4e8f8 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:38.631349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaf616-d46d-4063-acb8-3c4d2db4e8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:38.631349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaf616-d46d-4063-acb8-3c4d2db4e8f8 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:38.632714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 564/1139] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:38.637837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9417c60-c9a8-4f42-bd0a-60555242cc91 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:38.638235 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9417c60-c9a8-4f42-bd0a-60555242cc91 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:38.638385 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9417c60-c9a8-4f42-bd0a-60555242cc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:38.656759 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b9417c60-c9a8-4f42-bd0a-60555242cc91 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:38.657945 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b9417c60-c9a8-4f42-bd0a-60555242cc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:38.724405 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 576/1140] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:19:38.996672 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaaf616-d46d-4063-acb8-3c4d2db4e8f8 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:39.098466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaaf616-d46d-4063-acb8-3c4d2db4e8f8 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:39.116111 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:39.133018 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00f132-7455-4bf2-a14f-f36ae5b580dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:39.133664 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00f132-7455-4bf2-a14f-f36ae5b580dc None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:39.133928 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00f132-7455-4bf2-a14f-f36ae5b580dc None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:39.134205 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00f132-7455-4bf2-a14f-f36ae5b580dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:39.144835 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00f132-7455-4bf2-a14f-f36ae5b580dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:19:39.149602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-9b00f132-7455-4bf2-a14f-f36ae5b580dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:19:39.149602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:39.149602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:39.149602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:39.149602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:39.149602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:39.149602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:39.149602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:39.149602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:39.149602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:39.149602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:39.149602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:39.149602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:19:39.149602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:19:39.149602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:19:39.149602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:19:39.150758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:19:39.150758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:19:39.150758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:19:39.150758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:19:39.150758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:39.150758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:39.150758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:39.150758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:39.150758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:39.150758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:39.150758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:39.150758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:39.150758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:39.150758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:39.150758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:39.150758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:39.152020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:39.152020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:39.152020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:39.152020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:39.152020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:19:39.152020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:19:39.152020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:19:39.152020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:19:39.152020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:19:39.152020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:19:39.152020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:19:39.152020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:19:39.152020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 565/1141] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:19:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:19:39.156718 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9417c60-c9a8-4f42-bd0a-60555242cc91 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:39.216014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:39.258167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9417c60-c9a8-4f42-bd0a-60555242cc91 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:39.291515 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db97b7-314b-4fed-807f-2683f2317bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:39.292115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db97b7-314b-4fed-807f-2683f2317bbc None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:39.292397 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db97b7-314b-4fed-807f-2683f2317bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:39.292672 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db97b7-314b-4fed-807f-2683f2317bbc None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:39.293361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db97b7-314b-4fed-807f-2683f2317bbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:39.293670 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db97b7-314b-4fed-807f-2683f2317bbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:39.295040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db97b7-314b-4fed-807f-2683f2317bbc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:39.303691 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 577/1142] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:19:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:39.309780 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00f132-7455-4bf2-a14f-f36ae5b580dc None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:39.411216 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00f132-7455-4bf2-a14f-f36ae5b580dc None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:39.444294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dec41b-b2f8-45a8-ae63-ee9176803e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:39.444942 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dec41b-b2f8-45a8-ae63-ee9176803e18 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:39.445230 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dec41b-b2f8-45a8-ae63-ee9176803e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:39.445509 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dec41b-b2f8-45a8-ae63-ee9176803e18 None admin] PATH_INFO: `/v3/users/d5e3a1d8b01d4a62a7e5519c475a6007` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:39.459215 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dec41b-b2f8-45a8-ae63-ee9176803e18 None admin] RBAC: Authorizing `identity:get_user(user_id=d5e3a1d8b01d4a62a7e5519c475a6007)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:39.460653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dec41b-b2f8-45a8-ae63-ee9176803e18 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:39.462280 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 566/1143] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:19:39 2022] GET /identity/v3/users/d5e3a1d8b01d4a62a7e5519c475a6007 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:19:39.468258 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db97b7-314b-4fed-807f-2683f2317bbc None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:39.566803 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db97b7-314b-4fed-807f-2683f2317bbc None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:39.589099 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:39.601512 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb7567-25f8-48a2-a378-9191479ad81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:39.602116 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb7567-25f8-48a2-a378-9191479ad81c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:39.602399 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb7567-25f8-48a2-a378-9191479ad81c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:39.602766 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb7567-25f8-48a2-a378-9191479ad81c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:39.672988 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb7567-25f8-48a2-a378-9191479ad81c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:39.674448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb7567-25f8-48a2-a378-9191479ad81c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:39.770579 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 578/1144] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:19:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:19:39.776876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dec41b-b2f8-45a8-ae63-ee9176803e18 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:39.811238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:39.877294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dec41b-b2f8-45a8-ae63-ee9176803e18 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:39.913255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09422f3d-6d18-4e3a-b26e-e7986e679e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:39.913884 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09422f3d-6d18-4e3a-b26e-e7986e679e0a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:39.914167 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09422f3d-6d18-4e3a-b26e-e7986e679e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:39.914443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09422f3d-6d18-4e3a-b26e-e7986e679e0a None admin] PATH_INFO: `/v3/projects/807060621b324a0d9e3b98ed8b6e7845` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:39.915567 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09422f3d-6d18-4e3a-b26e-e7986e679e0a None admin] RBAC: Authorizing `identity:get_project(project_id=807060621b324a0d9e3b98ed8b6e7845)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:39.917029 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09422f3d-6d18-4e3a-b26e-e7986e679e0a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:39.918653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 567/1145] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:19:39 2022] GET /identity/v3/projects/807060621b324a0d9e3b98ed8b6e7845 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:39.925100 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb7567-25f8-48a2-a378-9191479ad81c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:39.949113 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:40.024442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb7567-25f8-48a2-a378-9191479ad81c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:40.058492 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c68bf7-234a-4c5d-91e0-16c4dd2ac502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:40.059094 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c68bf7-234a-4c5d-91e0-16c4dd2ac502 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:40.059379 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c68bf7-234a-4c5d-91e0-16c4dd2ac502 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:40.059657 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c68bf7-234a-4c5d-91e0-16c4dd2ac502 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:40.060382 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c68bf7-234a-4c5d-91e0-16c4dd2ac502 None admin] RBAC: Adding query filter params (role.id=059d2bf5bb8e42939f5f826bfdad6a21, scope.project.id=807060621b324a0d9e3b98ed8b6e7845, user.id=d5e3a1d8b01d4a62a7e5519c475a6007) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:40.060718 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c68bf7-234a-4c5d-91e0-16c4dd2ac502 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:40.062156 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c68bf7-234a-4c5d-91e0-16c4dd2ac502 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:40.067725 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 579/1146] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:19:39 2022] GET /identity/v3/role_assignments?user.id=d5e3a1d8b01d4a62a7e5519c475a6007&scope.project.id=807060621b324a0d9e3b98ed8b6e7845&role.id=059d2bf5bb8e42939f5f826bfdad6a21 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:41.943243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdfa14-507f-4d50-874a-bc5796e37fe9 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:41.943798 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdfa14-507f-4d50-874a-bc5796e37fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:41.943798 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdfa14-507f-4d50-874a-bc5796e37fe9 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:41.945183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 568/1147] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:41.950525 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d7f3d-563a-48af-8edc-44ae6779ab3b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:41.950947 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d7f3d-563a-48af-8edc-44ae6779ab3b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:41.951081 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d7f3d-563a-48af-8edc-44ae6779ab3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:41.970547 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-fe5d7f3d-563a-48af-8edc-44ae6779ab3b None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:41.972496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fe5d7f3d-563a-48af-8edc-44ae6779ab3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:42.038331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 580/1148] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:19:42.328198 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdfa14-507f-4d50-874a-bc5796e37fe9 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:42.455531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdfa14-507f-4d50-874a-bc5796e37fe9 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:42.458197 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:42.492050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801d60b-ad30-4cb1-af6d-d3d6ebbf98b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:42.492723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801d60b-ad30-4cb1-af6d-d3d6ebbf98b6 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:42.493001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801d60b-ad30-4cb1-af6d-d3d6ebbf98b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:42.493277 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801d60b-ad30-4cb1-af6d-d3d6ebbf98b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:42.504310 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801d60b-ad30-4cb1-af6d-d3d6ebbf98b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:19:42.509137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-1801d60b-ad30-4cb1-af6d-d3d6ebbf98b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:19:42.509137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:42.509137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:42.509137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:42.509137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:42.509137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:42.509137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:42.509137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:42.509137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:42.509137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:42.509137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:42.509137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:42.509137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:19:42.509137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:19:42.509137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:19:42.509137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:19:42.510308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:19:42.510308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:19:42.510308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:19:42.510308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:19:42.510308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:42.510308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:42.510308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:42.510308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:42.510308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:42.510308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:42.510308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:42.510308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:42.510308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:42.510308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:42.510308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:42.510308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:42.511463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:42.511463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:42.511463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:42.511463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:42.511463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:19:42.511463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:19:42.511463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:19:42.511463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:19:42.511463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:19:42.511463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:19:42.511463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:19:42.511463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:19:42.511463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 569/1149] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:19:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:19:42.516554 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d7f3d-563a-48af-8edc-44ae6779ab3b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:42.537872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:42.631359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d7f3d-563a-48af-8edc-44ae6779ab3b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:42.672649 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb0d82-7c0b-4fa2-b192-7f66d2528c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:42.673359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb0d82-7c0b-4fa2-b192-7f66d2528c0b None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:42.673643 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb0d82-7c0b-4fa2-b192-7f66d2528c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:42.673920 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb0d82-7c0b-4fa2-b192-7f66d2528c0b None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:42.674598 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb0d82-7c0b-4fa2-b192-7f66d2528c0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:42.675440 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb0d82-7c0b-4fa2-b192-7f66d2528c0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:42.678521 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb0d82-7c0b-4fa2-b192-7f66d2528c0b None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:42.691437 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 581/1150] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:19:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:42.697810 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801d60b-ad30-4cb1-af6d-d3d6ebbf98b6 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:42.807387 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801d60b-ad30-4cb1-af6d-d3d6ebbf98b6 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:42.849749 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48d42d-8003-4d26-b9b7-05832ce59a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:42.850402 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48d42d-8003-4d26-b9b7-05832ce59a55 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:42.850682 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48d42d-8003-4d26-b9b7-05832ce59a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:42.850960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48d42d-8003-4d26-b9b7-05832ce59a55 None admin] PATH_INFO: `/v3/users/d5e3a1d8b01d4a62a7e5519c475a6007` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:42.852294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48d42d-8003-4d26-b9b7-05832ce59a55 None admin] RBAC: Authorizing `identity:get_user(user_id=d5e3a1d8b01d4a62a7e5519c475a6007)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:42.854326 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48d42d-8003-4d26-b9b7-05832ce59a55 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:42.855935 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 570/1151] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:19:42 2022] GET /identity/v3/users/d5e3a1d8b01d4a62a7e5519c475a6007 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:42.861853 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb0d82-7c0b-4fa2-b192-7f66d2528c0b None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:42.969428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:42.998263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb0d82-7c0b-4fa2-b192-7f66d2528c0b None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:43.040030 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26751f4f-72e2-47ce-9657-f091fc5e458e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:43.041108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26751f4f-72e2-47ce-9657-f091fc5e458e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:43.041613 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26751f4f-72e2-47ce-9657-f091fc5e458e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:43.042119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26751f4f-72e2-47ce-9657-f091fc5e458e None admin] PATH_INFO: `/v3/projects/807060621b324a0d9e3b98ed8b6e7845` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:43.043830 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26751f4f-72e2-47ce-9657-f091fc5e458e None admin] RBAC: Authorizing `identity:get_project(project_id=807060621b324a0d9e3b98ed8b6e7845)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:43.045993 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26751f4f-72e2-47ce-9657-f091fc5e458e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:43.048281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 582/1152] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:19:42 2022] GET /identity/v3/projects/807060621b324a0d9e3b98ed8b6e7845 => generated 311 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:43.055383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48d42d-8003-4d26-b9b7-05832ce59a55 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:43.092799 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:43.162808 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48d42d-8003-4d26-b9b7-05832ce59a55 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:43.196258 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e838748-93cd-4155-9aab-8d537f249cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:43.196941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e838748-93cd-4155-9aab-8d537f249cf1 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:43.197225 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e838748-93cd-4155-9aab-8d537f249cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:43.197767 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e838748-93cd-4155-9aab-8d537f249cf1 None admin] PATH_INFO: `/v3/projects/807060621b324a0d9e3b98ed8b6e7845/users/d5e3a1d8b01d4a62a7e5519c475a6007/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:43.199654 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e838748-93cd-4155-9aab-8d537f249cf1 None admin] RBAC: Authorizing `identity:create_grant(project_id=807060621b324a0d9e3b98ed8b6e7845, user_id=d5e3a1d8b01d4a62a7e5519c475a6007, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:43.201122 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e838748-93cd-4155-9aab-8d537f249cf1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:43.218199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 571/1153] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:19:43 2022] PUT /identity/v3/projects/807060621b324a0d9e3b98ed8b6e7845/users/d5e3a1d8b01d4a62a7e5519c475a6007/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:19:45.099466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98922102-bd9c-4e49-8382-ea51a5370cc5 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:45.099990 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98922102-bd9c-4e49-8382-ea51a5370cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:45.099990 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98922102-bd9c-4e49-8382-ea51a5370cc5 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:45.101288 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 583/1154] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:19:45.106466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2a8ef-26ce-486d-a99b-9d51783a0247 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:45.106897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2a8ef-26ce-486d-a99b-9d51783a0247 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:45.107022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2a8ef-26ce-486d-a99b-9d51783a0247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:45.126033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-eac2a8ef-26ce-486d-a99b-9d51783a0247 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:45.127250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-eac2a8ef-26ce-486d-a99b-9d51783a0247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:45.192889 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 572/1155] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:19:45.464825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98922102-bd9c-4e49-8382-ea51a5370cc5 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:45.566301 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98922102-bd9c-4e49-8382-ea51a5370cc5 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:45.601116 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557e69b-9750-41cb-b9a5-2953aa620133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:45.601741 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557e69b-9750-41cb-b9a5-2953aa620133 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:45.602026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557e69b-9750-41cb-b9a5-2953aa620133 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:45.602306 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557e69b-9750-41cb-b9a5-2953aa620133 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:45.612178 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557e69b-9750-41cb-b9a5-2953aa620133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:19:45.617665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-8557e69b-9750-41cb-b9a5-2953aa620133 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:19:45.617665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:45.617665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:45.617665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:45.617665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:45.617665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:45.617665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:45.617665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:45.617665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:45.617665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:45.617665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:45.617665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:45.617665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:19:45.617665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:19:45.617665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:19:45.617665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:19:45.618792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:19:45.618792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:19:45.618792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:19:45.618792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:19:45.618792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:45.618792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:45.618792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:45.618792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:45.618792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:45.618792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:45.618792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:45.618792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:45.618792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:45.618792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:45.618792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:45.618792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:45.619781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:45.619781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:45.619781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:45.619781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:45.619781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:19:45.619781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:19:45.619781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:19:45.619781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:19:45.619781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:19:45.619781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:19:45.619781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:19:45.619781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:45.619781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 584/1156] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:19:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:19:45.624887 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2a8ef-26ce-486d-a99b-9d51783a0247 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:45.648875 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:45.725290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2a8ef-26ce-486d-a99b-9d51783a0247 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:45.760132 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c84c70-9da4-4c0b-abd1-a42df207e335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:45.760767 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c84c70-9da4-4c0b-abd1-a42df207e335 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:45.761047 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c84c70-9da4-4c0b-abd1-a42df207e335 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:45.761324 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c84c70-9da4-4c0b-abd1-a42df207e335 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:45.761997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c84c70-9da4-4c0b-abd1-a42df207e335 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:45.762303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c84c70-9da4-4c0b-abd1-a42df207e335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:45.763680 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c84c70-9da4-4c0b-abd1-a42df207e335 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:45.771632 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 573/1157] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:19:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:45.777488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557e69b-9750-41cb-b9a5-2953aa620133 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:45.787481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:45.879733 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557e69b-9750-41cb-b9a5-2953aa620133 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:45.913033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f0445-3bfa-4b7d-9382-8928da1f5b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:45.913652 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f0445-3bfa-4b7d-9382-8928da1f5b04 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:45.913936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f0445-3bfa-4b7d-9382-8928da1f5b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:45.914211 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f0445-3bfa-4b7d-9382-8928da1f5b04 None admin] PATH_INFO: `/v3/users/d5e3a1d8b01d4a62a7e5519c475a6007` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:45.915321 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f0445-3bfa-4b7d-9382-8928da1f5b04 None admin] RBAC: Authorizing `identity:get_user(user_id=d5e3a1d8b01d4a62a7e5519c475a6007)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:45.916769 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f0445-3bfa-4b7d-9382-8928da1f5b04 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:45.918342 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 585/1158] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:19:45 2022] GET /identity/v3/users/d5e3a1d8b01d4a62a7e5519c475a6007 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:45.924419 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c84c70-9da4-4c0b-abd1-a42df207e335 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:46.021520 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:46.038333 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c84c70-9da4-4c0b-abd1-a42df207e335 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:46.072182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aac423-2caa-42c5-95d6-2d9244e3ed2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:46.073074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aac423-2caa-42c5-95d6-2d9244e3ed2c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:46.073359 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aac423-2caa-42c5-95d6-2d9244e3ed2c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:46.073639 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aac423-2caa-42c5-95d6-2d9244e3ed2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:46.139895 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aac423-2caa-42c5-95d6-2d9244e3ed2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:46.141436 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aac423-2caa-42c5-95d6-2d9244e3ed2c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:46.222882 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:46.239746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 574/1159] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:19:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:19:46.245796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f0445-3bfa-4b7d-9382-8928da1f5b04 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:46.328282 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:46.355612 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f0445-3bfa-4b7d-9382-8928da1f5b04 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:46.389645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903e62e-e7f5-4521-ba7b-a9a6d84e7d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:46.390315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903e62e-e7f5-4521-ba7b-a9a6d84e7d0c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:46.390643 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903e62e-e7f5-4521-ba7b-a9a6d84e7d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:46.390979 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903e62e-e7f5-4521-ba7b-a9a6d84e7d0c None admin] PATH_INFO: `/v3/projects/807060621b324a0d9e3b98ed8b6e7845` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:46.392262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903e62e-e7f5-4521-ba7b-a9a6d84e7d0c None admin] RBAC: Authorizing `identity:get_project(project_id=807060621b324a0d9e3b98ed8b6e7845)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:46.394708 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903e62e-e7f5-4521-ba7b-a9a6d84e7d0c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:46.396417 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 586/1160] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:19:46 2022] GET /identity/v3/projects/807060621b324a0d9e3b98ed8b6e7845 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:46.404342 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aac423-2caa-42c5-95d6-2d9244e3ed2c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:46.506678 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aac423-2caa-42c5-95d6-2d9244e3ed2c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:46.541286 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74c5d7-5343-4910-9ff0-ac4926b955e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:46.541893 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74c5d7-5343-4910-9ff0-ac4926b955e2 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:46.542177 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74c5d7-5343-4910-9ff0-ac4926b955e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:46.542455 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74c5d7-5343-4910-9ff0-ac4926b955e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:46.543188 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74c5d7-5343-4910-9ff0-ac4926b955e2 None admin] RBAC: Adding query filter params (role.id=059d2bf5bb8e42939f5f826bfdad6a21, scope.project.id=807060621b324a0d9e3b98ed8b6e7845, user.id=d5e3a1d8b01d4a62a7e5519c475a6007) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:46.543500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74c5d7-5343-4910-9ff0-ac4926b955e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:46.544960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74c5d7-5343-4910-9ff0-ac4926b955e2 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:46.551298 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 575/1161] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:19:46 2022] GET /identity/v3/role_assignments?user.id=d5e3a1d8b01d4a62a7e5519c475a6007&scope.project.id=807060621b324a0d9e3b98ed8b6e7845&role.id=059d2bf5bb8e42939f5f826bfdad6a21 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:48.464320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007ab45-168e-4750-80bf-3a02b1b46c30 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:48.464914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007ab45-168e-4750-80bf-3a02b1b46c30 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:48.464914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007ab45-168e-4750-80bf-3a02b1b46c30 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:48.466226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 587/1162] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:48.471527 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a24f1e-4864-4894-b065-58c2dcb0e712 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:48.471895 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a24f1e-4864-4894-b065-58c2dcb0e712 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:48.472095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a24f1e-4864-4894-b065-58c2dcb0e712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:48.489838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-95a24f1e-4864-4894-b065-58c2dcb0e712 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:48.491031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-95a24f1e-4864-4894-b065-58c2dcb0e712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:48.535725 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:48.558822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 576/1163] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:19:48.823970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007ab45-168e-4750-80bf-3a02b1b46c30 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:48.924223 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007ab45-168e-4750-80bf-3a02b1b46c30 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:48.958284 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361d27b-dbd8-44af-a40b-cf70c595e9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:48.958884 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361d27b-dbd8-44af-a40b-cf70c595e9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:48.959164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361d27b-dbd8-44af-a40b-cf70c595e9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:48.959435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361d27b-dbd8-44af-a40b-cf70c595e9a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:48.970841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:49.026741 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361d27b-dbd8-44af-a40b-cf70c595e9a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:49.028227 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361d27b-dbd8-44af-a40b-cf70c595e9a7 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:49.123938 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 588/1164] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:19:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:19:49.130451 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a24f1e-4864-4894-b065-58c2dcb0e712 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:49.233848 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a24f1e-4864-4894-b065-58c2dcb0e712 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:49.267216 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b623ce4-b561-4657-8351-c2329dff06e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:49.267836 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b623ce4-b561-4657-8351-c2329dff06e1 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:49.268121 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b623ce4-b561-4657-8351-c2329dff06e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:49.268395 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b623ce4-b561-4657-8351-c2329dff06e1 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:49.276478 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b623ce4-b561-4657-8351-c2329dff06e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:49.277937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b623ce4-b561-4657-8351-c2329dff06e1 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:49.289506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-5b623ce4-b561-4657-8351-c2329dff06e1 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 04:19:49.289506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:49.289506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 04:19:49.289506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 04:19:49.289506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:19:49.289506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:19:49.289506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:19:49.289506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:19:49.289506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 04:19:49.289506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:19:49.289506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:19:49.289506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:19:49.289506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:49.289506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:49.289506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:49.289506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:49.289506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:49.290746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:49.290746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:49.290746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:49.290746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:49.290746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:49.290746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:49.290746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:19:49.290746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:19:49.290746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:19:49.290746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:19:49.290746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:49.290746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:49.290746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:49.290746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:49.290746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:49.290746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:49.291804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:49.291804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:49.291804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:49.291804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:49.291804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:49.291804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:49.291804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:49.291804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:49.291804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:49.291804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:49.291804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 04:19:49.291804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:19:49.291804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 04:19:49.291804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:19:49.291804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 577/1165] 10.222.0.96 () {56 vars in 1117 bytes} [Wed Aug 24 04:19:49 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:19:49.297149 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361d27b-dbd8-44af-a40b-cf70c595e9a7 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:49.340500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:49.397879 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361d27b-dbd8-44af-a40b-cf70c595e9a7 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:49.430535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47142ae0-bd53-4f1a-95e2-ca0440f25af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:49.431143 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47142ae0-bd53-4f1a-95e2-ca0440f25af3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:49.431429 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47142ae0-bd53-4f1a-95e2-ca0440f25af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:49.431705 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47142ae0-bd53-4f1a-95e2-ca0440f25af3 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:49.432347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47142ae0-bd53-4f1a-95e2-ca0440f25af3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:49.432660 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47142ae0-bd53-4f1a-95e2-ca0440f25af3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:49.434059 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47142ae0-bd53-4f1a-95e2-ca0440f25af3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:49.441797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 589/1166] 10.222.0.96 () {56 vars in 1115 bytes} [Wed Aug 24 04:19:49 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:51.336825 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a456e-7f2d-4dc4-965b-157cd82b1af2 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:51.337446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a456e-7f2d-4dc4-965b-157cd82b1af2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:51.337446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a456e-7f2d-4dc4-965b-157cd82b1af2 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:51.339749 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 578/1167] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:51.348309 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34780c2-12d1-4d09-95c1-2850ebe367b5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:51.348805 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34780c2-12d1-4d09-95c1-2850ebe367b5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:51.348931 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34780c2-12d1-4d09-95c1-2850ebe367b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:51.366575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b34780c2-12d1-4d09-95c1-2850ebe367b5 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:51.367774 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b34780c2-12d1-4d09-95c1-2850ebe367b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:51.433639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 590/1168] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:19:51.708550 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a456e-7f2d-4dc4-965b-157cd82b1af2 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:51.754407 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:51.819204 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a456e-7f2d-4dc4-965b-157cd82b1af2 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:51.853292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a6c87-f92e-47cd-b501-98fa8d9f5a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:51.853900 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a6c87-f92e-47cd-b501-98fa8d9f5a50 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:51.854183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a6c87-f92e-47cd-b501-98fa8d9f5a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:51.854456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a6c87-f92e-47cd-b501-98fa8d9f5a50 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:51.855129 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a6c87-f92e-47cd-b501-98fa8d9f5a50 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:51.856500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a6c87-f92e-47cd-b501-98fa8d9f5a50 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:51.872356 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 579/1169] 10.222.0.96 () {60 vars in 1138 bytes} [Wed Aug 24 04:19:51 2022] POST /identity/v3/domains => generated 267 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:19:53.817927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a3144-253c-4f0e-962b-b510c04ab6b8 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:53.818493 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a3144-253c-4f0e-962b-b510c04ab6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:53.818493 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a3144-253c-4f0e-962b-b510c04ab6b8 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:53.819834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 591/1170] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:53.825583 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e05be-b80b-499f-b1b4-c376ed39dd35 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:53.825978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e05be-b80b-499f-b1b4-c376ed39dd35 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:53.826140 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e05be-b80b-499f-b1b4-c376ed39dd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:53.845276 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-3f3e05be-b80b-499f-b1b4-c376ed39dd35 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:53.846510 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3f3e05be-b80b-499f-b1b4-c376ed39dd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:53.913732 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 580/1171] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:19:54.193619 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a3144-253c-4f0e-962b-b510c04ab6b8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:54.228934 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:54.292970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a3144-253c-4f0e-962b-b510c04ab6b8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:54.326446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710db82-753e-4cc2-b34c-750324db645f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:54.327068 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710db82-753e-4cc2-b34c-750324db645f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:54.327347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710db82-753e-4cc2-b34c-750324db645f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:54.327619 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710db82-753e-4cc2-b34c-750324db645f None admin] PATH_INFO: `/v3/domains/34c10269ee9c4292b30e56bacfd4dfc4` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:54.337864 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710db82-753e-4cc2-b34c-750324db645f None admin] RBAC: Authorizing `identity:get_domain(domain_id=34c10269ee9c4292b30e56bacfd4dfc4)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:54.339294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710db82-753e-4cc2-b34c-750324db645f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:54.340891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 592/1172] 10.222.0.96 () {56 vars in 1183 bytes} [Wed Aug 24 04:19:54 2022] GET /identity/v3/domains/34c10269ee9c4292b30e56bacfd4dfc4 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:54.346680 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e05be-b80b-499f-b1b4-c376ed39dd35 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:54.373672 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:54.451048 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e05be-b80b-499f-b1b4-c376ed39dd35 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:54.484230 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b88204-ba23-491f-a23c-907427ff002e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:54.484894 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b88204-ba23-491f-a23c-907427ff002e None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:54.485181 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b88204-ba23-491f-a23c-907427ff002e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:54.485462 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b88204-ba23-491f-a23c-907427ff002e None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:54.486133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b88204-ba23-491f-a23c-907427ff002e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:54.488372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b88204-ba23-491f-a23c-907427ff002e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:54.514413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 581/1173] 10.222.0.96 () {60 vars in 1141 bytes} [Wed Aug 24 04:19:54 2022] POST /identity/v3/projects => generated 361 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:19:56.456377 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd816ffc-f567-4c08-b166-842c1bbab6ef None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:56.456974 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd816ffc-f567-4c08-b166-842c1bbab6ef None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:56.456974 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd816ffc-f567-4c08-b166-842c1bbab6ef None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:56.458314 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 593/1174] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:56.463614 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55413e1-04db-4143-9ab7-ba2ab50ad20e None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:56.463984 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55413e1-04db-4143-9ab7-ba2ab50ad20e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:56.464179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55413e1-04db-4143-9ab7-ba2ab50ad20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:56.482827 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d55413e1-04db-4143-9ab7-ba2ab50ad20e None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:56.484018 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d55413e1-04db-4143-9ab7-ba2ab50ad20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:56.551422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 582/1175] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:19:56.820194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd816ffc-f567-4c08-b166-842c1bbab6ef None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:56.915086 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:56.922560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd816ffc-f567-4c08-b166-842c1bbab6ef None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:56.957412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e0ac7-afd7-4fe1-812c-f00bc3cc6ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:56.958121 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e0ac7-afd7-4fe1-812c-f00bc3cc6ddc None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:56.958476 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e0ac7-afd7-4fe1-812c-f00bc3cc6ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:56.958749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e0ac7-afd7-4fe1-812c-f00bc3cc6ddc None admin] PATH_INFO: `/v3/domains/34c10269ee9c4292b30e56bacfd4dfc4` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:56.959849 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e0ac7-afd7-4fe1-812c-f00bc3cc6ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=34c10269ee9c4292b30e56bacfd4dfc4)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:56.961294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e0ac7-afd7-4fe1-812c-f00bc3cc6ddc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:56.962846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 594/1176] 10.222.0.96 () {56 vars in 1183 bytes} [Wed Aug 24 04:19:56 2022] GET /identity/v3/domains/34c10269ee9c4292b30e56bacfd4dfc4 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:56.968624 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55413e1-04db-4143-9ab7-ba2ab50ad20e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:56.980152 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:57.070394 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55413e1-04db-4143-9ab7-ba2ab50ad20e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:57.103829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ff7e3-975e-4072-9ef8-cb901cfc53bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:57.104426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ff7e3-975e-4072-9ef8-cb901cfc53bd None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:57.104730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ff7e3-975e-4072-9ef8-cb901cfc53bd None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:57.105005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ff7e3-975e-4072-9ef8-cb901cfc53bd None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:57.105642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ff7e3-975e-4072-9ef8-cb901cfc53bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:57.107172 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ff7e3-975e-4072-9ef8-cb901cfc53bd None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:57.130079 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 583/1177] 10.222.0.96 () {60 vars in 1132 bytes} [Wed Aug 24 04:19:56 2022] POST /identity/v3/users => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:19:59.068800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec2ed3-7410-4762-b768-ad98200f8ee3 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:59.069356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec2ed3-7410-4762-b768-ad98200f8ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:59.069356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec2ed3-7410-4762-b768-ad98200f8ee3 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:59.070696 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 595/1178] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:19:59.076360 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455a483-94f6-4e38-a9f3-2057103edb21 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:59.076766 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455a483-94f6-4e38-a9f3-2057103edb21 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:59.076954 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455a483-94f6-4e38-a9f3-2057103edb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:59.095062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e455a483-94f6-4e38-a9f3-2057103edb21 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:19:59.096192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e455a483-94f6-4e38-a9f3-2057103edb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:19:59.157894 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:59.167683 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 584/1179] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:19:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:19:59.437515 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec2ed3-7410-4762-b768-ad98200f8ee3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:59.548207 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec2ed3-7410-4762-b768-ad98200f8ee3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:59.582411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70d986-8312-4293-9d37-661455b4027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:59.583028 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70d986-8312-4293-9d37-661455b4027d None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:59.583318 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70d986-8312-4293-9d37-661455b4027d None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:59.583595 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70d986-8312-4293-9d37-661455b4027d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:59.593668 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70d986-8312-4293-9d37-661455b4027d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:19:59.599044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-dd70d986-8312-4293-9d37-661455b4027d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:19:59.599044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:19:59.599044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:19:59.599044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:19:59.599044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:19:59.599044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:19:59.599044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:19:59.599044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:19:59.599044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:19:59.599044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:19:59.599044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:19:59.599044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:19:59.599044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:19:59.599044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:19:59.599044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:19:59.599044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:19:59.600213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:19:59.600213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:19:59.600213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:19:59.600213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:19:59.600213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:19:59.600213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:19:59.600213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:19:59.600213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:19:59.600213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:19:59.600213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:19:59.600213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:19:59.600213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:19:59.600213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:19:59.600213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:19:59.600213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:19:59.600213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:19:59.601422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:19:59.601422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:19:59.601422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:19:59.601422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:19:59.601422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:19:59.601422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:19:59.601422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:19:59.601422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:19:59.601422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:19:59.601422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:19:59.601422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:19:59.601422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:19:59.601422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 596/1180] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:19:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:19:59.606378 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455a483-94f6-4e38-a9f3-2057103edb21 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:59.708883 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455a483-94f6-4e38-a9f3-2057103edb21 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:59.741632 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f16c9a-ba3b-4b13-b849-026c38d6482e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:59.742238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f16c9a-ba3b-4b13-b849-026c38d6482e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:59.742529 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f16c9a-ba3b-4b13-b849-026c38d6482e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:59.742805 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f16c9a-ba3b-4b13-b849-026c38d6482e None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:59.743468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f16c9a-ba3b-4b13-b849-026c38d6482e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:19:59.743776 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f16c9a-ba3b-4b13-b849-026c38d6482e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:59.745209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f16c9a-ba3b-4b13-b849-026c38d6482e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:59.753600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 585/1181] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:19:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:59.759651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70d986-8312-4293-9d37-661455b4027d None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:59.787692 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:59.863409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70d986-8312-4293-9d37-661455b4027d None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:59.896966 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f2514-2319-4977-b38a-32ee980fa4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:59.897591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f2514-2319-4977-b38a-32ee980fa4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:59.897874 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f2514-2319-4977-b38a-32ee980fa4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:59.898149 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f2514-2319-4977-b38a-32ee980fa4f0 None admin] PATH_INFO: `/v3/users/aa59771d47ad4316896f065a7bff4c79` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:59.911363 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f2514-2319-4977-b38a-32ee980fa4f0 None admin] RBAC: Authorizing `identity:get_user(user_id=aa59771d47ad4316896f065a7bff4c79)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:59.912843 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f2514-2319-4977-b38a-32ee980fa4f0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:59.914462 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 597/1182] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:19:59 2022] GET /identity/v3/users/aa59771d47ad4316896f065a7bff4c79 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:19:59.920403 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f16c9a-ba3b-4b13-b849-026c38d6482e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:59.981876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:00.024958 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f16c9a-ba3b-4b13-b849-026c38d6482e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:20:00.057661 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e0f95-8fd2-4d13-87e0-42c4c7379f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:20:00.058256 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e0f95-8fd2-4d13-87e0-42c4c7379f82 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:20:00.058535 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e0f95-8fd2-4d13-87e0-42c4c7379f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:20:00.058807 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e0f95-8fd2-4d13-87e0-42c4c7379f82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:20:00.133626 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e0f95-8fd2-4d13-87e0-42c4c7379f82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:20:00.135082 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e0f95-8fd2-4d13-87e0-42c4c7379f82 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:20:00.189813 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:00.231797 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 586/1183] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:19:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:20:00.238334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f2514-2319-4977-b38a-32ee980fa4f0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:20:00.319277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:00.337344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f2514-2319-4977-b38a-32ee980fa4f0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:20:00.370493 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6083d2-88ef-42b0-a331-cfd7feccc2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:20:00.371115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6083d2-88ef-42b0-a331-cfd7feccc2fa None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:20:00.371399 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6083d2-88ef-42b0-a331-cfd7feccc2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:20:00.371676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6083d2-88ef-42b0-a331-cfd7feccc2fa None admin] PATH_INFO: `/v3/projects/2c859bd96a0c4d94917eabfdb491fdf0` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:20:00.372806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6083d2-88ef-42b0-a331-cfd7feccc2fa None admin] RBAC: Authorizing `identity:get_project(project_id=2c859bd96a0c4d94917eabfdb491fdf0)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:20:00.374240 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6083d2-88ef-42b0-a331-cfd7feccc2fa None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:20:00.375871 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 598/1184] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:20:00 2022] GET /identity/v3/projects/2c859bd96a0c4d94917eabfdb491fdf0 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:20:00.382614 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e0f95-8fd2-4d13-87e0-42c4c7379f82 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:20:00.480364 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e0f95-8fd2-4d13-87e0-42c4c7379f82 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:20:00.515442 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85939f32-1a9c-4d80-a89f-61e4b815ec08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:20:00.515973 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85939f32-1a9c-4d80-a89f-61e4b815ec08 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:20:00.516253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85939f32-1a9c-4d80-a89f-61e4b815ec08 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:20:00.516527 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85939f32-1a9c-4d80-a89f-61e4b815ec08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:20:00.517282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85939f32-1a9c-4d80-a89f-61e4b815ec08 None admin] RBAC: Adding query filter params (role.id=059d2bf5bb8e42939f5f826bfdad6a21, scope.project.id=2c859bd96a0c4d94917eabfdb491fdf0, user.id=aa59771d47ad4316896f065a7bff4c79) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:20:00.517597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85939f32-1a9c-4d80-a89f-61e4b815ec08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:20:00.519591 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85939f32-1a9c-4d80-a89f-61e4b815ec08 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:20:00.524873 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 587/1185] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:20:00 2022] GET /identity/v3/role_assignments?user.id=aa59771d47ad4316896f065a7bff4c79&scope.project.id=2c859bd96a0c4d94917eabfdb491fdf0&role.id=059d2bf5bb8e42939f5f826bfdad6a21 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:20:02.405909 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284222a6-104b-4967-a61c-85ca7dced274 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:20:02.406461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284222a6-104b-4967-a61c-85ca7dced274 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:20:02.406461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284222a6-104b-4967-a61c-85ca7dced274 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:20:02.407811 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 599/1186] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:20:02.412942 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312708f-484b-4f45-b461-85fbccf04597 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:20:02.413364 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312708f-484b-4f45-b461-85fbccf04597 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:20:02.413495 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312708f-484b-4f45-b461-85fbccf04597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:20:02.431860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-7312708f-484b-4f45-b461-85fbccf04597 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:20:02.433083 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7312708f-484b-4f45-b461-85fbccf04597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:20:02.450070 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:02.500371 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 588/1187] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:20:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:20:02.766778 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284222a6-104b-4967-a61c-85ca7dced274 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:20:02.870412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284222a6-104b-4967-a61c-85ca7dced274 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:20:02.903430 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04244d3-2077-4f83-9360-d95564ac1977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:20:02.904049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04244d3-2077-4f83-9360-d95564ac1977 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:20:02.904333 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04244d3-2077-4f83-9360-d95564ac1977 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:20:02.904605 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04244d3-2077-4f83-9360-d95564ac1977 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:20:02.915114 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04244d3-2077-4f83-9360-d95564ac1977 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:20:02.919813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-e04244d3-2077-4f83-9360-d95564ac1977 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:20:02.919813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:20:02.919813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:20:02.919813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:20:02.919813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:20:02.919813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:20:02.919813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:20:02.919813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:20:02.919813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:20:02.919813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:20:02.919813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:20:02.919813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:20:02.919813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:20:02.919813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:20:02.919813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:20:02.919813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:20:02.920962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:20:02.920962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:20:02.920962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:20:02.920962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:20:02.920962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:20:02.920962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:20:02.920962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:20:02.920962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:20:02.920962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:20:02.920962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:20:02.920962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:20:02.920962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:20:02.920962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:20:02.920962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:20:02.920962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:20:02.920962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:20:02.921826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:20:02.921826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:20:02.921826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:20:02.921826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:20:02.921826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:20:02.921826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:20:02.921826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:20:02.921826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:20:02.921826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:20:02.921826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:20:02.921826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:20:02.921826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:20:02.921826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 600/1188] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:20:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:20:02.927519 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312708f-484b-4f45-b461-85fbccf04597 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:20:03.026724 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312708f-484b-4f45-b461-85fbccf04597 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:20:03.060343 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfdf03-62e9-4b25-9e88-ea507121d739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:20:03.060977 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfdf03-62e9-4b25-9e88-ea507121d739 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:20:03.061258 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfdf03-62e9-4b25-9e88-ea507121d739 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:20:03.061532 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfdf03-62e9-4b25-9e88-ea507121d739 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:20:03.062195 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dfdf03-62e9-4b25-9e88-ea507121d739 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:20:03.062503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dfdf03-62e9-4b25-9e88-ea507121d739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:20:03.063878 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dfdf03-62e9-4b25-9e88-ea507121d739 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:20:03.071789 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 589/1189] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:20:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:20:03.077821 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04244d3-2077-4f83-9360-d95564ac1977 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:20:03.090867 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:03.178665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04244d3-2077-4f83-9360-d95564ac1977 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:20:03.212340 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb88211-97c4-44ed-ad05-36742af58e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:20:03.212984 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb88211-97c4-44ed-ad05-36742af58e2f None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:20:03.213262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb88211-97c4-44ed-ad05-36742af58e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:20:03.213532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb88211-97c4-44ed-ad05-36742af58e2f None admin] PATH_INFO: `/v3/users/aa59771d47ad4316896f065a7bff4c79` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:20:03.214681 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb88211-97c4-44ed-ad05-36742af58e2f None admin] RBAC: Authorizing `identity:get_user(user_id=aa59771d47ad4316896f065a7bff4c79)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:20:03.216097 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb88211-97c4-44ed-ad05-36742af58e2f None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:20:03.217678 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 601/1190] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:20:03 2022] GET /identity/v3/users/aa59771d47ad4316896f065a7bff4c79 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:20:03.224250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfdf03-62e9-4b25-9e88-ea507121d739 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:20:03.240133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:03.323343 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dfdf03-62e9-4b25-9e88-ea507121d739 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:20:03.357181 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899d709-a219-470a-a6a3-65aa2010c99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:20:03.357800 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899d709-a219-470a-a6a3-65aa2010c99d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:20:03.358079 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899d709-a219-470a-a6a3-65aa2010c99d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:20:03.358352 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899d709-a219-470a-a6a3-65aa2010c99d None admin] PATH_INFO: `/v3/projects/2c859bd96a0c4d94917eabfdb491fdf0` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:20:03.359448 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899d709-a219-470a-a6a3-65aa2010c99d None admin] RBAC: Authorizing `identity:get_project(project_id=2c859bd96a0c4d94917eabfdb491fdf0)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:20:03.360888 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899d709-a219-470a-a6a3-65aa2010c99d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:20:03.362533 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 590/1191] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:20:03 2022] GET /identity/v3/projects/2c859bd96a0c4d94917eabfdb491fdf0 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:20:03.368510 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb88211-97c4-44ed-ad05-36742af58e2f None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:20:03.447583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:03.474332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb88211-97c4-44ed-ad05-36742af58e2f None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:20:03.507177 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285d6bc-e2c1-4e6f-aafe-8d3803fad33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:20:03.507828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285d6bc-e2c1-4e6f-aafe-8d3803fad33a None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:20:03.508113 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285d6bc-e2c1-4e6f-aafe-8d3803fad33a None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:20:03.508386 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285d6bc-e2c1-4e6f-aafe-8d3803fad33a None admin] PATH_INFO: `/v3/projects/2c859bd96a0c4d94917eabfdb491fdf0/users/aa59771d47ad4316896f065a7bff4c79/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:20:03.510297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285d6bc-e2c1-4e6f-aafe-8d3803fad33a None admin] RBAC: Authorizing `identity:create_grant(project_id=2c859bd96a0c4d94917eabfdb491fdf0, user_id=aa59771d47ad4316896f065a7bff4c79, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:20:03.511729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285d6bc-e2c1-4e6f-aafe-8d3803fad33a None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:20:03.524795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 602/1192] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:20:03 2022] PUT /identity/v3/projects/2c859bd96a0c4d94917eabfdb491fdf0/users/aa59771d47ad4316896f065a7bff4c79/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:20:05.444551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b424a8e-47f6-442b-915f-50581863d850 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:20:05.445113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b424a8e-47f6-442b-915f-50581863d850 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:20:05.445113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b424a8e-47f6-442b-915f-50581863d850 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:20:05.446495 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 591/1193] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:20:05.452016 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64878723-3a62-4646-861c-8cf8b71fd74d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:20:05.452439 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64878723-3a62-4646-861c-8cf8b71fd74d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:20:05.452602 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64878723-3a62-4646-861c-8cf8b71fd74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:20:05.471270 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-64878723-3a62-4646-861c-8cf8b71fd74d None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:20:05.472680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-64878723-3a62-4646-861c-8cf8b71fd74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:20:05.543595 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 603/1194] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:20:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:20:05.813288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b424a8e-47f6-442b-915f-50581863d850 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:20:05.897933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:05.917146 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b424a8e-47f6-442b-915f-50581863d850 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:20:05.950671 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b4920-c994-423b-804a-f07d58d3acfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:20:05.951294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b4920-c994-423b-804a-f07d58d3acfd None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:20:05.951576 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b4920-c994-423b-804a-f07d58d3acfd None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:20:05.951854 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b4920-c994-423b-804a-f07d58d3acfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:20:05.963049 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b4920-c994-423b-804a-f07d58d3acfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:20:05.967778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-d05b4920-c994-423b-804a-f07d58d3acfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:20:05.967778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:20:05.967778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:20:05.967778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:20:05.967778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:20:05.967778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:20:05.967778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:20:05.967778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:20:05.967778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:20:05.967778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:20:05.967778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:20:05.967778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:20:05.967778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:20:05.967778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:20:05.967778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:20:05.967778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:20:05.968886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:20:05.968886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:20:05.968886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:20:05.968886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:20:05.968886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:20:05.968886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:20:05.968886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:20:05.968886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:20:05.968886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:20:05.968886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:20:05.968886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:20:05.968886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:20:05.968886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:20:05.968886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:20:05.968886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:20:05.968886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:20:05.970066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:20:05.970066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:20:05.970066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:20:05.970066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:20:05.970066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:20:05.970066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:20:05.970066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:20:05.970066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:20:05.970066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:20:05.970066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:20:05.970066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:20:05.970066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:20:05.970066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 592/1195] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:20:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:20:05.975033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64878723-3a62-4646-861c-8cf8b71fd74d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:20:06.040862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:06.076501 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64878723-3a62-4646-861c-8cf8b71fd74d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:20:06.109374 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf157d-4334-4c63-89e2-e941efeed2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:20:06.109978 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf157d-4334-4c63-89e2-e941efeed2aa None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:20:06.110260 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf157d-4334-4c63-89e2-e941efeed2aa None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:20:06.110534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf157d-4334-4c63-89e2-e941efeed2aa None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:20:06.111189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf157d-4334-4c63-89e2-e941efeed2aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:20:06.111492 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf157d-4334-4c63-89e2-e941efeed2aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:20:06.113481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf157d-4334-4c63-89e2-e941efeed2aa None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:20:06.121266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 604/1196] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:20:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:20:06.127340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b4920-c994-423b-804a-f07d58d3acfd None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:20:06.236618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b4920-c994-423b-804a-f07d58d3acfd None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:20:06.270463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cf45a-a30d-4c8f-8d37-c455e8e268c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:20:06.271085 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cf45a-a30d-4c8f-8d37-c455e8e268c0 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:20:06.271395 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cf45a-a30d-4c8f-8d37-c455e8e268c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:20:06.271666 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cf45a-a30d-4c8f-8d37-c455e8e268c0 None admin] PATH_INFO: `/v3/users/aa59771d47ad4316896f065a7bff4c79` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:20:06.272792 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cf45a-a30d-4c8f-8d37-c455e8e268c0 None admin] RBAC: Authorizing `identity:get_user(user_id=aa59771d47ad4316896f065a7bff4c79)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:20:06.274212 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cf45a-a30d-4c8f-8d37-c455e8e268c0 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:20:06.275774 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 593/1197] 10.222.0.96 () {56 vars in 1177 bytes} [Wed Aug 24 04:20:06 2022] GET /identity/v3/users/aa59771d47ad4316896f065a7bff4c79 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:20:06.281724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf157d-4334-4c63-89e2-e941efeed2aa None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:20:06.380945 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf157d-4334-4c63-89e2-e941efeed2aa None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:20:06.408086 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:06.415097 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8ab32-963e-4e9f-b086-c5eca6f88380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:20:06.415701 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8ab32-963e-4e9f-b086-c5eca6f88380 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:20:06.415986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8ab32-963e-4e9f-b086-c5eca6f88380 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:20:06.416264 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8ab32-963e-4e9f-b086-c5eca6f88380 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:20:06.481798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8ab32-963e-4e9f-b086-c5eca6f88380 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:20:06.483245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8ab32-963e-4e9f-b086-c5eca6f88380 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:20:06.579959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 605/1198] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:20:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:20:06.585926 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cf45a-a30d-4c8f-8d37-c455e8e268c0 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:20:06.600142 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:06.687130 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cf45a-a30d-4c8f-8d37-c455e8e268c0 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:20:06.719797 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e93c8-f869-4067-a224-c9fb7369521f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:20:06.720453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e93c8-f869-4067-a224-c9fb7369521f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:20:06.720762 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e93c8-f869-4067-a224-c9fb7369521f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:20:06.721039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e93c8-f869-4067-a224-c9fb7369521f None admin] PATH_INFO: `/v3/projects/2c859bd96a0c4d94917eabfdb491fdf0` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:20:06.722987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e93c8-f869-4067-a224-c9fb7369521f None admin] RBAC: Authorizing `identity:get_project(project_id=2c859bd96a0c4d94917eabfdb491fdf0)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:20:06.724414 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e93c8-f869-4067-a224-c9fb7369521f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:20:06.726061 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 594/1199] 10.222.0.96 () {56 vars in 1186 bytes} [Wed Aug 24 04:20:06 2022] GET /identity/v3/projects/2c859bd96a0c4d94917eabfdb491fdf0 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:20:06.732143 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8ab32-963e-4e9f-b086-c5eca6f88380 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:20:06.761715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:06.835763 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8ab32-963e-4e9f-b086-c5eca6f88380 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:20:06.871707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65dbfc-1c79-4ebd-8be3-03d9fbd01a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:20:06.872304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65dbfc-1c79-4ebd-8be3-03d9fbd01a29 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:20:06.872584 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65dbfc-1c79-4ebd-8be3-03d9fbd01a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:20:06.872880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65dbfc-1c79-4ebd-8be3-03d9fbd01a29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:20:06.873594 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65dbfc-1c79-4ebd-8be3-03d9fbd01a29 None admin] RBAC: Adding query filter params (role.id=059d2bf5bb8e42939f5f826bfdad6a21, scope.project.id=2c859bd96a0c4d94917eabfdb491fdf0, user.id=aa59771d47ad4316896f065a7bff4c79) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:20:06.873902 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65dbfc-1c79-4ebd-8be3-03d9fbd01a29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:20:06.875321 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65dbfc-1c79-4ebd-8be3-03d9fbd01a29 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:20:06.881019 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 606/1200] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:20:06 2022] GET /identity/v3/role_assignments?user.id=aa59771d47ad4316896f065a7bff4c79&scope.project.id=2c859bd96a0c4d94917eabfdb491fdf0&role.id=059d2bf5bb8e42939f5f826bfdad6a21 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:20:16.715708 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=61 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:16.878568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=53 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:02.551846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f902e03-f1f7-4ad3-b2d0-10d7636cbbc8 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:02.552496 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f902e03-f1f7-4ad3-b2d0-10d7636cbbc8 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:02.552496 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f902e03-f1f7-4ad3-b2d0-10d7636cbbc8 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:02.554978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 595/1201] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:21:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:21:02.561096 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553a901-6d7f-43bb-8362-2cb5be6827ec None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:02.561632 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553a901-6d7f-43bb-8362-2cb5be6827ec None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:02.561816 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553a901-6d7f-43bb-8362-2cb5be6827ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:02.581698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9553a901-6d7f-43bb-8362-2cb5be6827ec None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:21:02.583656 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9553a901-6d7f-43bb-8362-2cb5be6827ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:21:02.668193 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 607/1202] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:21:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:21:02.947155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f902e03-f1f7-4ad3-b2d0-10d7636cbbc8 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:03.077739 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f902e03-f1f7-4ad3-b2d0-10d7636cbbc8 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:03.119985 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318ed7e-7cec-485f-9472-8ba2c494fa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:03.120624 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318ed7e-7cec-485f-9472-8ba2c494fa47 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:03.120960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318ed7e-7cec-485f-9472-8ba2c494fa47 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:03.121230 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318ed7e-7cec-485f-9472-8ba2c494fa47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:03.135938 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318ed7e-7cec-485f-9472-8ba2c494fa47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:03.137614 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318ed7e-7cec-485f-9472-8ba2c494fa47 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:03.155584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-a318ed7e-7cec-485f-9472-8ba2c494fa47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:03.155584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:03.155584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:03.155584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:03.155584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:03.155584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:03.155584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:03.155584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:03.155584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:03.155584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:03.155584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:03.155584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:03.155584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:21:03.155584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:21:03.155584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:21:03.155584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:21:03.157025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:03.157025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:03.157025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:03.157025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:03.157025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:03.157025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:03.157025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:03.157025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:03.157025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:03.157025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:03.157025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:03.157025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:03.157025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:03.157025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:03.157025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:03.157025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:03.157025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:21:03.158083 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:21:03.158083 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:03.158083 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:21:03.158083 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 596/1203] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:21:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:21:03.163515 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553a901-6d7f-43bb-8362-2cb5be6827ec None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:03.307581 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553a901-6d7f-43bb-8362-2cb5be6827ec None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:03.348720 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:03.356219 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a5957-15c8-4054-bd6b-21c79e66f80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:03.356885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a5957-15c8-4054-bd6b-21c79e66f80e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:03.357165 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a5957-15c8-4054-bd6b-21c79e66f80e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:03.357440 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a5957-15c8-4054-bd6b-21c79e66f80e None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:03.360824 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a5957-15c8-4054-bd6b-21c79e66f80e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:03.361129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a5957-15c8-4054-bd6b-21c79e66f80e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:03.362522 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a5957-15c8-4054-bd6b-21c79e66f80e None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:03.375953 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 608/1204] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:03.382639 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318ed7e-7cec-485f-9472-8ba2c494fa47 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:03.446096 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:03.512020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318ed7e-7cec-485f-9472-8ba2c494fa47 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:03.568659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa4fcb-059a-4cf3-a009-91d769e21005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:03.570013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa4fcb-059a-4cf3-a009-91d769e21005 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:03.570322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa4fcb-059a-4cf3-a009-91d769e21005 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:03.570620 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa4fcb-059a-4cf3-a009-91d769e21005 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:03.571509 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa4fcb-059a-4cf3-a009-91d769e21005 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:03.573289 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa4fcb-059a-4cf3-a009-91d769e21005 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:03.602629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 597/1205] 10.222.0.96 () {60 vars in 1132 bytes} [Wed Aug 24 04:21:03 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:21:06.008228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416ee96-c707-4426-ab60-1875e187446f None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:06.008790 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416ee96-c707-4426-ab60-1875e187446f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:06.008938 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416ee96-c707-4426-ab60-1875e187446f None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:06.010302 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 609/1206] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:21:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:21:06.017062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ffed3-f095-4433-a72c-374d60aa51b8 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:06.017535 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ffed3-f095-4433-a72c-374d60aa51b8 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:06.017915 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ffed3-f095-4433-a72c-374d60aa51b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:06.041155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a81ffed3-f095-4433-a72c-374d60aa51b8 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:21:06.042362 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a81ffed3-f095-4433-a72c-374d60aa51b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:21:06.125948 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 598/1207] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:21:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:21:06.457967 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416ee96-c707-4426-ab60-1875e187446f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:06.576163 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416ee96-c707-4426-ab60-1875e187446f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:06.617479 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b533d-d2eb-4cd5-b256-1dcdc4d4846e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:06.618156 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b533d-d2eb-4cd5-b256-1dcdc4d4846e None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:06.618589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b533d-d2eb-4cd5-b256-1dcdc4d4846e None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:06.618790 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b533d-d2eb-4cd5-b256-1dcdc4d4846e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:06.636900 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b533d-d2eb-4cd5-b256-1dcdc4d4846e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:21:06.643669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-0f3b533d-d2eb-4cd5-b256-1dcdc4d4846e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:21:06.643669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:06.643669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:06.643669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:06.643669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:06.643669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:06.643669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:06.643669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:06.643669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:06.643669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:06.643669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:06.643669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:06.643669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:21:06.643669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:21:06.643669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:21:06.643669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:21:06.644892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:21:06.644892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:21:06.644892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:21:06.644892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:21:06.644892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:06.644892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:06.644892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:06.644892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:06.644892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:06.644892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:06.644892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:06.644892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:06.644892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:06.644892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:06.644892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:06.644892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:06.645796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:06.645796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:06.645796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:06.645796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:06.645796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:21:06.645796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:21:06.645796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:21:06.645796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:21:06.645796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:21:06.645796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:21:06.645796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:21:06.645796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:06.649780 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 610/1208] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:21:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:06.653140 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ffed3-f095-4433-a72c-374d60aa51b8 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:06.702916 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:06.779101 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ffed3-f095-4433-a72c-374d60aa51b8 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:06.832311 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35938cc8-15b3-4912-86f1-8f1c35730d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:06.832311 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35938cc8-15b3-4912-86f1-8f1c35730d3a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:06.832311 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35938cc8-15b3-4912-86f1-8f1c35730d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:06.832311 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35938cc8-15b3-4912-86f1-8f1c35730d3a None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:06.832783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35938cc8-15b3-4912-86f1-8f1c35730d3a None admin] RBAC: Adding query filter params (name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:06.832783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35938cc8-15b3-4912-86f1-8f1c35730d3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:06.834056 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35938cc8-15b3-4912-86f1-8f1c35730d3a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:06.845116 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 599/1209] 10.222.0.96 () {56 vars in 1103 bytes} [Wed Aug 24 04:21:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:06.853844 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b533d-d2eb-4cd5-b256-1dcdc4d4846e None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:06.920479 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:07.004877 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b533d-d2eb-4cd5-b256-1dcdc4d4846e None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:07.044812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c11e84-c55c-4f9d-8b73-cd9fca1354f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:07.044812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c11e84-c55c-4f9d-8b73-cd9fca1354f8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:07.045522 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c11e84-c55c-4f9d-8b73-cd9fca1354f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:07.045522 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c11e84-c55c-4f9d-8b73-cd9fca1354f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:07.056698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c11e84-c55c-4f9d-8b73-cd9fca1354f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:07.058195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c11e84-c55c-4f9d-8b73-cd9fca1354f8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:07.074144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-07c11e84-c55c-4f9d-8b73-cd9fca1354f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:07.074144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:07.074144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:07.074144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:07.074144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:07.074144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:07.074144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:07.074144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:07.074144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:07.074144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:07.074144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:07.074144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:07.074144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:21:07.074144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:21:07.074144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:21:07.074144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:21:07.075391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:07.075391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:07.075391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:07.075391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:07.075391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:07.075391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:07.075391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:07.075391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:07.075391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:07.075391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:07.075391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:07.075391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:07.075391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:07.075391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:07.075391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:07.075391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:07.075391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:21:07.076525 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:21:07.076525 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:07.076525 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:07.076525 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 611/1210] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:21:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:07.085440 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35938cc8-15b3-4912-86f1-8f1c35730d3a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:07.215321 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:07.223312 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35938cc8-15b3-4912-86f1-8f1c35730d3a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:07.278461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60230753-3648-439b-a0ef-137cc55fe179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:07.279518 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60230753-3648-439b-a0ef-137cc55fe179 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:07.279981 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60230753-3648-439b-a0ef-137cc55fe179 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:07.280363 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60230753-3648-439b-a0ef-137cc55fe179 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:07.281513 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60230753-3648-439b-a0ef-137cc55fe179 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:07.283438 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60230753-3648-439b-a0ef-137cc55fe179 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:07.283863 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60230753-3648-439b-a0ef-137cc55fe179 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:07.304433 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 600/1211] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:07.310361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c11e84-c55c-4f9d-8b73-cd9fca1354f8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:07.432442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c11e84-c55c-4f9d-8b73-cd9fca1354f8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:07.436046 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:07.476755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952f419-b142-44c1-b944-052e30aaac36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:07.477524 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952f419-b142-44c1-b944-052e30aaac36 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:07.477809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952f419-b142-44c1-b944-052e30aaac36 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:07.478089 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952f419-b142-44c1-b944-052e30aaac36 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:07.486290 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952f419-b142-44c1-b944-052e30aaac36 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:07.487955 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952f419-b142-44c1-b944-052e30aaac36 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:07.502863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-b952f419-b142-44c1-b944-052e30aaac36 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:21:07.502863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:07.502863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:07.502863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:07.502863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:07.502863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:07.502863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:07.502863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:07.502863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:07.502863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:07.502863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:07.502863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:07.502863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:21:07.502863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:21:07.502863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:21:07.502863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:21:07.508959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:07.508959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:07.508959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:21:07.508959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:21:07.508959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:21:07.508959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:21:07.508959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:07.508959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:07.508959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:07.508959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:07.508959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:07.508959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:07.508959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:07.508959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:07.508959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:07.508959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:07.508959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:07.508959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:07.510157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:07.510157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:07.510157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:21:07.510157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:21:07.510157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:21:07.510157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:21:07.510157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:21:07.510157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:21:07.510157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:21:07.510157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:07.510157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 612/1212] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:21:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:07.513052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60230753-3648-439b-a0ef-137cc55fe179 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:07.633713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60230753-3648-439b-a0ef-137cc55fe179 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:07.674305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffd6e7-9376-414e-9c1d-ccbfa9db15e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:07.674939 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffd6e7-9376-414e-9c1d-ccbfa9db15e8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:07.675440 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffd6e7-9376-414e-9c1d-ccbfa9db15e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:07.675566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffd6e7-9376-414e-9c1d-ccbfa9db15e8 None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:07.676269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffd6e7-9376-414e-9c1d-ccbfa9db15e8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:07.676630 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffd6e7-9376-414e-9c1d-ccbfa9db15e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:07.678069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffd6e7-9376-414e-9c1d-ccbfa9db15e8 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:07.699368 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 601/1213] 10.222.0.96 () {56 vars in 1143 bytes} [Wed Aug 24 04:21:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:07.704905 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952f419-b142-44c1-b944-052e30aaac36 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:07.843677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952f419-b142-44c1-b944-052e30aaac36 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:07.884921 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52939e28-823b-4808-9d31-b9025e45b9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:07.885525 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52939e28-823b-4808-9d31-b9025e45b9d8 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:07.885867 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52939e28-823b-4808-9d31-b9025e45b9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:07.886145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52939e28-823b-4808-9d31-b9025e45b9d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:07.919648 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:07.965619 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52939e28-823b-4808-9d31-b9025e45b9d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:07.967194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52939e28-823b-4808-9d31-b9025e45b9d8 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:08.092280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 613/1214] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:21:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:21:08.098419 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffd6e7-9376-414e-9c1d-ccbfa9db15e8 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:08.120535 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:08.210837 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffd6e7-9376-414e-9c1d-ccbfa9db15e8 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:08.250705 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716c984-8359-46ea-bc80-ae74be2a6a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:08.251351 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716c984-8359-46ea-bc80-ae74be2a6a32 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:08.251676 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716c984-8359-46ea-bc80-ae74be2a6a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:08.251924 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716c984-8359-46ea-bc80-ae74be2a6a32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:08.264338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716c984-8359-46ea-bc80-ae74be2a6a32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:08.265837 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716c984-8359-46ea-bc80-ae74be2a6a32 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:08.281524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-d716c984-8359-46ea-bc80-ae74be2a6a32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:08.281524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:08.281524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:08.281524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:08.281524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:08.281524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:08.281524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:08.281524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:08.281524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:08.281524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:08.281524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:08.281524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:08.281524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:21:08.281524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:21:08.281524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:21:08.281524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:21:08.282741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:08.282741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:08.282741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:08.282741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:08.282741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:08.282741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:08.282741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:08.282741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:08.282741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:08.282741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:08.282741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:08.282741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:08.282741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:08.282741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:08.282741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:08.282741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:08.282741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:21:08.284031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:21:08.284031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:08.284031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:21:08.287535 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 602/1215] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:21:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:08.289062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52939e28-823b-4808-9d31-b9025e45b9d8 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:08.358262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:08.402991 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52939e28-823b-4808-9d31-b9025e45b9d8 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:08.441871 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d4959-5156-4274-b6fa-afc76128b439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:08.442579 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d4959-5156-4274-b6fa-afc76128b439 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:08.442934 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d4959-5156-4274-b6fa-afc76128b439 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:08.443280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d4959-5156-4274-b6fa-afc76128b439 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:08.443997 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d4959-5156-4274-b6fa-afc76128b439 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:08.444419 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d4959-5156-4274-b6fa-afc76128b439 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:08.446039 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d4959-5156-4274-b6fa-afc76128b439 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:08.470737 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 614/1216] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:21:08.472008 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716c984-8359-46ea-bc80-ae74be2a6a32 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:08.547480 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:08.580992 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716c984-8359-46ea-bc80-ae74be2a6a32 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:08.623058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1659fc1-7c2f-4cab-a9e1-53c9e21f6546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:08.623695 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1659fc1-7c2f-4cab-a9e1-53c9e21f6546 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:08.623950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1659fc1-7c2f-4cab-a9e1-53c9e21f6546 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:08.624217 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1659fc1-7c2f-4cab-a9e1-53c9e21f6546 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:08.631335 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1659fc1-7c2f-4cab-a9e1-53c9e21f6546 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:08.632995 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1659fc1-7c2f-4cab-a9e1-53c9e21f6546 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:08.647039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-c1659fc1-7c2f-4cab-a9e1-53c9e21f6546 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:21:08.647039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:08.647039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:08.647039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:08.647039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:08.647039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:08.647039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:08.647039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:08.647039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:08.647039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:08.647039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:08.647039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:08.647039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:21:08.647039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:21:08.647039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:21:08.653517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:21:08.653517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:08.653517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:08.653517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:08.653517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:08.653517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:08.653517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:08.653517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:08.653517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:08.653517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:08.653517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:08.653517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:08.653517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:08.653517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:08.653517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:08.653517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:08.653517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:08.654651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:21:08.654651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:21:08.654651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:21:08.654651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:21:08.654651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:21:08.654651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:21:08.654651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:21:08.654651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:21:08.654651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 603/1217] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:21:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:08.655271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d4959-5156-4274-b6fa-afc76128b439 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:08.773966 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d4959-5156-4274-b6fa-afc76128b439 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:08.798972 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:08.813137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5537d-3470-45f5-94d3-c182944e7024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:08.815033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5537d-3470-45f5-94d3-c182944e7024 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:08.815033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5537d-3470-45f5-94d3-c182944e7024 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:08.815033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5537d-3470-45f5-94d3-c182944e7024 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:08.819496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5537d-3470-45f5-94d3-c182944e7024 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:08.819496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5537d-3470-45f5-94d3-c182944e7024 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:08.819496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5537d-3470-45f5-94d3-c182944e7024 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:08.848300 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 615/1218] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:21:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:08.849544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1659fc1-7c2f-4cab-a9e1-53c9e21f6546 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:08.966369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1659fc1-7c2f-4cab-a9e1-53c9e21f6546 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:08.999319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:09.008051 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfce11-0e3d-4b80-a648-63b4540ac73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:09.008943 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfce11-0e3d-4b80-a648-63b4540ac73d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:09.009200 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfce11-0e3d-4b80-a648-63b4540ac73d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:09.009512 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfce11-0e3d-4b80-a648-63b4540ac73d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:09.010322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfce11-0e3d-4b80-a648-63b4540ac73d None admin] RBAC: Adding query filter params (role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=d1f7fe9af30947dbae1f2334b18f630d) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:09.010653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfce11-0e3d-4b80-a648-63b4540ac73d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:09.012247 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfce11-0e3d-4b80-a648-63b4540ac73d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:09.027385 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 604/1219] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:21:08 2022] GET /identity/v3/role_assignments?user.id=d1f7fe9af30947dbae1f2334b18f630d&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:10.961245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897e4ee-97ca-4b26-be56-5dd626971901 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:10.961860 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897e4ee-97ca-4b26-be56-5dd626971901 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:10.961860 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897e4ee-97ca-4b26-be56-5dd626971901 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:10.963157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 616/1220] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:21:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:21:10.968873 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47350d3-f6be-44e7-808a-fed37f5942f2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:10.969325 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47350d3-f6be-44e7-808a-fed37f5942f2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:10.969442 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47350d3-f6be-44e7-808a-fed37f5942f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:10.988716 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e47350d3-f6be-44e7-808a-fed37f5942f2 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:21:10.989933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e47350d3-f6be-44e7-808a-fed37f5942f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:21:11.065241 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 605/1221] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:21:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:21:11.351754 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897e4ee-97ca-4b26-be56-5dd626971901 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:11.456474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897e4ee-97ca-4b26-be56-5dd626971901 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:11.494857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d722989-e773-4c2a-9326-854d677db563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:11.495500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d722989-e773-4c2a-9326-854d677db563 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:11.495800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d722989-e773-4c2a-9326-854d677db563 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:11.496125 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d722989-e773-4c2a-9326-854d677db563 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:11.507521 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d722989-e773-4c2a-9326-854d677db563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:21:11.512411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-7d722989-e773-4c2a-9326-854d677db563 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:21:11.512411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:11.512411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:11.512411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:11.512411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:11.512411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:11.512411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:11.512411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:11.512411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:11.512411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:11.512411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:11.512411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:11.512411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:21:11.512411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:21:11.512411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:21:11.512411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:21:11.513574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:21:11.513574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:21:11.513574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:21:11.513574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:21:11.513574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:11.513574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:11.513574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:11.513574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:11.513574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:11.513574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:11.513574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:11.513574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:11.513574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:11.513574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:11.513574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:11.513574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:11.517996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:11.517996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:11.517996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:11.517996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:11.517996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:21:11.517996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:21:11.517996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:21:11.517996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:21:11.517996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:21:11.517996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:21:11.517996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:21:11.517996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:11.517996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 617/1222] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:21:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:11.519662 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47350d3-f6be-44e7-808a-fed37f5942f2 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:11.635215 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47350d3-f6be-44e7-808a-fed37f5942f2 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:11.660884 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:11.674109 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7551350-18e8-462f-b5c6-39d61af3ba17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:11.674801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7551350-18e8-462f-b5c6-39d61af3ba17 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:11.675181 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7551350-18e8-462f-b5c6-39d61af3ba17 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:11.675503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7551350-18e8-462f-b5c6-39d61af3ba17 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:11.676234 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7551350-18e8-462f-b5c6-39d61af3ba17 None admin] RBAC: Adding query filter params (name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:11.676598 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7551350-18e8-462f-b5c6-39d61af3ba17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:11.678199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7551350-18e8-462f-b5c6-39d61af3ba17 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:11.687840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 606/1223] 10.222.0.96 () {56 vars in 1103 bytes} [Wed Aug 24 04:21:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:21:11.693846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d722989-e773-4c2a-9326-854d677db563 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:11.740499 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:11.803288 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d722989-e773-4c2a-9326-854d677db563 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:11.845510 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dda84-c7c5-4bf2-a426-68a19d489fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:11.846154 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dda84-c7c5-4bf2-a426-68a19d489fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:11.846440 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dda84-c7c5-4bf2-a426-68a19d489fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:11.846725 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dda84-c7c5-4bf2-a426-68a19d489fc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:11.858084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44dda84-c7c5-4bf2-a426-68a19d489fc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:11.859563 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44dda84-c7c5-4bf2-a426-68a19d489fc1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:11.874052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-e44dda84-c7c5-4bf2-a426-68a19d489fc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:11.874052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:11.874052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:11.874052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:11.874052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:11.874052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:11.874052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:11.874052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:11.874052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:11.874052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:11.874052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:11.874052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:11.874052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:21:11.874052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:21:11.874052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:21:11.874052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:21:11.875243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:11.875243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:11.875243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:11.875243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:11.875243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:11.875243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:11.875243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:11.875243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:11.875243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:11.875243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:11.875243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:11.875243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:11.875243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:11.875243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:11.875243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:11.875243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:11.875243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:21:11.876377 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:21:11.876377 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:11.876377 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:11.876920 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 618/1224] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:21:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:11.881448 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7551350-18e8-462f-b5c6-39d61af3ba17 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:11.998794 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7551350-18e8-462f-b5c6-39d61af3ba17 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:12.038298 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e68f2-356c-44f3-8a02-3ec4c8e6761d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:12.038983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e68f2-356c-44f3-8a02-3ec4c8e6761d None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:12.039397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e68f2-356c-44f3-8a02-3ec4c8e6761d None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:12.039733 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e68f2-356c-44f3-8a02-3ec4c8e6761d None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:12.040401 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e68f2-356c-44f3-8a02-3ec4c8e6761d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:12.040749 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e68f2-356c-44f3-8a02-3ec4c8e6761d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:12.042418 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e68f2-356c-44f3-8a02-3ec4c8e6761d None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:12.061470 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 607/1225] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:12.062754 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dda84-c7c5-4bf2-a426-68a19d489fc1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:12.168156 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:12.175542 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dda84-c7c5-4bf2-a426-68a19d489fc1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:12.217017 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b36926-a4ad-4524-94b1-7d41c4010d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:12.217658 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b36926-a4ad-4524-94b1-7d41c4010d60 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:12.218309 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b36926-a4ad-4524-94b1-7d41c4010d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:12.218309 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b36926-a4ad-4524-94b1-7d41c4010d60 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:12.225879 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b36926-a4ad-4524-94b1-7d41c4010d60 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:12.227476 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b36926-a4ad-4524-94b1-7d41c4010d60 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:12.240617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-c4b36926-a4ad-4524-94b1-7d41c4010d60 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:21:12.240617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:12.240617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:12.240617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:12.240617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:12.240617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:12.240617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:12.240617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:12.240617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:12.240617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:12.240617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:12.240617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:12.240617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:21:12.240617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:21:12.240617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:21:12.240617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:21:12.242196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:12.242196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:12.242196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:21:12.242196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:21:12.242196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:21:12.242196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:21:12.242196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:12.242196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:12.242196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:12.242196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:12.242196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:12.242196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:12.242196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:12.242196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:12.242196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:12.242196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:12.242196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:12.242196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:12.243482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:12.243482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:12.243482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:21:12.243482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:21:12.243482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:21:12.243482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:21:12.243482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:21:12.243482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:21:12.243482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:21:12.243482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:12.243482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 619/1226] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:21:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:12.248569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e68f2-356c-44f3-8a02-3ec4c8e6761d None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:12.303330 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:12.363861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e68f2-356c-44f3-8a02-3ec4c8e6761d None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:12.403209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5666c75-9bca-4284-bd38-3aa02d2e66ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:12.403846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5666c75-9bca-4284-bd38-3aa02d2e66ed None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:12.404136 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5666c75-9bca-4284-bd38-3aa02d2e66ed None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:12.404418 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5666c75-9bca-4284-bd38-3aa02d2e66ed None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:12.405252 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5666c75-9bca-4284-bd38-3aa02d2e66ed None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:12.405585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5666c75-9bca-4284-bd38-3aa02d2e66ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:12.407190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5666c75-9bca-4284-bd38-3aa02d2e66ed None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:12.426572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 608/1227] 10.222.0.96 () {56 vars in 1143 bytes} [Wed Aug 24 04:21:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:12.433266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b36926-a4ad-4524-94b1-7d41c4010d60 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:12.547541 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b36926-a4ad-4524-94b1-7d41c4010d60 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:12.587580 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b8c30-f611-4d06-89ef-e341ced961da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:12.588278 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b8c30-f611-4d06-89ef-e341ced961da None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:12.588608 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b8c30-f611-4d06-89ef-e341ced961da None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:12.588940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b8c30-f611-4d06-89ef-e341ced961da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:12.601170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b8c30-f611-4d06-89ef-e341ced961da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:12.602761 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b8c30-f611-4d06-89ef-e341ced961da None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:12.618690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-470b8c30-f611-4d06-89ef-e341ced961da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:12.618690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:12.618690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:12.618690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:12.618690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:12.618690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:12.618690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:12.618690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:12.618690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:12.618690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:12.618690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:12.618690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:12.618690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:21:12.618690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:21:12.618690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:21:12.618690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:21:12.620093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:12.620093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:12.620093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:12.620093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:12.620093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:12.620093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:12.620093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:12.620093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:12.620093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:12.620093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:12.620093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:12.620093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:12.620093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:12.620093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:12.620093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:12.620093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:12.620093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:21:12.621014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:21:12.621014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:12.621014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:12.621014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 620/1228] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:21:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:12.626340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5666c75-9bca-4284-bd38-3aa02d2e66ed None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:12.750274 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5666c75-9bca-4284-bd38-3aa02d2e66ed None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:12.752609 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:12.790827 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817c7bd-295d-4423-92bd-916ed5972895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:12.791491 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817c7bd-295d-4423-92bd-916ed5972895 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:12.791728 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817c7bd-295d-4423-92bd-916ed5972895 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:12.792053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817c7bd-295d-4423-92bd-916ed5972895 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:12.792760 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817c7bd-295d-4423-92bd-916ed5972895 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:12.793131 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817c7bd-295d-4423-92bd-916ed5972895 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:12.794581 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817c7bd-295d-4423-92bd-916ed5972895 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:12.808026 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 609/1229] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:12.813885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b8c30-f611-4d06-89ef-e341ced961da None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:12.823745 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:12.933218 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b8c30-f611-4d06-89ef-e341ced961da None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:12.971951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac776def-a8e9-4a8d-9b34-89996b982724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:12.972582 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac776def-a8e9-4a8d-9b34-89996b982724 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:12.972893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac776def-a8e9-4a8d-9b34-89996b982724 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:12.973171 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac776def-a8e9-4a8d-9b34-89996b982724 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:12.980488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac776def-a8e9-4a8d-9b34-89996b982724 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:12.982133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac776def-a8e9-4a8d-9b34-89996b982724 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:12.995731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-ac776def-a8e9-4a8d-9b34-89996b982724 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:21:12.995731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:12.995731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:12.995731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:12.995731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:12.995731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:12.995731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:12.995731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:12.995731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:12.995731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:12.995731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:12.995731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:12.995731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:21:12.995731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:21:12.995731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:21:12.996872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:21:12.996872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:12.996872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:12.996872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:12.996872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:12.996872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:12.996872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:12.996872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:12.996872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:12.996872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:12.996872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:12.996872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:12.996872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:12.996872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:12.996872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:12.996872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:12.996872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:12.997833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:21:12.997833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:21:12.997833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:21:12.997833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:21:12.997833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:21:12.997833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:21:12.997833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:21:12.997833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:12.997833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 621/1230] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:21:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:13.003157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817c7bd-295d-4423-92bd-916ed5972895 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:13.117439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817c7bd-295d-4423-92bd-916ed5972895 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:13.153519 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7371fd-55e8-422c-93dd-6dc4c71f308e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:13.154133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7371fd-55e8-422c-93dd-6dc4c71f308e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:13.154414 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7371fd-55e8-422c-93dd-6dc4c71f308e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:13.154690 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7371fd-55e8-422c-93dd-6dc4c71f308e None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:13.155391 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7371fd-55e8-422c-93dd-6dc4c71f308e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:13.155702 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7371fd-55e8-422c-93dd-6dc4c71f308e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:13.157175 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7371fd-55e8-422c-93dd-6dc4c71f308e None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:13.170974 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 610/1231] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:21:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:21:13.177110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac776def-a8e9-4a8d-9b34-89996b982724 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:13.254634 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:13.296136 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac776def-a8e9-4a8d-9b34-89996b982724 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:13.332473 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852f616-d270-4996-b4d8-cb247a91f512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:13.333193 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852f616-d270-4996-b4d8-cb247a91f512 None admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:13.333473 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852f616-d270-4996-b4d8-cb247a91f512 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:13.333749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852f616-d270-4996-b4d8-cb247a91f512 None admin] PATH_INFO: `/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/d1f7fe9af30947dbae1f2334b18f630d/roles/f1c5993fc3be47ef98bfd2ae3cdcd6e7` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:13.349398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852f616-d270-4996-b4d8-cb247a91f512 None admin] RBAC: Authorizing `identity:create_grant(project_id=d76b6cd68a7f4613a8e921781495f256, user_id=d1f7fe9af30947dbae1f2334b18f630d, role_id=f1c5993fc3be47ef98bfd2ae3cdcd6e7)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:13.351500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852f616-d270-4996-b4d8-cb247a91f512 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:13.363302 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 622/1232] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:21:13 2022] PUT /identity/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/d1f7fe9af30947dbae1f2334b18f630d/roles/f1c5993fc3be47ef98bfd2ae3cdcd6e7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:21:15.355390 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511bde8-a703-4341-9969-cf77123d4b8e None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:15.356089 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511bde8-a703-4341-9969-cf77123d4b8e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:15.356089 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511bde8-a703-4341-9969-cf77123d4b8e None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:15.357333 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 611/1233] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:21:15.362832 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975f424-1f15-46a9-96e8-1901896798fc None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:15.363269 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975f424-1f15-46a9-96e8-1901896798fc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:15.363382 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975f424-1f15-46a9-96e8-1901896798fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:15.382427 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9975f424-1f15-46a9-96e8-1901896798fc None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:21:15.383627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9975f424-1f15-46a9-96e8-1901896798fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:21:15.457003 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 623/1234] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:21:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:21:15.722908 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511bde8-a703-4341-9969-cf77123d4b8e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:15.751222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:15.847959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511bde8-a703-4341-9969-cf77123d4b8e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:15.887710 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c98b1d-e443-4b63-bb98-1e0d8c9a9046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:15.888426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c98b1d-e443-4b63-bb98-1e0d8c9a9046 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:15.888744 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c98b1d-e443-4b63-bb98-1e0d8c9a9046 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:15.889088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c98b1d-e443-4b63-bb98-1e0d8c9a9046 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:15.900876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c98b1d-e443-4b63-bb98-1e0d8c9a9046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:21:15.905988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-e7c98b1d-e443-4b63-bb98-1e0d8c9a9046 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:21:15.905988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:15.905988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:15.905988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:15.905988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:15.905988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:15.905988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:15.905988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:15.905988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:15.905988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:15.905988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:15.905988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:15.905988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:21:15.905988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:21:15.905988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:21:15.905988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:21:15.907182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:21:15.907182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:21:15.907182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:21:15.907182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:21:15.907182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:15.907182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:15.907182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:15.907182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:15.907182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:15.907182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:15.907182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:15.907182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:15.907182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:15.907182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:15.907182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:15.907182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:15.908192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:15.908192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:15.908192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:15.908192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:15.908192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:21:15.908192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:21:15.908192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:21:15.908192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:21:15.908192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:21:15.908192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:21:15.908192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:21:15.908192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:21:15.908192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 612/1235] 10.222.0.96 () {56 vars in 1102 bytes} [Wed Aug 24 04:21:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:15.913808 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975f424-1f15-46a9-96e8-1901896798fc None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:15.963422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:16.023654 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975f424-1f15-46a9-96e8-1901896798fc None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:16.065092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9615844-5773-4b76-8087-f138cf0eb4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:16.065854 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9615844-5773-4b76-8087-f138cf0eb4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:16.066222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9615844-5773-4b76-8087-f138cf0eb4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:16.066523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9615844-5773-4b76-8087-f138cf0eb4d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:16.067229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9615844-5773-4b76-8087-f138cf0eb4d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:16.067607 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9615844-5773-4b76-8087-f138cf0eb4d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:16.069282 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9615844-5773-4b76-8087-f138cf0eb4d0 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:16.078149 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 624/1236] 10.222.0.96 () {56 vars in 1103 bytes} [Wed Aug 24 04:21:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:16.084204 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c98b1d-e443-4b63-bb98-1e0d8c9a9046 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:16.181878 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:16.201124 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c98b1d-e443-4b63-bb98-1e0d8c9a9046 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:16.240011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dee48a-520b-4e7d-ab60-c4a7f0a603f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:16.240785 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dee48a-520b-4e7d-ab60-c4a7f0a603f8 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:16.241100 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dee48a-520b-4e7d-ab60-c4a7f0a603f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:16.241558 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dee48a-520b-4e7d-ab60-c4a7f0a603f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:16.254537 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dee48a-520b-4e7d-ab60-c4a7f0a603f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:16.256219 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dee48a-520b-4e7d-ab60-c4a7f0a603f8 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:16.279687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-c0dee48a-520b-4e7d-ab60-c4a7f0a603f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:16.279687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:16.279687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:16.279687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:16.279687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:16.279687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:16.279687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:16.279687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:16.279687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:16.279687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:16.279687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:16.279687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:16.279687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:21:16.279687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:21:16.279687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:21:16.279687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:21:16.280968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:16.280968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:16.280968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:16.280968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:16.280968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:16.280968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:16.280968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:16.280968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:16.280968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:16.280968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:16.280968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:16.280968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:16.280968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:16.280968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:16.280968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:16.280968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:16.280968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:21:16.282191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:21:16.282191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:16.282191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:21:16.286172 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 613/1237] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:21:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:16.287475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9615844-5773-4b76-8087-f138cf0eb4d0 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:16.403485 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9615844-5773-4b76-8087-f138cf0eb4d0 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:16.414863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:16.442648 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1ffea-7b8c-41c0-b436-c77d47d354eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:16.443269 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1ffea-7b8c-41c0-b436-c77d47d354eb None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:16.443555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1ffea-7b8c-41c0-b436-c77d47d354eb None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:16.443835 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1ffea-7b8c-41c0-b436-c77d47d354eb None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:16.445228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1ffea-7b8c-41c0-b436-c77d47d354eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:16.445629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1ffea-7b8c-41c0-b436-c77d47d354eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:16.446996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1ffea-7b8c-41c0-b436-c77d47d354eb None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:16.461743 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 625/1238] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:16.467616 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dee48a-520b-4e7d-ab60-c4a7f0a603f8 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:16.580885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dee48a-520b-4e7d-ab60-c4a7f0a603f8 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:16.620112 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106593f9-3a6e-42d3-88ba-aa8598047bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:16.621096 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106593f9-3a6e-42d3-88ba-aa8598047bba None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:16.621376 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106593f9-3a6e-42d3-88ba-aa8598047bba None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:16.621710 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106593f9-3a6e-42d3-88ba-aa8598047bba None admin] PATH_INFO: `/v3/users/placement` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:16.624980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:16.636617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106593f9-3a6e-42d3-88ba-aa8598047bba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:16.639409 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106593f9-3a6e-42d3-88ba-aa8598047bba None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:16.658821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-106593f9-3a6e-42d3-88ba-aa8598047bba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:21:16.658821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:16.658821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:16.658821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:16.658821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:16.658821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:16.658821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:16.658821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:16.658821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:16.658821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:16.658821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:16.658821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:16.658821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:21:16.658821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:21:16.658821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:21:16.658821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:21:16.660420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:16.660420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:16.660420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:21:16.660420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:21:16.660420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:21:16.660420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:21:16.660420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:16.660420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:16.660420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:16.660420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:16.660420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:16.660420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:16.660420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:16.660420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:16.660420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:16.660420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:16.660420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:16.660420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:16.661591 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:16.661591 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:16.661591 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:21:16.661591 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:21:16.661591 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:21:16.661591 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:21:16.661591 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:21:16.661591 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:21:16.661591 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:21:16.661591 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:21:16.661591 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 614/1239] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:21:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:16.666569 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1ffea-7b8c-41c0-b436-c77d47d354eb None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:16.780805 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1ffea-7b8c-41c0-b436-c77d47d354eb None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:16.818869 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9047e9-139d-416a-9805-19af586e5a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:16.820044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9047e9-139d-416a-9805-19af586e5a51 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:16.820484 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9047e9-139d-416a-9805-19af586e5a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:16.820919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9047e9-139d-416a-9805-19af586e5a51 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:16.821736 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9047e9-139d-416a-9805-19af586e5a51 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:16.822051 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9047e9-139d-416a-9805-19af586e5a51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:16.823546 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9047e9-139d-416a-9805-19af586e5a51 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:16.842058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 626/1240] 10.222.0.96 () {56 vars in 1143 bytes} [Wed Aug 24 04:21:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:16.848013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106593f9-3a6e-42d3-88ba-aa8598047bba None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:16.963179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106593f9-3a6e-42d3-88ba-aa8598047bba None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:17.002308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49e636-ab2c-451e-9a80-b160b2db4f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:17.002908 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49e636-ab2c-451e-9a80-b160b2db4f7f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:17.003236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49e636-ab2c-451e-9a80-b160b2db4f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:17.003555 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49e636-ab2c-451e-9a80-b160b2db4f7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:17.076991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:17.084208 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49e636-ab2c-451e-9a80-b160b2db4f7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:17.086082 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49e636-ab2c-451e-9a80-b160b2db4f7f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:17.207882 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 615/1241] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:21:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:21:17.209154 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9047e9-139d-416a-9805-19af586e5a51 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:17.243390 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:17.320987 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9047e9-139d-416a-9805-19af586e5a51 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:17.359445 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991ca04-8860-4b1a-9454-e634f0bd4dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:17.360241 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991ca04-8860-4b1a-9454-e634f0bd4dda None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:17.360647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991ca04-8860-4b1a-9454-e634f0bd4dda None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:17.361063 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991ca04-8860-4b1a-9454-e634f0bd4dda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:17.372935 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991ca04-8860-4b1a-9454-e634f0bd4dda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:17.374395 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991ca04-8860-4b1a-9454-e634f0bd4dda None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:17.389518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-b991ca04-8860-4b1a-9454-e634f0bd4dda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:17.389518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:17.389518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:17.389518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:17.389518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:17.389518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:17.389518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:17.389518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:17.389518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:17.389518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:17.389518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:17.389518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:17.389518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:21:17.389518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:21:17.389518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:21:17.389518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:21:17.390724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:17.390724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:17.390724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:17.390724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:17.390724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:17.390724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:17.390724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:17.390724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:17.390724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:17.390724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:17.390724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:17.390724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:17.390724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:17.390724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:17.390724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:17.390724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:17.390724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:21:17.391701 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:21:17.391701 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:17.391701 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:17.391701 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 627/1242] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:21:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:21:17.396659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49e636-ab2c-451e-9a80-b160b2db4f7f None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:17.498415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:17.505546 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49e636-ab2c-451e-9a80-b160b2db4f7f None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:17.544590 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734e599-5293-4a30-b0bc-fb671904a3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:17.545240 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734e599-5293-4a30-b0bc-fb671904a3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:17.545529 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734e599-5293-4a30-b0bc-fb671904a3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:17.545798 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734e599-5293-4a30-b0bc-fb671904a3e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:17.546443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734e599-5293-4a30-b0bc-fb671904a3e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:17.546752 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734e599-5293-4a30-b0bc-fb671904a3e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:17.548119 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734e599-5293-4a30-b0bc-fb671904a3e4 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:17.560921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 616/1243] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:21:17.567215 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991ca04-8860-4b1a-9454-e634f0bd4dda None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:17.654557 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:17.678561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991ca04-8860-4b1a-9454-e634f0bd4dda None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:17.717410 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a864fc9-e01c-49dd-8cc0-4de929ae4181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:17.718039 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a864fc9-e01c-49dd-8cc0-4de929ae4181 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:17.718319 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a864fc9-e01c-49dd-8cc0-4de929ae4181 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:17.718589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a864fc9-e01c-49dd-8cc0-4de929ae4181 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:17.726615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a864fc9-e01c-49dd-8cc0-4de929ae4181 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:17.728194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a864fc9-e01c-49dd-8cc0-4de929ae4181 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:17.740820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-6a864fc9-e01c-49dd-8cc0-4de929ae4181 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:21:17.740820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:17.740820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:17.740820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:17.740820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:17.740820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:17.740820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:17.740820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:17.740820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:17.740820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:17.740820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:17.740820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:17.740820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:21:17.740820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:21:17.740820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:21:17.742053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:21:17.742053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:17.742053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:17.742053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:17.742053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:17.742053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:17.742053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:17.742053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:17.742053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:17.742053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:17.742053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:17.742053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:17.742053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:17.742053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:17.742053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:17.742053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:17.742053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:17.743167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:21:17.743167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:21:17.743167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:21:17.743167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:21:17.743167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:21:17.743167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:21:17.743167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:21:17.743167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:17.747311 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 628/1244] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:21:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:17.748572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734e599-5293-4a30-b0bc-fb671904a3e4 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:17.870155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734e599-5293-4a30-b0bc-fb671904a3e4 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:17.907660 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd0d83-a0b7-413f-9a0f-53700c72ba3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:17.908427 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd0d83-a0b7-413f-9a0f-53700c72ba3f None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:17.908740 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd0d83-a0b7-413f-9a0f-53700c72ba3f None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:17.909082 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd0d83-a0b7-413f-9a0f-53700c72ba3f None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:17.909879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd0d83-a0b7-413f-9a0f-53700c72ba3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:17.910356 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd0d83-a0b7-413f-9a0f-53700c72ba3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:17.911985 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd0d83-a0b7-413f-9a0f-53700c72ba3f None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:17.925775 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 617/1245] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:21:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:17.932111 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a864fc9-e01c-49dd-8cc0-4de929ae4181 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:18.054884 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a864fc9-e01c-49dd-8cc0-4de929ae4181 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:18.093559 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237ce70-638f-444e-b847-77fbf945cf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:18.094170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237ce70-638f-444e-b847-77fbf945cf48 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:18.094448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237ce70-638f-444e-b847-77fbf945cf48 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:18.094717 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237ce70-638f-444e-b847-77fbf945cf48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:18.095438 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9237ce70-638f-444e-b847-77fbf945cf48 None admin] RBAC: Adding query filter params (role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=d1f7fe9af30947dbae1f2334b18f630d) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:18.095744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9237ce70-638f-444e-b847-77fbf945cf48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:18.097462 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9237ce70-638f-444e-b847-77fbf945cf48 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:18.104596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 629/1246] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:21:17 2022] GET /identity/v3/role_assignments?user.id=d1f7fe9af30947dbae1f2334b18f630d&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=f1c5993fc3be47ef98bfd2ae3cdcd6e7 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:20.227911 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59322960-978c-4c2d-a21c-b96de7d78e21 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:20.228435 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59322960-978c-4c2d-a21c-b96de7d78e21 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:20.228710 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59322960-978c-4c2d-a21c-b96de7d78e21 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:20.230769 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 618/1247] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:21:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:21:20.236549 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352503aa-a30d-4d21-ba37-b64556c1fbae None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:20.237125 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352503aa-a30d-4d21-ba37-b64556c1fbae None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:20.237223 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352503aa-a30d-4d21-ba37-b64556c1fbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:20.245064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:20.259159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-352503aa-a30d-4d21-ba37-b64556c1fbae None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:21:20.260398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-352503aa-a30d-4d21-ba37-b64556c1fbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:21:20.343920 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 630/1248] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:21:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:21:20.637398 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59322960-978c-4c2d-a21c-b96de7d78e21 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:20.657934 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:20.765312 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59322960-978c-4c2d-a21c-b96de7d78e21 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:20.805498 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53171a9b-34f4-4a7d-932f-9721c0f1ab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:20.806218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53171a9b-34f4-4a7d-932f-9721c0f1ab04 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:20.806502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53171a9b-34f4-4a7d-932f-9721c0f1ab04 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:20.806768 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53171a9b-34f4-4a7d-932f-9721c0f1ab04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:20.818485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53171a9b-34f4-4a7d-932f-9721c0f1ab04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:21:20.823764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-53171a9b-34f4-4a7d-932f-9721c0f1ab04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:21:20.823764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:20.823764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:20.823764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:20.823764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:20.823764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:20.823764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:20.823764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:20.823764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:20.823764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:20.823764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:20.823764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:20.823764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:21:20.823764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:21:20.823764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:21:20.823764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:21:20.825156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:21:20.825156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:21:20.825156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:21:20.825156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:21:20.825156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:20.825156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:20.825156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:20.825156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:20.825156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:20.825156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:20.825156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:20.825156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:20.825156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:20.825156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:20.825156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:20.825156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:20.826237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:20.826237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:20.826237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:20.826237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:20.826237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:21:20.826237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:21:20.826237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:21:20.826237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:21:20.826237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:21:20.826237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:21:20.826237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:21:20.826237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:21:20.826237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 619/1249] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:21:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:20.833485 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352503aa-a30d-4d21-ba37-b64556c1fbae None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:20.957429 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352503aa-a30d-4d21-ba37-b64556c1fbae None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:20.994356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:21.001087 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1eb314-1e9d-487e-b8ed-ae877cbec2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:21.001714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eb314-1e9d-487e-b8ed-ae877cbec2cb None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:21.002000 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eb314-1e9d-487e-b8ed-ae877cbec2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:21.002280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1eb314-1e9d-487e-b8ed-ae877cbec2cb None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:21.002955 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1eb314-1e9d-487e-b8ed-ae877cbec2cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:21.003262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1eb314-1e9d-487e-b8ed-ae877cbec2cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:21.005143 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1eb314-1e9d-487e-b8ed-ae877cbec2cb None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:21.015481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 631/1250] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:21:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:21:21.021757 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53171a9b-34f4-4a7d-932f-9721c0f1ab04 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:21.120790 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:21.147225 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53171a9b-34f4-4a7d-932f-9721c0f1ab04 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:21.189403 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0e6da-54e4-4989-aa74-5a97d01f03db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:21.190082 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0e6da-54e4-4989-aa74-5a97d01f03db None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:21.190396 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0e6da-54e4-4989-aa74-5a97d01f03db None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:21.190788 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0e6da-54e4-4989-aa74-5a97d01f03db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:21.204806 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0e6da-54e4-4989-aa74-5a97d01f03db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:21.206548 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0e6da-54e4-4989-aa74-5a97d01f03db None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:21.224643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-62b0e6da-54e4-4989-aa74-5a97d01f03db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:21.224643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:21.224643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:21.224643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:21.224643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:21.224643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:21.224643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:21.224643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:21.224643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:21.224643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:21.224643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:21.224643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:21.224643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:21:21.224643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:21:21.224643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:21:21.224643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:21:21.232260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:21.232260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:21.232260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:21.232260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:21.232260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:21.232260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:21.232260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:21.232260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:21.232260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:21.232260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:21.232260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:21.232260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:21.232260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:21.232260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:21.232260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:21.232260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:21.232260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:21:21.233431 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:21:21.233431 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:21.233431 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:21:21.233431 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 620/1251] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:21:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:21.233678 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1eb314-1e9d-487e-b8ed-ae877cbec2cb None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:21.347515 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1eb314-1e9d-487e-b8ed-ae877cbec2cb None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:21.385595 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea36358-9539-40ac-8c5d-bbe95df347d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:21.386320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea36358-9539-40ac-8c5d-bbe95df347d9 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:21.386570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea36358-9539-40ac-8c5d-bbe95df347d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:21.386922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea36358-9539-40ac-8c5d-bbe95df347d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:21.387642 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea36358-9539-40ac-8c5d-bbe95df347d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:21.387956 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea36358-9539-40ac-8c5d-bbe95df347d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:21.389558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea36358-9539-40ac-8c5d-bbe95df347d9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:21.402576 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 632/1252] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:21.408909 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0e6da-54e4-4989-aa74-5a97d01f03db None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:21.523190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0e6da-54e4-4989-aa74-5a97d01f03db None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:21.548955 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:21.557808 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e78941-0721-457d-9ae2-e7809cc22f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:21.558446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e78941-0721-457d-9ae2-e7809cc22f2a None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:21.558737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e78941-0721-457d-9ae2-e7809cc22f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:21.559012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e78941-0721-457d-9ae2-e7809cc22f2a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:21.566811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e78941-0721-457d-9ae2-e7809cc22f2a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:21.568478 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e78941-0721-457d-9ae2-e7809cc22f2a None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:21.582053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-35e78941-0721-457d-9ae2-e7809cc22f2a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:21:21.582053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:21.582053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:21.582053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:21.582053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:21.582053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:21.582053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:21.582053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:21.582053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:21.582053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:21.582053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:21.582053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:21.582053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:21:21.582053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:21:21.582053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:21:21.582053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:21:21.583182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:21.583182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:21.583182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:21:21.583182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:21:21.583182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:21:21.583182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:21:21.583182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:21.583182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:21.583182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:21.583182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:21.583182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:21.583182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:21.583182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:21.583182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:21.583182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:21.583182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:21.583182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:21.583182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:21.584145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:21.584145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:21.584145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:21:21.584145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:21:21.584145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:21:21.584145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:21:21.584145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:21:21.584145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:21:21.584145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:21:21.584145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:21:21.584145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 621/1253] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:21:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:21.589104 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea36358-9539-40ac-8c5d-bbe95df347d9 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:21.655154 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:21.707540 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea36358-9539-40ac-8c5d-bbe95df347d9 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:21.750327 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6731e-479a-4305-9c8f-f8db0b300a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:21.751091 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6731e-479a-4305-9c8f-f8db0b300a34 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:21.751476 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6731e-479a-4305-9c8f-f8db0b300a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:21.751854 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6731e-479a-4305-9c8f-f8db0b300a34 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:21.752756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6731e-479a-4305-9c8f-f8db0b300a34 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:21.753073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6731e-479a-4305-9c8f-f8db0b300a34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:21.754771 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6731e-479a-4305-9c8f-f8db0b300a34 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:21.784035 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 633/1254] 10.222.0.96 () {56 vars in 1143 bytes} [Wed Aug 24 04:21:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:21.791915 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e78941-0721-457d-9ae2-e7809cc22f2a None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:21.961336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e78941-0721-457d-9ae2-e7809cc22f2a None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:22.009408 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34aeec-9333-4d7e-bad3-422f15f9a236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:22.010334 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34aeec-9333-4d7e-bad3-422f15f9a236 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:22.010812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34aeec-9333-4d7e-bad3-422f15f9a236 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:22.011372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34aeec-9333-4d7e-bad3-422f15f9a236 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:22.088644 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:22.103574 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34aeec-9333-4d7e-bad3-422f15f9a236 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:22.105241 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34aeec-9333-4d7e-bad3-422f15f9a236 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:22.216896 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 622/1255] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:21:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:21:22.222848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6731e-479a-4305-9c8f-f8db0b300a34 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:22.352313 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6731e-479a-4305-9c8f-f8db0b300a34 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:22.368787 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:22.391220 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0ed16-ec54-4e09-8638-0cb2abd010e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:22.391930 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0ed16-ec54-4e09-8638-0cb2abd010e3 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:22.392223 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0ed16-ec54-4e09-8638-0cb2abd010e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:22.392524 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0ed16-ec54-4e09-8638-0cb2abd010e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:22.404080 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0ed16-ec54-4e09-8638-0cb2abd010e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:22.405829 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0ed16-ec54-4e09-8638-0cb2abd010e3 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:22.422596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-98a0ed16-ec54-4e09-8638-0cb2abd010e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:22.422596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:22.422596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:22.422596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:22.422596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:22.422596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:22.422596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:22.422596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:22.422596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:22.422596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:22.422596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:22.422596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:22.422596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:21:22.422596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:21:22.422596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:21:22.422596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:21:22.423841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:22.423841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:22.423841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:22.423841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:22.423841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:22.423841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:22.423841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:22.423841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:22.423841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:22.423841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:22.423841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:22.423841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:22.423841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:22.423841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:22.423841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:22.423841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:22.423841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:21:22.425124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:21:22.425124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:22.425124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:22.425124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 634/1256] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:21:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:22.429598 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34aeec-9333-4d7e-bad3-422f15f9a236 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:22.534870 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:22.547555 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34aeec-9333-4d7e-bad3-422f15f9a236 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:22.585599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101b50d-cb23-41e5-9e27-7d92e7586b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:22.586405 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101b50d-cb23-41e5-9e27-7d92e7586b59 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:22.586833 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101b50d-cb23-41e5-9e27-7d92e7586b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:22.587180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101b50d-cb23-41e5-9e27-7d92e7586b59 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:22.587928 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101b50d-cb23-41e5-9e27-7d92e7586b59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:22.588404 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101b50d-cb23-41e5-9e27-7d92e7586b59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:22.589855 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101b50d-cb23-41e5-9e27-7d92e7586b59 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:22.601823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 623/1257] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:22.607815 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0ed16-ec54-4e09-8638-0cb2abd010e3 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:22.721381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0ed16-ec54-4e09-8638-0cb2abd010e3 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:22.755817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bbd69-927d-4d2a-b89f-034d7e9f44d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:22.757024 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bbd69-927d-4d2a-b89f-034d7e9f44d2 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:22.757369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bbd69-927d-4d2a-b89f-034d7e9f44d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:22.757695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bbd69-927d-4d2a-b89f-034d7e9f44d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:22.766575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bbd69-927d-4d2a-b89f-034d7e9f44d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:22.768173 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bbd69-927d-4d2a-b89f-034d7e9f44d2 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:22.780537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-772bbd69-927d-4d2a-b89f-034d7e9f44d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:21:22.780537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:22.780537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:22.780537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:22.780537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:22.780537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:22.780537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:22.780537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:22.780537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:22.780537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:22.780537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:22.780537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:22.780537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:21:22.780537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:21:22.780537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:21:22.781697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:21:22.781697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:22.781697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:22.781697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:22.781697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:22.781697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:22.781697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:22.781697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:22.781697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:22.781697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:22.781697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:22.781697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:22.781697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:22.781697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:22.781697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:22.781697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:22.781697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:22.782846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:21:22.782846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:21:22.782846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:21:22.782846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:21:22.782846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:21:22.782846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:21:22.782846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:21:22.782846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:22.782846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 635/1258] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:21:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:22.789848 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101b50d-cb23-41e5-9e27-7d92e7586b59 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:22.908544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101b50d-cb23-41e5-9e27-7d92e7586b59 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:22.947928 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47dfda-e3cb-4cf2-9a72-5965c9331098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:22.948928 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47dfda-e3cb-4cf2-9a72-5965c9331098 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:22.949609 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47dfda-e3cb-4cf2-9a72-5965c9331098 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:22.950044 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47dfda-e3cb-4cf2-9a72-5965c9331098 None admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:22.951070 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47dfda-e3cb-4cf2-9a72-5965c9331098 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:22.951504 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47dfda-e3cb-4cf2-9a72-5965c9331098 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:22.953533 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47dfda-e3cb-4cf2-9a72-5965c9331098 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:22.969130 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 624/1259] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:21:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:22.975298 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bbd69-927d-4d2a-b89f-034d7e9f44d2 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:23.002354 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:23.093116 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bbd69-927d-4d2a-b89f-034d7e9f44d2 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:23.138445 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917145e-47dd-4e5e-92af-0301b56c6569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:23.139080 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917145e-47dd-4e5e-92af-0301b56c6569 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:23.139368 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917145e-47dd-4e5e-92af-0301b56c6569 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:23.139647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917145e-47dd-4e5e-92af-0301b56c6569 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:23.140402 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917145e-47dd-4e5e-92af-0301b56c6569 None admin] RBAC: Adding query filter params (role.id=059d2bf5bb8e42939f5f826bfdad6a21, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=d1f7fe9af30947dbae1f2334b18f630d) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:23.140746 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917145e-47dd-4e5e-92af-0301b56c6569 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:23.142236 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917145e-47dd-4e5e-92af-0301b56c6569 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:23.148761 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 636/1260] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:21:22 2022] GET /identity/v3/role_assignments?user.id=d1f7fe9af30947dbae1f2334b18f630d&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=059d2bf5bb8e42939f5f826bfdad6a21 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:25.080804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed809f23-ee95-4ae1-9f11-e3e258455311 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:25.081379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed809f23-ee95-4ae1-9f11-e3e258455311 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:25.081379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed809f23-ee95-4ae1-9f11-e3e258455311 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:25.082779 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 625/1261] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:21:25.088257 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaccf8-80ae-42b9-bd10-dca336622a29 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:25.088666 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaccf8-80ae-42b9-bd10-dca336622a29 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:25.088852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaccf8-80ae-42b9-bd10-dca336622a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:25.107724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8dbaccf8-80ae-42b9-bd10-dca336622a29 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:21:25.108956 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8dbaccf8-80ae-42b9-bd10-dca336622a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:21:25.175285 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 637/1262] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:21:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:21:25.452822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed809f23-ee95-4ae1-9f11-e3e258455311 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:25.464342 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:25.556633 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed809f23-ee95-4ae1-9f11-e3e258455311 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:25.590751 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8b13b-f80b-40b0-add0-8dcfb6a0540e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:25.591377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8b13b-f80b-40b0-add0-8dcfb6a0540e None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:25.591662 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8b13b-f80b-40b0-add0-8dcfb6a0540e None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:25.591941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8b13b-f80b-40b0-add0-8dcfb6a0540e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:25.602003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8b13b-f80b-40b0-add0-8dcfb6a0540e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:21:25.606764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-84f8b13b-f80b-40b0-add0-8dcfb6a0540e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:21:25.606764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:25.606764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:25.606764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:25.606764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:25.606764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:25.606764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:25.606764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:25.606764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:25.606764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:25.606764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:25.606764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:25.606764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:21:25.606764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:21:25.606764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:21:25.606764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:21:25.607933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:21:25.607933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:21:25.607933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:21:25.607933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:21:25.607933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:25.607933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:25.607933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:25.607933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:25.607933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:25.607933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:25.607933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:25.607933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:25.607933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:25.607933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:25.607933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:25.607933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:25.609021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:25.609021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:25.609021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:25.609021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:25.609021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:21:25.609021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:21:25.609021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:21:25.609021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:21:25.609021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:21:25.609021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:21:25.609021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:21:25.609021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:21:25.609021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 626/1263] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:21:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:25.613817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaccf8-80ae-42b9-bd10-dca336622a29 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:25.632446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:25.711426 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaccf8-80ae-42b9-bd10-dca336622a29 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:25.743582 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc690950-b37e-461f-a175-72cb30436574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:25.744176 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc690950-b37e-461f-a175-72cb30436574 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:25.744456 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc690950-b37e-461f-a175-72cb30436574 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:25.744754 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc690950-b37e-461f-a175-72cb30436574 None admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:25.745411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc690950-b37e-461f-a175-72cb30436574 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:25.745715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc690950-b37e-461f-a175-72cb30436574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:25.747066 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc690950-b37e-461f-a175-72cb30436574 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:25.754819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 638/1264] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:21:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:25.761031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8b13b-f80b-40b0-add0-8dcfb6a0540e None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:25.827677 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:25.861531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8b13b-f80b-40b0-add0-8dcfb6a0540e None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:25.895879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2356342-0149-4142-82b2-38318b2e843b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:25.896508 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2356342-0149-4142-82b2-38318b2e843b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:25.896821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2356342-0149-4142-82b2-38318b2e843b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:25.897806 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2356342-0149-4142-82b2-38318b2e843b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:25.907038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2356342-0149-4142-82b2-38318b2e843b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:25.908483 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2356342-0149-4142-82b2-38318b2e843b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:25.923062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-b2356342-0149-4142-82b2-38318b2e843b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:25.923062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:25.923062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:25.923062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:25.923062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:25.923062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:25.923062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:25.923062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:25.923062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:25.923062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:25.923062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:25.923062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:25.923062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:21:25.923062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:21:25.923062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:21:25.923062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:21:25.928876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:25.928876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:25.928876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:25.928876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:25.928876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:25.928876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:25.928876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:25.928876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:25.928876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:25.928876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:25.928876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:25.928876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:25.928876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:25.928876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:25.928876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:25.928876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:25.928876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:21:25.930160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:21:25.930160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:25.930160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:21:25.930160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 627/1265] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:21:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:25.930584 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc690950-b37e-461f-a175-72cb30436574 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:26.011892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:26.030129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc690950-b37e-461f-a175-72cb30436574 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:26.062079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11109a5-7468-41f3-ba10-d0711fe8e094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:26.062675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11109a5-7468-41f3-ba10-d0711fe8e094 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:26.062950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11109a5-7468-41f3-ba10-d0711fe8e094 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:26.063219 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11109a5-7468-41f3-ba10-d0711fe8e094 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:26.063849 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11109a5-7468-41f3-ba10-d0711fe8e094 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:26.064151 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11109a5-7468-41f3-ba10-d0711fe8e094 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:26.067015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11109a5-7468-41f3-ba10-d0711fe8e094 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:26.079216 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 639/1266] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:26.084887 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2356342-0149-4142-82b2-38318b2e843b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:26.183648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2356342-0149-4142-82b2-38318b2e843b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:26.203004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:26.217123 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5614c43-ddc8-4366-b143-04d53262094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:26.217748 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5614c43-ddc8-4366-b143-04d53262094c None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:26.218031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5614c43-ddc8-4366-b143-04d53262094c None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:26.218305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5614c43-ddc8-4366-b143-04d53262094c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:26.226202 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5614c43-ddc8-4366-b143-04d53262094c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:26.227886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5614c43-ddc8-4366-b143-04d53262094c None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:26.240473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-b5614c43-ddc8-4366-b143-04d53262094c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:21:26.240473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:26.240473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:26.240473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:26.240473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:26.240473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:26.240473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:26.240473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:26.240473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:26.240473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:26.240473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:26.240473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:26.240473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:21:26.240473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:21:26.240473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:21:26.240473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:21:26.242570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:26.242570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:26.242570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:21:26.242570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:21:26.242570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:21:26.242570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:21:26.242570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:26.242570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:26.242570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:26.242570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:26.242570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:26.242570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:26.242570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:26.242570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:26.242570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:26.242570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:26.242570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:26.242570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:26.243723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:26.243723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:26.243723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:21:26.243723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:21:26.243723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:21:26.243723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:21:26.243723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:21:26.243723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:21:26.243723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:21:26.243723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:21:26.243723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 628/1267] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:21:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:26.248940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11109a5-7468-41f3-ba10-d0711fe8e094 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:26.348596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11109a5-7468-41f3-ba10-d0711fe8e094 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:26.383534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b6890-21a0-4c87-acce-2643148e73a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:26.384133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b6890-21a0-4c87-acce-2643148e73a5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:26.384419 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b6890-21a0-4c87-acce-2643148e73a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:26.384721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b6890-21a0-4c87-acce-2643148e73a5 None admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:26.385455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b6890-21a0-4c87-acce-2643148e73a5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:26.385789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b6890-21a0-4c87-acce-2643148e73a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:26.387218 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b6890-21a0-4c87-acce-2643148e73a5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:26.395977 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:26.405029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 640/1268] 10.222.0.96 () {56 vars in 1143 bytes} [Wed Aug 24 04:21:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:26.410786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5614c43-ddc8-4366-b143-04d53262094c None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:26.508819 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5614c43-ddc8-4366-b143-04d53262094c None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:26.541734 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e56632-71e0-4ca1-936e-7430432c0a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:26.542340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e56632-71e0-4ca1-936e-7430432c0a43 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:26.542620 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e56632-71e0-4ca1-936e-7430432c0a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:26.542894 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e56632-71e0-4ca1-936e-7430432c0a43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:26.552975 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e56632-71e0-4ca1-936e-7430432c0a43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:26.555097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e56632-71e0-4ca1-936e-7430432c0a43 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:26.568588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-f0e56632-71e0-4ca1-936e-7430432c0a43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:26.568588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:26.568588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:26.568588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:26.568588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:26.568588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:26.568588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:26.568588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:26.568588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:26.568588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:26.568588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:26.568588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:26.568588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:21:26.568588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:21:26.568588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:21:26.568588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:21:26.569715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:26.569715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:26.569715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:26.569715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:26.569715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:26.569715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:26.569715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:26.569715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:26.569715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:26.569715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:26.569715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:26.569715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:26.569715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:26.569715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:26.569715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:26.569715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:26.569715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:21:26.570844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:21:26.570844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:26.570844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:21:26.570844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 629/1269] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:21:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:26.577329 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b6890-21a0-4c87-acce-2643148e73a5 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:26.675002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b6890-21a0-4c87-acce-2643148e73a5 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:26.707989 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862510b2-d25e-4746-80c5-ea3c1bac7549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:26.708588 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862510b2-d25e-4746-80c5-ea3c1bac7549 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:26.708901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862510b2-d25e-4746-80c5-ea3c1bac7549 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:26.709180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862510b2-d25e-4746-80c5-ea3c1bac7549 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:26.710481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862510b2-d25e-4746-80c5-ea3c1bac7549 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:26.710799 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862510b2-d25e-4746-80c5-ea3c1bac7549 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:26.712244 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862510b2-d25e-4746-80c5-ea3c1bac7549 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:26.723234 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 641/1270] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:26.729394 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e56632-71e0-4ca1-936e-7430432c0a43 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:26.760468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:26.832461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e56632-71e0-4ca1-936e-7430432c0a43 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:26.867526 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63ffb7-91bf-476a-88de-0d495273f756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:26.868156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63ffb7-91bf-476a-88de-0d495273f756 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:26.868443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63ffb7-91bf-476a-88de-0d495273f756 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:26.868753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63ffb7-91bf-476a-88de-0d495273f756 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:26.875235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63ffb7-91bf-476a-88de-0d495273f756 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:26.876664 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63ffb7-91bf-476a-88de-0d495273f756 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:26.887949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-cd63ffb7-91bf-476a-88de-0d495273f756 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:21:26.887949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:26.887949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:26.887949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:26.887949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:26.887949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:26.887949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:26.887949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:26.887949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:26.887949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:26.887949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:26.887949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:26.887949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:21:26.887949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:21:26.887949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:21:26.889072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:21:26.889072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:26.889072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:26.889072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:26.889072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:26.889072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:26.889072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:26.889072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:26.889072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:26.889072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:26.889072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:26.889072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:26.889072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:26.889072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:26.889072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:26.889072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:26.889072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:26.889999 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:21:26.889999 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:21:26.889999 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:21:26.889999 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:21:26.889999 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:21:26.889999 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:21:26.889999 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:21:26.889999 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:21:26.889999 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 630/1271] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:21:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:26.894871 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862510b2-d25e-4746-80c5-ea3c1bac7549 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:26.952622 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:27.001931 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862510b2-d25e-4746-80c5-ea3c1bac7549 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:27.038290 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6d669-ee41-45c0-a4ac-51b45188ddf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:27.038891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6d669-ee41-45c0-a4ac-51b45188ddf1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:27.039171 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6d669-ee41-45c0-a4ac-51b45188ddf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:27.039439 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6d669-ee41-45c0-a4ac-51b45188ddf1 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:27.040119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6d669-ee41-45c0-a4ac-51b45188ddf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:27.040422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6d669-ee41-45c0-a4ac-51b45188ddf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:27.041868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6d669-ee41-45c0-a4ac-51b45188ddf1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:27.053707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 642/1272] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:21:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:21:27.059837 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63ffb7-91bf-476a-88de-0d495273f756 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:27.163623 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:27.172739 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63ffb7-91bf-476a-88de-0d495273f756 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:27.209193 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecc166-3b23-44e3-aeb3-c799b0e2c5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:27.210459 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecc166-3b23-44e3-aeb3-c799b0e2c5d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:27.210738 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecc166-3b23-44e3-aeb3-c799b0e2c5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:27.211014 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecc166-3b23-44e3-aeb3-c799b0e2c5d0 None admin] PATH_INFO: `/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/d1f7fe9af30947dbae1f2334b18f630d/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:27.212954 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecc166-3b23-44e3-aeb3-c799b0e2c5d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d76b6cd68a7f4613a8e921781495f256, user_id=d1f7fe9af30947dbae1f2334b18f630d, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:27.214403 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecc166-3b23-44e3-aeb3-c799b0e2c5d0 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:27.227614 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 631/1273] 10.222.0.96 () {58 vars in 1439 bytes} [Wed Aug 24 04:21:27 2022] PUT /identity/v3/projects/d76b6cd68a7f4613a8e921781495f256/users/d1f7fe9af30947dbae1f2334b18f630d/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:21:29.129028 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28989d-c89a-4311-8a9b-63ebe7445ca2 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:29.129566 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28989d-c89a-4311-8a9b-63ebe7445ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:29.129566 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28989d-c89a-4311-8a9b-63ebe7445ca2 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:29.130836 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 643/1274] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:21:29.136446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14171c-8ae1-4007-a325-eaf974806aa9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:29.136935 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14171c-8ae1-4007-a325-eaf974806aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:29.137062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14171c-8ae1-4007-a325-eaf974806aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:29.155438 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4e14171c-8ae1-4007-a325-eaf974806aa9 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:21:29.156639 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4e14171c-8ae1-4007-a325-eaf974806aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:21:29.222922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 632/1275] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:21:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:21:29.493904 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28989d-c89a-4311-8a9b-63ebe7445ca2 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:29.596170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28989d-c89a-4311-8a9b-63ebe7445ca2 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:29.613400 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:29.632278 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd0242-19e4-4ac5-80dc-460fcfb39647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:29.632929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd0242-19e4-4ac5-80dc-460fcfb39647 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:29.633213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd0242-19e4-4ac5-80dc-460fcfb39647 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:29.633487 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd0242-19e4-4ac5-80dc-460fcfb39647 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:29.643592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd0242-19e4-4ac5-80dc-460fcfb39647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:21:29.648457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-c9fd0242-19e4-4ac5-80dc-460fcfb39647 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:21:29.648457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:29.648457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:29.648457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:29.648457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:29.648457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:29.648457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:29.648457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:29.648457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:29.648457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:29.648457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:29.648457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:29.648457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:21:29.648457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:21:29.648457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:21:29.648457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:21:29.650281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:21:29.650281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:21:29.650281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:21:29.650281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:21:29.650281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:29.650281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:29.650281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:29.650281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:29.650281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:29.650281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:29.650281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:29.650281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:29.650281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:29.650281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:29.650281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:29.650281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:29.651894 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:29.651894 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:29.651894 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:29.651894 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:29.651894 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:21:29.651894 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:21:29.651894 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:21:29.651894 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:21:29.651894 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:21:29.651894 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:21:29.651894 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:21:29.651894 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:29.651894 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 644/1276] 10.222.0.96 () {56 vars in 1096 bytes} [Wed Aug 24 04:21:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:21:29.655646 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14171c-8ae1-4007-a325-eaf974806aa9 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:29.737085 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:29.757490 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14171c-8ae1-4007-a325-eaf974806aa9 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:29.790728 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d4014-e7f6-4906-ad96-ad2ae5372969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:29.791324 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d4014-e7f6-4906-ad96-ad2ae5372969 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:29.791602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d4014-e7f6-4906-ad96-ad2ae5372969 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:29.791871 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d4014-e7f6-4906-ad96-ad2ae5372969 None admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:29.792530 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d4014-e7f6-4906-ad96-ad2ae5372969 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:29.792874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d4014-e7f6-4906-ad96-ad2ae5372969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:29.794274 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d4014-e7f6-4906-ad96-ad2ae5372969 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:29.802685 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 633/1277] 10.222.0.96 () {56 vars in 1099 bytes} [Wed Aug 24 04:21:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:29.809027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd0242-19e4-4ac5-80dc-460fcfb39647 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:29.910149 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd0242-19e4-4ac5-80dc-460fcfb39647 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:29.943472 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564b7c2-48d6-4eb9-87dd-426fe8dc523c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:29.944118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564b7c2-48d6-4eb9-87dd-426fe8dc523c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:29.944398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564b7c2-48d6-4eb9-87dd-426fe8dc523c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:29.944831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7564b7c2-48d6-4eb9-87dd-426fe8dc523c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:29.954996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564b7c2-48d6-4eb9-87dd-426fe8dc523c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:29.956500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7564b7c2-48d6-4eb9-87dd-426fe8dc523c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:29.970856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-7564b7c2-48d6-4eb9-87dd-426fe8dc523c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:29.970856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:29.970856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:29.970856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:29.970856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:29.970856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:29.970856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:29.970856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:29.970856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:29.970856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:29.970856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:29.970856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:29.970856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:21:29.970856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:21:29.970856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:21:29.970856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:21:29.971951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:29.971951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:29.971951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:29.971951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:29.971951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:29.971951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:29.971951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:29.971951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:29.971951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:29.971951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:29.971951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:29.971951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:29.971951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:29.971951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:29.971951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:29.971951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:29.971951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:21:29.973065 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:21:29.973065 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:29.973065 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:29.973065 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 645/1278] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:29.978444 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d4014-e7f6-4906-ad96-ad2ae5372969 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:30.078969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d4014-e7f6-4906-ad96-ad2ae5372969 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:30.114447 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c4ba5-4d35-4207-84ce-7a01e3131380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:30.115050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c4ba5-4d35-4207-84ce-7a01e3131380 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:30.115329 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c4ba5-4d35-4207-84ce-7a01e3131380 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:30.115601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c4ba5-4d35-4207-84ce-7a01e3131380 None admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:30.117125 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c4ba5-4d35-4207-84ce-7a01e3131380 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:30.117441 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c4ba5-4d35-4207-84ce-7a01e3131380 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:30.118808 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c4ba5-4d35-4207-84ce-7a01e3131380 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:30.130589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 634/1279] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:30.136936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564b7c2-48d6-4eb9-87dd-426fe8dc523c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:30.167208 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:30.237061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7564b7c2-48d6-4eb9-87dd-426fe8dc523c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:30.274146 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a15fa6-88b1-430c-89ff-e4860574df0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:30.274769 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a15fa6-88b1-430c-89ff-e4860574df0c None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:30.275048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a15fa6-88b1-430c-89ff-e4860574df0c None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:30.275319 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a15fa6-88b1-430c-89ff-e4860574df0c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:30.282628 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a15fa6-88b1-430c-89ff-e4860574df0c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:30.284063 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a15fa6-88b1-430c-89ff-e4860574df0c None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:30.295831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-d7a15fa6-88b1-430c-89ff-e4860574df0c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:21:30.295831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:30.295831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:30.295831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:30.295831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:30.295831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:30.295831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:30.295831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:30.295831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:30.295831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:30.295831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:30.295831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:30.295831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:21:30.295831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:21:30.295831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:21:30.295831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:21:30.296852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:30.296852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:30.296852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:21:30.296852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:21:30.296852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:21:30.296852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:21:30.296852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:30.296852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:30.296852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:30.296852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:30.296852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:30.296852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:30.296852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:30.296852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:30.296852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:30.296852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:30.296852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:30.296852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:30.297950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:30.297950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:30.297950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:21:30.297950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:21:30.297950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:21:30.297950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:21:30.297950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:21:30.297950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:21:30.297950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:21:30.297950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:30.297950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 646/1280] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:21:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:30.305828 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c4ba5-4d35-4207-84ce-7a01e3131380 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:30.309772 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:30.406309 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c4ba5-4d35-4207-84ce-7a01e3131380 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:30.440448 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b20da1-5177-40ec-b2d7-04722da73bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:30.441087 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b20da1-5177-40ec-b2d7-04722da73bfc None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:30.441367 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b20da1-5177-40ec-b2d7-04722da73bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:30.441640 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b20da1-5177-40ec-b2d7-04722da73bfc None admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:30.442367 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b20da1-5177-40ec-b2d7-04722da73bfc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:30.442672 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b20da1-5177-40ec-b2d7-04722da73bfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:30.444146 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b20da1-5177-40ec-b2d7-04722da73bfc None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:30.463067 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 635/1281] 10.222.0.96 () {56 vars in 1143 bytes} [Wed Aug 24 04:21:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:30.469237 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a15fa6-88b1-430c-89ff-e4860574df0c None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:30.559635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:30.569871 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a15fa6-88b1-430c-89ff-e4860574df0c None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:30.604837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212b412-7f02-407d-96bf-9af00d5e11cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:30.605442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212b412-7f02-407d-96bf-9af00d5e11cf None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:30.605722 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212b412-7f02-407d-96bf-9af00d5e11cf None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:30.605996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212b412-7f02-407d-96bf-9af00d5e11cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:30.673583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212b412-7f02-407d-96bf-9af00d5e11cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:30.674943 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212b412-7f02-407d-96bf-9af00d5e11cf None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:30.763433 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:30.774926 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 647/1282] 10.222.0.96 () {58 vars in 1282 bytes} [Wed Aug 24 04:21:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:21:30.781028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b20da1-5177-40ec-b2d7-04722da73bfc None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:30.843505 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:30.884899 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b20da1-5177-40ec-b2d7-04722da73bfc None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:30.919095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b90608-94c8-4abe-8d92-4a88f7022098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:30.919739 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b90608-94c8-4abe-8d92-4a88f7022098 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:30.920024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b90608-94c8-4abe-8d92-4a88f7022098 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:30.920303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b90608-94c8-4abe-8d92-4a88f7022098 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:30.930697 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b90608-94c8-4abe-8d92-4a88f7022098 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:30.932081 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b90608-94c8-4abe-8d92-4a88f7022098 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:30.947108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-b2b90608-94c8-4abe-8d92-4a88f7022098 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:30.947108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:30.947108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:30.947108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:30.947108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:30.947108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:30.947108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:30.947108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:30.947108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:30.947108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:30.947108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:30.947108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:30.947108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:21:30.947108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:21:30.947108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:21:30.947108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:21:30.948259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:30.948259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:30.948259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:30.948259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:30.948259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:30.948259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:30.948259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:30.948259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:30.948259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:30.948259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:30.948259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:30.948259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:30.948259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:30.948259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:30.948259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:30.948259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:30.948259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:21:30.949625 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:21:30.949625 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:21:30.949625 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:21:30.949625 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 636/1283] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:30.954717 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212b412-7f02-407d-96bf-9af00d5e11cf None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:31.052792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212b412-7f02-407d-96bf-9af00d5e11cf None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:31.092429 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9205a4-5aab-4664-bf85-274e87c7ef86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:31.093117 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9205a4-5aab-4664-bf85-274e87c7ef86 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:31.093472 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9205a4-5aab-4664-bf85-274e87c7ef86 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:31.093802 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9205a4-5aab-4664-bf85-274e87c7ef86 None admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:31.094525 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9205a4-5aab-4664-bf85-274e87c7ef86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:31.094881 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9205a4-5aab-4664-bf85-274e87c7ef86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:31.096293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9205a4-5aab-4664-bf85-274e87c7ef86 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:31.107749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 648/1284] 10.222.0.96 () {56 vars in 1109 bytes} [Wed Aug 24 04:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:31.113738 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b90608-94c8-4abe-8d92-4a88f7022098 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:31.216853 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b90608-94c8-4abe-8d92-4a88f7022098 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:31.230523 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:31.252514 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec26c3-c133-478b-9f7a-0cdec9de5c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:31.253170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec26c3-c133-478b-9f7a-0cdec9de5c2b None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:31.253449 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec26c3-c133-478b-9f7a-0cdec9de5c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:31.253722 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec26c3-c133-478b-9f7a-0cdec9de5c2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:31.261151 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec26c3-c133-478b-9f7a-0cdec9de5c2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:31.262616 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec26c3-c133-478b-9f7a-0cdec9de5c2b None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:31.274001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application [None req-5dec26c3-c133-478b-9f7a-0cdec9de5c2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:21:31.274001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:31.274001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:31.274001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:31.274001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:31.274001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:31.274001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:31.274001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:31.274001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:31.274001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:31.274001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:31.274001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:31.274001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:21:31.274001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:21:31.274001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:21:31.275069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:21:31.275069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:31.275069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:31.275069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:31.275069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:31.275069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:31.275069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:31.275069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:31.275069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:31.275069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:31.275069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:31.275069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:31.275069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:31.275069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:31.275069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:31.275069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:31.275069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:31.276294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:21:31.276294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:21:31.276294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:21:31.276294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:21:31.276294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:21:31.276294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:21:31.276294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:21:31.276294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: ERROR keystone.server.flask.application Aug 24 04:21:31.276294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 637/1285] 10.222.0.96 () {56 vars in 1111 bytes} [Wed Aug 24 04:21:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:31.281550 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9205a4-5aab-4664-bf85-274e87c7ef86 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:31.332579 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:31.382831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9205a4-5aab-4664-bf85-274e87c7ef86 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:31.416477 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1258f9d-54f8-4937-bdba-9387a90b61e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:31.417103 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1258f9d-54f8-4937-bdba-9387a90b61e5 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:31.417386 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1258f9d-54f8-4937-bdba-9387a90b61e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:31.417661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1258f9d-54f8-4937-bdba-9387a90b61e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:31.418342 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1258f9d-54f8-4937-bdba-9387a90b61e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:31.418642 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1258f9d-54f8-4937-bdba-9387a90b61e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:31.420052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1258f9d-54f8-4937-bdba-9387a90b61e5 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:31.432983 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 649/1286] 10.222.0.96 () {56 vars in 1148 bytes} [Wed Aug 24 04:21:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:31.439202 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec26c3-c133-478b-9f7a-0cdec9de5c2b None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:31.542644 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec26c3-c133-478b-9f7a-0cdec9de5c2b None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:31.577021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98706e-9ca1-488e-8086-600a5a7554e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:31.577623 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98706e-9ca1-488e-8086-600a5a7554e5 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:31.577904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98706e-9ca1-488e-8086-600a5a7554e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:31.578179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98706e-9ca1-488e-8086-600a5a7554e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:31.578912 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98706e-9ca1-488e-8086-600a5a7554e5 None admin] RBAC: Adding query filter params (role.id=059d2bf5bb8e42939f5f826bfdad6a21, scope.project.id=d76b6cd68a7f4613a8e921781495f256, user.id=d1f7fe9af30947dbae1f2334b18f630d) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:31.579221 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98706e-9ca1-488e-8086-600a5a7554e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:31.580668 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98706e-9ca1-488e-8086-600a5a7554e5 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:31.586659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 638/1287] 10.222.0.96 () {56 vars in 1374 bytes} [Wed Aug 24 04:21:31 2022] GET /identity/v3/role_assignments?user.id=d1f7fe9af30947dbae1f2334b18f630d&scope.project.id=d76b6cd68a7f4613a8e921781495f256&role.id=059d2bf5bb8e42939f5f826bfdad6a21 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:33.580541 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e11fe6-c709-44a0-b18e-9d9af7e84edf None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:33.581168 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e11fe6-c709-44a0-b18e-9d9af7e84edf None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:33.581168 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e11fe6-c709-44a0-b18e-9d9af7e84edf None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:33.582460 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 650/1288] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:21:33.588582 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95029b-543c-4eb9-8bb0-457273d4d30e None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:33.589055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95029b-543c-4eb9-8bb0-457273d4d30e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:33.589291 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95029b-543c-4eb9-8bb0-457273d4d30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:33.608158 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ee95029b-543c-4eb9-8bb0-457273d4d30e None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:21:33.609374 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ee95029b-543c-4eb9-8bb0-457273d4d30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:21:33.639165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:33.679205 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 639/1289] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:21:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:21:33.942755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e11fe6-c709-44a0-b18e-9d9af7e84edf None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:34.048065 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e11fe6-c709-44a0-b18e-9d9af7e84edf None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:34.059818 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:34.085983 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd920eb1-85c2-4a35-afc7-1bbda8490620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:34.086538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd920eb1-85c2-4a35-afc7-1bbda8490620 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:34.086816 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd920eb1-85c2-4a35-afc7-1bbda8490620 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:34.087090 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd920eb1-85c2-4a35-afc7-1bbda8490620 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:34.087672 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd920eb1-85c2-4a35-afc7-1bbda8490620 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:34.089059 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd920eb1-85c2-4a35-afc7-1bbda8490620 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:34.098054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-bd920eb1-85c2-4a35-afc7-1bbda8490620 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:21:34.098054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:34.098054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:21:34.098054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:21:34.098054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:21:34.098054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:21:34.098054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:21:34.098054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:21:34.098054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:21:34.098054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:34.098054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:21:34.098054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:34.098054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:34.098054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:34.098054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:34.098054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:34.098054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:34.099941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:34.099941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:34.099941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:34.099941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:34.099941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:34.099941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:34.099941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:21:34.099941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:21:34.099941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:21:34.099941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:21:34.099941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:34.099941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:34.099941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:34.099941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:34.099941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:34.099941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:34.102133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:34.102133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:34.102133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:34.102133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:34.102133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:34.102133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:34.102133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:34.102133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:34.102133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:34.102133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:34.102133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:21:34.102133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:21:34.102133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:21:34.102133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:34.102133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 651/1290] 10.222.0.96 () {56 vars in 1117 bytes} [Wed Aug 24 04:21:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:34.105714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95029b-543c-4eb9-8bb0-457273d4d30e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:34.207291 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95029b-543c-4eb9-8bb0-457273d4d30e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:34.245470 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed6709-bfa8-49bd-876f-2e283af21c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:34.246061 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed6709-bfa8-49bd-876f-2e283af21c59 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:34.246336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed6709-bfa8-49bd-876f-2e283af21c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:34.246623 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed6709-bfa8-49bd-876f-2e283af21c59 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:34.247295 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed6709-bfa8-49bd-876f-2e283af21c59 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:34.247538 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed6709-bfa8-49bd-876f-2e283af21c59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:34.248942 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed6709-bfa8-49bd-876f-2e283af21c59 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:34.254017 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 640/1291] 10.222.0.96 () {56 vars in 1116 bytes} [Wed Aug 24 04:21:34 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:34.261045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd920eb1-85c2-4a35-afc7-1bbda8490620 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:34.368669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd920eb1-85c2-4a35-afc7-1bbda8490620 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:34.402393 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed6c48-2801-4daf-be7d-67ed18792e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:34.403001 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed6c48-2801-4daf-be7d-67ed18792e41 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:34.403284 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed6c48-2801-4daf-be7d-67ed18792e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:34.403556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed6c48-2801-4daf-be7d-67ed18792e41 None admin] PATH_INFO: `/v3/services` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:34.404188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed6c48-2801-4daf-be7d-67ed18792e41 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:34.404495 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed6c48-2801-4daf-be7d-67ed18792e41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:34.405900 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed6c48-2801-4daf-be7d-67ed18792e41 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:34.410371 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 652/1292] 10.222.0.96 () {56 vars in 1116 bytes} [Wed Aug 24 04:21:34 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:36.304913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ba4f6-fb71-46c6-9fca-e9ae00185848 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:36.305466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ba4f6-fb71-46c6-9fca-e9ae00185848 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:36.305466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ba4f6-fb71-46c6-9fca-e9ae00185848 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:36.306757 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 641/1293] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:21:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:21:36.311913 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eda77d-d6a2-41d3-b2db-8af9f673df96 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:36.312330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eda77d-d6a2-41d3-b2db-8af9f673df96 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:36.312529 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eda77d-d6a2-41d3-b2db-8af9f673df96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:36.331298 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-39eda77d-d6a2-41d3-b2db-8af9f673df96 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:21:36.333384 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-39eda77d-d6a2-41d3-b2db-8af9f673df96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:21:36.365945 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:36.404768 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 653/1294] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:21:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:21:36.672230 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ba4f6-fb71-46c6-9fca-e9ae00185848 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:36.704113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:36.785728 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ba4f6-fb71-46c6-9fca-e9ae00185848 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:36.819814 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72f39a-a48b-4e7a-8d73-f02199073b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:36.820407 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72f39a-a48b-4e7a-8d73-f02199073b03 None admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:36.820716 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72f39a-a48b-4e7a-8d73-f02199073b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:36.820999 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72f39a-a48b-4e7a-8d73-f02199073b03 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:36.821662 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72f39a-a48b-4e7a-8d73-f02199073b03 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:36.823031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72f39a-a48b-4e7a-8d73-f02199073b03 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:36.839134 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 642/1295] 10.222.0.96 () {60 vars in 1141 bytes} [Wed Aug 24 04:21:36 2022] POST /identity/v3/services => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:21:38.781441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0240e6-d647-4584-a8a7-f598b277c4a3 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:38.782006 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0240e6-d647-4584-a8a7-f598b277c4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:38.782006 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0240e6-d647-4584-a8a7-f598b277c4a3 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:38.783339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 654/1296] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:21:38.789508 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083a855-8a49-4e55-aa72-455f80e340a8 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:38.789971 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083a855-8a49-4e55-aa72-455f80e340a8 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:38.790121 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083a855-8a49-4e55-aa72-455f80e340a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:38.809046 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-7083a855-8a49-4e55-aa72-455f80e340a8 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:21:38.810283 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7083a855-8a49-4e55-aa72-455f80e340a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:21:38.885407 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 643/1297] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:21:38 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:21:39.156207 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0240e6-d647-4584-a8a7-f598b277c4a3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:39.260981 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0240e6-d647-4584-a8a7-f598b277c4a3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:39.308175 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29978db4-26c1-4dfb-8a0b-e1168b0f18bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:39.308822 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29978db4-26c1-4dfb-8a0b-e1168b0f18bc None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:39.309105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29978db4-26c1-4dfb-8a0b-e1168b0f18bc None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:39.309382 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29978db4-26c1-4dfb-8a0b-e1168b0f18bc None admin] PATH_INFO: `/v3/services/placement` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:39.309961 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29978db4-26c1-4dfb-8a0b-e1168b0f18bc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:39.311330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29978db4-26c1-4dfb-8a0b-e1168b0f18bc None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:39.321357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-29978db4-26c1-4dfb-8a0b-e1168b0f18bc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:21:39.321357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:39.321357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:21:39.321357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:21:39.321357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:21:39.321357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:21:39.321357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:21:39.321357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:21:39.321357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:21:39.321357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:39.321357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:21:39.321357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:39.321357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:39.321357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:39.321357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:39.321357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:39.321357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:39.322552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:39.322552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:39.322552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:39.322552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:39.322552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:39.322552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:39.322552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:21:39.322552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:21:39.322552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:21:39.322552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:21:39.322552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:39.322552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:39.322552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:39.322552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:39.322552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:39.322552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:39.323435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:39.323435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:39.323435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:39.323435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:39.323435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:39.323435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:39.323435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:39.323435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:39.323435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:39.323435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:39.323435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:21:39.323435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:21:39.323435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:21:39.323435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:39.323435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 655/1298] 10.222.0.96 () {56 vars in 1117 bytes} [Wed Aug 24 04:21:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:39.328829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083a855-8a49-4e55-aa72-455f80e340a8 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:39.351559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:39.438775 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083a855-8a49-4e55-aa72-455f80e340a8 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:39.473489 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e60d15-1c04-459f-9521-554e84491398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:39.474101 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e60d15-1c04-459f-9521-554e84491398 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:39.474383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e60d15-1c04-459f-9521-554e84491398 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:39.474658 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e60d15-1c04-459f-9521-554e84491398 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:39.475383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e60d15-1c04-459f-9521-554e84491398 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:39.475695 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e60d15-1c04-459f-9521-554e84491398 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:39.477093 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e60d15-1c04-459f-9521-554e84491398 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:39.482120 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 644/1299] 10.222.0.96 () {56 vars in 1116 bytes} [Wed Aug 24 04:21:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:39.488229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29978db4-26c1-4dfb-8a0b-e1168b0f18bc None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:39.520053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:39.626349 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29978db4-26c1-4dfb-8a0b-e1168b0f18bc None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:39.677190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc1594-728b-4cd6-99db-f20597e602a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:39.677794 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc1594-728b-4cd6-99db-f20597e602a6 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:39.678075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc1594-728b-4cd6-99db-f20597e602a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:39.678881 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc1594-728b-4cd6-99db-f20597e602a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:39.679739 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc1594-728b-4cd6-99db-f20597e602a6 None admin] RBAC: Adding query filter params (interface=public, service_id=38b1d01ef12f4866b06e8d5c7437ce2d, region_id=RegionOne) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:39.680055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc1594-728b-4cd6-99db-f20597e602a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:39.681469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc1594-728b-4cd6-99db-f20597e602a6 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:39.686472 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 656/1300] 10.222.0.96 () {56 vars in 1251 bytes} [Wed Aug 24 04:21:39 2022] GET /identity/v3/endpoints?service_id=38b1d01ef12f4866b06e8d5c7437ce2d&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:39.692484 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e60d15-1c04-459f-9521-554e84491398 None admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:39.776579 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:39.795284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e60d15-1c04-459f-9521-554e84491398 None admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:39.835026 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce131f-f798-4c05-8bd9-49218c82dfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:39.835722 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce131f-f798-4c05-8bd9-49218c82dfc0 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:39.836006 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce131f-f798-4c05-8bd9-49218c82dfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:39.836284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce131f-f798-4c05-8bd9-49218c82dfc0 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:39.836926 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce131f-f798-4c05-8bd9-49218c82dfc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:39.838298 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce131f-f798-4c05-8bd9-49218c82dfc0 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:39.845102 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 645/1301] 10.222.0.96 () {56 vars in 1087 bytes} [Wed Aug 24 04:21:39 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:21:41.783310 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed858c-a6d7-4505-9b14-6e2ac13f2ccc None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:41.783879 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed858c-a6d7-4505-9b14-6e2ac13f2ccc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:41.783879 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed858c-a6d7-4505-9b14-6e2ac13f2ccc None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:41.785255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 657/1302] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:21:41.791605 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06109e-68e0-493c-a306-8477dae9e51f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:41.792051 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06109e-68e0-493c-a306-8477dae9e51f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:41.792146 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06109e-68e0-493c-a306-8477dae9e51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:41.810311 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-8b06109e-68e0-493c-a306-8477dae9e51f None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:21:41.811499 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8b06109e-68e0-493c-a306-8477dae9e51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:21:41.881358 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 646/1303] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:21:41 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:21:42.155844 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed858c-a6d7-4505-9b14-6e2ac13f2ccc None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:42.252453 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:42.260535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed858c-a6d7-4505-9b14-6e2ac13f2ccc None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:42.294496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99a176-1685-47bd-bbcd-599876845ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:42.295116 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99a176-1685-47bd-bbcd-599876845ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:42.295395 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99a176-1685-47bd-bbcd-599876845ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:42.295666 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99a176-1685-47bd-bbcd-599876845ad1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:42.296245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99a176-1685-47bd-bbcd-599876845ad1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:42.297625 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99a176-1685-47bd-bbcd-599876845ad1 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:42.307038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application [None req-db99a176-1685-47bd-bbcd-599876845ad1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:21:42.307038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:42.307038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:21:42.307038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:21:42.307038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:21:42.307038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:21:42.307038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:21:42.307038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:21:42.307038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:21:42.307038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:42.307038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:21:42.307038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:42.307038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:21:42.307038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:21:42.307038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:21:42.307038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:21:42.307038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:21:42.308919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:21:42.308919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:21:42.308919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:21:42.308919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:21:42.308919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:21:42.308919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:21:42.308919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:21:42.308919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:21:42.308919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:21:42.308919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:21:42.308919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:21:42.308919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:21:42.308919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:21:42.308919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:21:42.308919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:21:42.308919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:21:42.310965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:21:42.310965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application with Lock( Aug 24 04:21:42.310965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:21:42.310965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:21:42.310965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:21:42.310965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:21:42.310965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:21:42.310965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:21:42.310965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:21:42.310965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:21:42.310965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:21:42.310965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:21:42.310965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:21:42.310965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: ERROR keystone.server.flask.application Aug 24 04:21:42.310965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 658/1304] 10.222.0.96 () {56 vars in 1117 bytes} [Wed Aug 24 04:21:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:21:42.316234 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06109e-68e0-493c-a306-8477dae9e51f None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:42.393427 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:42.418810 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06109e-68e0-493c-a306-8477dae9e51f None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:42.454157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261fc3e-26b2-434e-b0c1-81b458ae6371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:42.454770 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261fc3e-26b2-434e-b0c1-81b458ae6371 None admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:42.455058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261fc3e-26b2-434e-b0c1-81b458ae6371 None admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:42.455335 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261fc3e-26b2-434e-b0c1-81b458ae6371 None admin] PATH_INFO: `/v3/services` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:42.455972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261fc3e-26b2-434e-b0c1-81b458ae6371 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:21:42.456282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261fc3e-26b2-434e-b0c1-81b458ae6371 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:42.457733 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261fc3e-26b2-434e-b0c1-81b458ae6371 None admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:42.463137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 647/1305] 10.222.0.96 () {56 vars in 1116 bytes} [Wed Aug 24 04:21:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:21:42.469081 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99a176-1685-47bd-bbcd-599876845ad1 None admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:42.571986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99a176-1685-47bd-bbcd-599876845ad1 None admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:42.605828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15107d9e-8beb-426a-bbf2-2f4ec636dcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:42.606431 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15107d9e-8beb-426a-bbf2-2f4ec636dcb9 None admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:42.606717 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15107d9e-8beb-426a-bbf2-2f4ec636dcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:42.606996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15107d9e-8beb-426a-bbf2-2f4ec636dcb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:42.607669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15107d9e-8beb-426a-bbf2-2f4ec636dcb9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:42.609073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15107d9e-8beb-426a-bbf2-2f4ec636dcb9 None admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:42.628217 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 659/1306] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:21:42 2022] POST /identity/v3/endpoints => generated 331 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:21:52.460758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=30 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:52.624734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:22:48.330571 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826c31-9a82-4a07-bd53-5b56cbb74c9b None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:48.331009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826c31-9a82-4a07-bd53-5b56cbb74c9b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:48.331128 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826c31-9a82-4a07-bd53-5b56cbb74c9b None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:48.333041 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 648/1307] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:22:48.339108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43f1b0-f88d-4a0f-92ea-a162108dbfb4 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:48.339509 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43f1b0-f88d-4a0f-92ea-a162108dbfb4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:48.339599 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43f1b0-f88d-4a0f-92ea-a162108dbfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:48.516752 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6b43f1b0-f88d-4a0f-92ea-a162108dbfb4 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:22:48.518725 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6b43f1b0-f88d-4a0f-92ea-a162108dbfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:22:48.663783 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 660/1308] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:22:48.974939 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce23e48-1c27-4aa2-a794-0c168df5ee0a None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:48.975396 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce23e48-1c27-4aa2-a794-0c168df5ee0a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:48.975680 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce23e48-1c27-4aa2-a794-0c168df5ee0a None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:48.977325 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 649/1309] 10.222.0.96 () {54 vars in 965 bytes} [Wed Aug 24 04:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:22:48.983331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6886f34-7d64-420f-aff0-349c038f5c3e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:48.983695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6886f34-7d64-420f-aff0-349c038f5c3e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:48.984079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6886f34-7d64-420f-aff0-349c038f5c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:49.068770 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c6886f34-7d64-420f-aff0-349c038f5c3e None None] MFA Rules not processed for user `50358dbf699a41188dae93496161709d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:22:49.070017 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c6886f34-7d64-420f-aff0-349c038f5c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:22:49.091876 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:22:49.152154 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 661/1310] 10.222.0.96 () {58 vars in 1062 bytes} [Wed Aug 24 04:22:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:22:49.161005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce23e48-1c27-4aa2-a794-0c168df5ee0a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:22:49.162930 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-fce23e48-1c27-4aa2-a794-0c168df5ee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:22:49.275320 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce23e48-1c27-4aa2-a794-0c168df5ee0a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:22:49.358360 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1ad16-1c07-4d18-9c6a-b5b2b7cbbc90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:22:49.359014 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1ad16-1c07-4d18-9c6a-b5b2b7cbbc90 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:49.359243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1ad16-1c07-4d18-9c6a-b5b2b7cbbc90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:49.359523 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1ad16-1c07-4d18-9c6a-b5b2b7cbbc90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:49.361397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b5f1ad16-1c07-4d18-9c6a-b5b2b7cbbc90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:22:49.421633 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:22:49.488112 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1ad16-1c07-4d18-9c6a-b5b2b7cbbc90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:22:49.489648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1ad16-1c07-4d18-9c6a-b5b2b7cbbc90 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:22:49.510282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 650/1311] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:22:51.758724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff17b19-4a67-4c84-8312-48e8d1d3918f None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:51.759260 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff17b19-4a67-4c84-8312-48e8d1d3918f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:51.759260 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff17b19-4a67-4c84-8312-48e8d1d3918f None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:51.760619 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 662/1312] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:22:51.766200 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5cf3d-2d54-4a00-b389-930dea18c85f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:51.766721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5cf3d-2d54-4a00-b389-930dea18c85f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:51.766837 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5cf3d-2d54-4a00-b389-930dea18c85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:51.847019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ccf5cf3d-2d54-4a00-b389-930dea18c85f None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:22:51.848236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ccf5cf3d-2d54-4a00-b389-930dea18c85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:22:51.947654 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 651/1313] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:22:52.259555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06bffb-ffe6-40f7-8608-43835dae9761 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:52.259878 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06bffb-ffe6-40f7-8608-43835dae9761 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:52.260161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06bffb-ffe6-40f7-8608-43835dae9761 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:52.261620 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 663/1314] 10.222.0.96 () {54 vars in 965 bytes} [Wed Aug 24 04:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:22:52.267669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7274dc8-533b-4962-8ff5-f2ffa9a71ff2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:52.267952 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7274dc8-533b-4962-8ff5-f2ffa9a71ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:52.268225 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7274dc8-533b-4962-8ff5-f2ffa9a71ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:52.280942 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:22:52.347915 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-c7274dc8-533b-4962-8ff5-f2ffa9a71ff2 None None] MFA Rules not processed for user `50358dbf699a41188dae93496161709d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:22:52.349234 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c7274dc8-533b-4962-8ff5-f2ffa9a71ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:22:52.426750 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 652/1315] 10.222.0.96 () {58 vars in 1062 bytes} [Wed Aug 24 04:22:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:22:52.435720 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06bffb-ffe6-40f7-8608-43835dae9761 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:22:52.437295 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-dc06bffb-ffe6-40f7-8608-43835dae9761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:22:52.550451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06bffb-ffe6-40f7-8608-43835dae9761 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:22:52.622873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:22:52.625322 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801ddd6-03a6-4fc8-93c2-c9477efd9864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:22:52.625943 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801ddd6-03a6-4fc8-93c2-c9477efd9864 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:52.626467 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801ddd6-03a6-4fc8-93c2-c9477efd9864 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:52.626959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801ddd6-03a6-4fc8-93c2-c9477efd9864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:52.628816 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3801ddd6-03a6-4fc8-93c2-c9477efd9864 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:22:52.738757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801ddd6-03a6-4fc8-93c2-c9477efd9864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:22:52.740742 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801ddd6-03a6-4fc8-93c2-c9477efd9864 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:22:52.759456 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 664/1316] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:22:55.204938 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b7778-9d70-42b9-b215-2c8461408393 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:55.205529 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b7778-9d70-42b9-b215-2c8461408393 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:55.205529 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b7778-9d70-42b9-b215-2c8461408393 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:55.206765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 653/1317] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:22:55.212204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ed729-82cd-4a3b-9308-65ad92b5380c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:55.212656 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ed729-82cd-4a3b-9308-65ad92b5380c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:55.212793 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ed729-82cd-4a3b-9308-65ad92b5380c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:55.288953 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-375ed729-82cd-4a3b-9308-65ad92b5380c None None] MFA Rules not processed for user `58534463aeb44a27b394cd1dc1a1454a`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:22:55.290171 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-375ed729-82cd-4a3b-9308-65ad92b5380c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:22:55.343057 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:22:55.388547 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 665/1318] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:22:55 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:22:55.671103 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b7778-9d70-42b9-b215-2c8461408393 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:22:55.672661 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c09b7778-9d70-42b9-b215-2c8461408393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:22:55.778362 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b7778-9d70-42b9-b215-2c8461408393 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:22:55.781188 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:22:55.855407 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1e34b-83e3-4ac8-a38b-82c16937e754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:22:55.856107 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1e34b-83e3-4ac8-a38b-82c16937e754 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:55.856457 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1e34b-83e3-4ac8-a38b-82c16937e754 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:55.856833 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1e34b-83e3-4ac8-a38b-82c16937e754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:55.858575 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1be1e34b-83e3-4ac8-a38b-82c16937e754 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:22:55.968062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1e34b-83e3-4ac8-a38b-82c16937e754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:22:55.969461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1e34b-83e3-4ac8-a38b-82c16937e754 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:22:55.988356 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 654/1319] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:22:55 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:22:58.483111 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b7b3e-69ae-4584-a848-9ddb89fc3cf0 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:58.483638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b7b3e-69ae-4584-a848-9ddb89fc3cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:58.483747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b7b3e-69ae-4584-a848-9ddb89fc3cf0 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:58.485061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 666/1320] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:22:58.491155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d41b5-1406-4d1b-9237-123c5039bb8d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:58.491604 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d41b5-1406-4d1b-9237-123c5039bb8d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:58.491710 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d41b5-1406-4d1b-9237-123c5039bb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:58.531574 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:22:58.558699 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9d8d41b5-1406-4d1b-9237-123c5039bb8d None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:22:58.560507 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9d8d41b5-1406-4d1b-9237-123c5039bb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:22:58.658453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 655/1321] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:22:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:22:58.944941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b7b3e-69ae-4584-a848-9ddb89fc3cf0 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:22:58.946508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5d5b7b3e-69ae-4584-a848-9ddb89fc3cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:22:59.055043 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b7b3e-69ae-4584-a848-9ddb89fc3cf0 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:22:59.127647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f7283-c8ce-4c10-a744-e7ce1cc3e0d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:22:59.128179 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f7283-c8ce-4c10-a744-e7ce1cc3e0d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:59.128462 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f7283-c8ce-4c10-a744-e7ce1cc3e0d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:59.128764 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f7283-c8ce-4c10-a744-e7ce1cc3e0d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:59.131017 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-314f7283-c8ce-4c10-a744-e7ce1cc3e0d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:22:59.138354 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:22:59.241781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f7283-c8ce-4c10-a744-e7ce1cc3e0d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:22:59.243467 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f7283-c8ce-4c10-a744-e7ce1cc3e0d9 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:22:59.262964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 667/1322] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:22:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:23:01.864044 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dda0ff-b80b-4d48-8027-3914712f791b None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:01.864552 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dda0ff-b80b-4d48-8027-3914712f791b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:01.865267 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dda0ff-b80b-4d48-8027-3914712f791b None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:01.866615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 656/1323] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:23:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:23:01.872207 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dd336-a0a1-4980-bd33-762eccaf1491 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:01.872636 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dd336-a0a1-4980-bd33-762eccaf1491 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:01.872820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dd336-a0a1-4980-bd33-762eccaf1491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:01.937966 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ba9dd336-a0a1-4980-bd33-762eccaf1491 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:23:01.939096 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ba9dd336-a0a1-4980-bd33-762eccaf1491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:01.998052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:02.040364 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 668/1324] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:23:02.343489 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dda0ff-b80b-4d48-8027-3914712f791b None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:23:02.345087 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b7dda0ff-b80b-4d48-8027-3914712f791b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:02.452010 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dda0ff-b80b-4d48-8027-3914712f791b None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:23:02.464076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:02.527780 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17c1c5-a55f-46e1-af87-05930015c8fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:23:02.528256 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17c1c5-a55f-46e1-af87-05930015c8fb service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:02.528535 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17c1c5-a55f-46e1-af87-05930015c8fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:02.528838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17c1c5-a55f-46e1-af87-05930015c8fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:02.530421 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0a17c1c5-a55f-46e1-af87-05930015c8fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:02.640832 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17c1c5-a55f-46e1-af87-05930015c8fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:23:02.642274 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17c1c5-a55f-46e1-af87-05930015c8fb service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:23:02.660654 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 657/1325] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:23:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:23:04.650199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3754f-d544-48f3-b0de-b932c7889e98 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:04.650732 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3754f-d544-48f3-b0de-b932c7889e98 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:04.650732 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3754f-d544-48f3-b0de-b932c7889e98 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:04.652021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 669/1326] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:23:04.657402 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb4751-d3cb-4613-b7b5-97cb172bfec7 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:04.657827 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb4751-d3cb-4613-b7b5-97cb172bfec7 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:04.657955 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb4751-d3cb-4613-b7b5-97cb172bfec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:04.708903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:04.728981 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-feeb4751-d3cb-4613-b7b5-97cb172bfec7 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:23:04.730194 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-feeb4751-d3cb-4613-b7b5-97cb172bfec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:04.833221 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 658/1327] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:23:05.113598 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3754f-d544-48f3-b0de-b932c7889e98 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:23:05.115615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-46a3754f-d544-48f3-b0de-b932c7889e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:05.222803 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3754f-d544-48f3-b0de-b932c7889e98 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:23:05.308754 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8c525-db76-4708-b78b-f7af17842944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:23:05.309586 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8c525-db76-4708-b78b-f7af17842944 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:05.309940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8c525-db76-4708-b78b-f7af17842944 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:05.310275 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8c525-db76-4708-b78b-f7af17842944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:05.311930 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-41e8c525-db76-4708-b78b-f7af17842944 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:05.332254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:05.438508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8c525-db76-4708-b78b-f7af17842944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:23:05.439966 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8c525-db76-4708-b78b-f7af17842944 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:23:05.458998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 670/1328] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:23:07.423282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a638a-6ea7-4cb3-8e86-6fe4f14533d3 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:07.423732 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a638a-6ea7-4cb3-8e86-6fe4f14533d3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:07.423825 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a638a-6ea7-4cb3-8e86-6fe4f14533d3 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:07.425679 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 659/1329] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:23:07.431371 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920b904-53a3-4300-bb91-bcf2937cddf9 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:07.432085 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920b904-53a3-4300-bb91-bcf2937cddf9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:07.432085 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920b904-53a3-4300-bb91-bcf2937cddf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:07.504680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c920b904-53a3-4300-bb91-bcf2937cddf9 None None] MFA Rules not processed for user `58534463aeb44a27b394cd1dc1a1454a`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:23:07.506640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c920b904-53a3-4300-bb91-bcf2937cddf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:07.572276 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:07.606166 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 671/1330] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:23:07 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:23:07.900807 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a638a-6ea7-4cb3-8e86-6fe4f14533d3 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:23:07.902354 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-206a638a-6ea7-4cb3-8e86-6fe4f14533d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:08.021427 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a638a-6ea7-4cb3-8e86-6fe4f14533d3 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:23:08.044004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:08.107628 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539ac72-bda1-4b6b-8fb8-6e15f48e1ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:23:08.108237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539ac72-bda1-4b6b-8fb8-6e15f48e1ddd service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:08.108520 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539ac72-bda1-4b6b-8fb8-6e15f48e1ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:08.108822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539ac72-bda1-4b6b-8fb8-6e15f48e1ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:08.110427 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b539ac72-bda1-4b6b-8fb8-6e15f48e1ddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:08.225276 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539ac72-bda1-4b6b-8fb8-6e15f48e1ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:23:08.226613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539ac72-bda1-4b6b-8fb8-6e15f48e1ddd service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:23:08.245901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 660/1331] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:23:07 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:23:10.583515 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd487db1-f5ac-4726-ba9a-d4a4ef1680da None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:10.584137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd487db1-f5ac-4726-ba9a-d4a4ef1680da None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:10.584137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd487db1-f5ac-4726-ba9a-d4a4ef1680da None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:10.585440 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 672/1332] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:23:10.592323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee2a20-5490-4dde-bfd7-3a29666c1960 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:10.592865 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee2a20-5490-4dde-bfd7-3a29666c1960 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:10.593083 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee2a20-5490-4dde-bfd7-3a29666c1960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:10.657455 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:10.660207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-8bee2a20-5490-4dde-bfd7-3a29666c1960 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:23:10.662581 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8bee2a20-5490-4dde-bfd7-3a29666c1960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:10.763620 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 661/1333] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:23:11.049579 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd487db1-f5ac-4726-ba9a-d4a4ef1680da None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:23:11.051146 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fd487db1-f5ac-4726-ba9a-d4a4ef1680da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:11.155868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd487db1-f5ac-4726-ba9a-d4a4ef1680da None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:23:11.230596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b872ad-91ec-40e6-b66d-23f10b6e36c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:23:11.231208 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b872ad-91ec-40e6-b66d-23f10b6e36c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:11.231490 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b872ad-91ec-40e6-b66d-23f10b6e36c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:11.231764 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b872ad-91ec-40e6-b66d-23f10b6e36c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:11.233392 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-63b872ad-91ec-40e6-b66d-23f10b6e36c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:11.260607 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:11.341222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b872ad-91ec-40e6-b66d-23f10b6e36c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:23:11.342654 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b872ad-91ec-40e6-b66d-23f10b6e36c7 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:23:11.361148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 673/1334] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:23:13.334043 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56691b33-c7be-4bbf-92dc-580e15573b3e None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:13.334564 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56691b33-c7be-4bbf-92dc-580e15573b3e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:13.334564 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56691b33-c7be-4bbf-92dc-580e15573b3e None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:13.335956 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 662/1335] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:23:13.341400 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c7768-412e-4ff5-ad76-eb77449a37ae None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:13.341790 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c7768-412e-4ff5-ad76-eb77449a37ae None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:13.341957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c7768-412e-4ff5-ad76-eb77449a37ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:13.407969 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-cb4c7768-412e-4ff5-ad76-eb77449a37ae None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:23:13.409207 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cb4c7768-412e-4ff5-ad76-eb77449a37ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:13.482521 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:13.505030 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 674/1336] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:23:13.794285 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56691b33-c7be-4bbf-92dc-580e15573b3e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:23:13.795838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-56691b33-c7be-4bbf-92dc-580e15573b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:13.903835 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56691b33-c7be-4bbf-92dc-580e15573b3e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:23:13.932911 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:13.979967 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6f8cb-e4d1-418c-9c25-c6051833e6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:23:13.980566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6f8cb-e4d1-418c-9c25-c6051833e6af service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:13.980880 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6f8cb-e4d1-418c-9c25-c6051833e6af service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:13.981240 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6f8cb-e4d1-418c-9c25-c6051833e6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:13.983197 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c5b6f8cb-e4d1-418c-9c25-c6051833e6af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:14.105510 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6f8cb-e4d1-418c-9c25-c6051833e6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:23:14.106959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6f8cb-e4d1-418c-9c25-c6051833e6af service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:23:14.125028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 663/1337] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:23:16.339306 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4312f-55d6-46f7-9b63-f5c6e0b9ed27 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:16.339838 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4312f-55d6-46f7-9b63-f5c6e0b9ed27 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:16.339838 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4312f-55d6-46f7-9b63-f5c6e0b9ed27 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:16.341243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 675/1338] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:23:16.346383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa38cef-f184-4331-832d-b1bfe344e45a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:16.346791 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa38cef-f184-4331-832d-b1bfe344e45a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:16.346946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa38cef-f184-4331-832d-b1bfe344e45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:16.413848 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-afa38cef-f184-4331-832d-b1bfe344e45a None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:23:16.415064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-afa38cef-f184-4331-832d-b1bfe344e45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:16.423570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:16.513102 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 664/1339] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:23:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:23:16.803011 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4312f-55d6-46f7-9b63-f5c6e0b9ed27 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:23:16.804559 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-16b4312f-55d6-46f7-9b63-f5c6e0b9ed27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:16.907180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4312f-55d6-46f7-9b63-f5c6e0b9ed27 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:23:16.981927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f35a3-6a39-416b-a250-2b7a112a9b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:23:16.982538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f35a3-6a39-416b-a250-2b7a112a9b79 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:16.982857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f35a3-6a39-416b-a250-2b7a112a9b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:16.983389 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f35a3-6a39-416b-a250-2b7a112a9b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:16.985048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-852f35a3-6a39-416b-a250-2b7a112a9b79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:17.021812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:17.094927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f35a3-6a39-416b-a250-2b7a112a9b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:23:17.096370 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f35a3-6a39-416b-a250-2b7a112a9b79 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:23:17.115042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 676/1340] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:23:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:23:21.034050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6272d-a192-4424-8901-8fe47acd04ed None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:21.034616 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6272d-a192-4424-8901-8fe47acd04ed None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:21.035106 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6272d-a192-4424-8901-8fe47acd04ed None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:21.037870 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 665/1341] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:23:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:23:21.044756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7ac9b-940c-4741-a018-a444ea5ec326 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:21.045231 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7ac9b-940c-4741-a018-a444ea5ec326 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:21.045351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7ac9b-940c-4741-a018-a444ea5ec326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:21.116710 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-7ca7ac9b-940c-4741-a018-a444ea5ec326 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:23:21.117927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7ca7ac9b-940c-4741-a018-a444ea5ec326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:21.204218 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:21.216781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 677/1342] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:23:21.504155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6272d-a192-4424-8901-8fe47acd04ed None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:23:21.506135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-13c6272d-a192-4424-8901-8fe47acd04ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:21.613851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6272d-a192-4424-8901-8fe47acd04ed None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:23:21.652651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:21.691248 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbe220-044a-448f-bdb7-ae1615c8f813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:23:21.692076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbe220-044a-448f-bdb7-ae1615c8f813 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:21.692938 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbe220-044a-448f-bdb7-ae1615c8f813 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:21.693485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbe220-044a-448f-bdb7-ae1615c8f813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:21.695772 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d9fbe220-044a-448f-bdb7-ae1615c8f813 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:21.819331 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbe220-044a-448f-bdb7-ae1615c8f813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:23:21.820808 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fbe220-044a-448f-bdb7-ae1615c8f813 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:23:21.842080 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 666/1343] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:23:24.455686 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce93db4-0689-4fed-895f-9bd837355885 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:24.456462 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce93db4-0689-4fed-895f-9bd837355885 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:24.456462 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce93db4-0689-4fed-895f-9bd837355885 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:24.463211 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf35319-fdbc-4c3a-a2ad-9f1ed7df9c91 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:24.463728 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf35319-fdbc-4c3a-a2ad-9f1ed7df9c91 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:24.463858 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf35319-fdbc-4c3a-a2ad-9f1ed7df9c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:24.468127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 678/1344] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:23:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:23:24.537018 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ddf35319-fdbc-4c3a-a2ad-9f1ed7df9c91 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:23:24.538251 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ddf35319-fdbc-4c3a-a2ad-9f1ed7df9c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:24.559503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:24.660127 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 667/1345] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:23:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:23:24.925359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce93db4-0689-4fed-895f-9bd837355885 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:23:24.927047 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5ce93db4-0689-4fed-895f-9bd837355885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:25.038832 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce93db4-0689-4fed-895f-9bd837355885 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:23:25.125842 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843a577-1faa-4178-91c9-9f4807d6837c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:23:25.126451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843a577-1faa-4178-91c9-9f4807d6837c service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:25.126731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843a577-1faa-4178-91c9-9f4807d6837c service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:25.126999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843a577-1faa-4178-91c9-9f4807d6837c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:25.128611 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8843a577-1faa-4178-91c9-9f4807d6837c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:25.172833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:25.242013 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843a577-1faa-4178-91c9-9f4807d6837c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:23:25.243731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843a577-1faa-4178-91c9-9f4807d6837c service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:23:25.271287 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 679/1346] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:23:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:23:29.209164 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a3b3f-d50e-4718-8f22-b749a2b521d8 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:29.210001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a3b3f-d50e-4718-8f22-b749a2b521d8 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:29.210001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a3b3f-d50e-4718-8f22-b749a2b521d8 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:29.211711 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 668/1347] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:23:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:23:29.217452 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31b998-a02b-4b83-8f65-6645596a0eaf None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:29.217924 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31b998-a02b-4b83-8f65-6645596a0eaf None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:29.218032 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31b998-a02b-4b83-8f65-6645596a0eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:29.298026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-7e31b998-a02b-4b83-8f65-6645596a0eaf None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:23:29.299373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7e31b998-a02b-4b83-8f65-6645596a0eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:29.421610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:29.424255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 680/1348] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:23:29.718876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a3b3f-d50e-4718-8f22-b749a2b521d8 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:23:29.721786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b71a3b3f-d50e-4718-8f22-b749a2b521d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:29.893024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a3b3f-d50e-4718-8f22-b749a2b521d8 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:23:29.966413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:30.003598 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aedcc2-c8bb-4255-9f71-0575a5665898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:23:30.004217 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aedcc2-c8bb-4255-9f71-0575a5665898 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:30.004499 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aedcc2-c8bb-4255-9f71-0575a5665898 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:30.004853 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aedcc2-c8bb-4255-9f71-0575a5665898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:30.006774 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-57aedcc2-c8bb-4255-9f71-0575a5665898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:30.163840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aedcc2-c8bb-4255-9f71-0575a5665898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:23:30.165494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aedcc2-c8bb-4255-9f71-0575a5665898 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:23:30.186199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 669/1349] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:23:35.304146 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc5c7d-cc0d-4803-879d-41d31911fa66 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:35.304840 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc5c7d-cc0d-4803-879d-41d31911fa66 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:35.306439 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc5c7d-cc0d-4803-879d-41d31911fa66 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:35.308215 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 681/1350] 10.222.0.96 () {54 vars in 921 bytes} [Wed Aug 24 04:23:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:23:35.315146 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bbb03-a643-45d6-8ac6-024ef3be26f4 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:35.315612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bbb03-a643-45d6-8ac6-024ef3be26f4 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:35.315713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bbb03-a643-45d6-8ac6-024ef3be26f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:35.438300 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6f4bbb03-a643-45d6-8ac6-024ef3be26f4 None None] MFA Rules not processed for user `d1f7fe9af30947dbae1f2334b18f630d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:23:35.439813 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6f4bbb03-a643-45d6-8ac6-024ef3be26f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:35.467635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:35.613078 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 670/1351] 10.222.0.96 () {58 vars in 1018 bytes} [Wed Aug 24 04:23:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:23:40.305781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199814c-6d33-4641-b350-5b752be66fc7 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:40.306294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199814c-6d33-4641-b350-5b752be66fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:40.306416 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199814c-6d33-4641-b350-5b752be66fc7 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:40.307672 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 682/1352] 10.222.0.96 () {54 vars in 921 bytes} [Wed Aug 24 04:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:23:40.312969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804c63b-8fb7-4233-9105-0e72ff7152e6 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:40.313422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804c63b-8fb7-4233-9105-0e72ff7152e6 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:40.313515 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804c63b-8fb7-4233-9105-0e72ff7152e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:40.395135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9804c63b-8fb7-4233-9105-0e72ff7152e6 None None] MFA Rules not processed for user `d1f7fe9af30947dbae1f2334b18f630d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:23:40.397164 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9804c63b-8fb7-4233-9105-0e72ff7152e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:40.477129 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:40.537645 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 671/1353] 10.222.0.96 () {58 vars in 1018 bytes} [Wed Aug 24 04:23:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:23:42.088081 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0e17c-091c-456b-9a9e-eec3adb1b05c None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:42.088602 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0e17c-091c-456b-9a9e-eec3adb1b05c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:42.089174 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0e17c-091c-456b-9a9e-eec3adb1b05c None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:42.091095 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 683/1354] 10.222.0.96 () {54 vars in 921 bytes} [Wed Aug 24 04:23:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:23:42.096366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc713a45-f94c-4bf6-b572-c51e9bb949b2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:42.096959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc713a45-f94c-4bf6-b572-c51e9bb949b2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:42.096959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc713a45-f94c-4bf6-b572-c51e9bb949b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:42.183167 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-cc713a45-f94c-4bf6-b572-c51e9bb949b2 None None] MFA Rules not processed for user `d1f7fe9af30947dbae1f2334b18f630d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:23:42.184411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cc713a45-f94c-4bf6-b572-c51e9bb949b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:42.300287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 672/1355] 10.222.0.96 () {58 vars in 1018 bytes} [Wed Aug 24 04:23:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:23:46.234141 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55fcb4-35c5-4c2f-9dee-e9ba01f879b5 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:46.235045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55fcb4-35c5-4c2f-9dee-e9ba01f879b5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:46.235329 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55fcb4-35c5-4c2f-9dee-e9ba01f879b5 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:46.236716 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 684/1356] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:23:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:23:46.243218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae62d0-6092-4702-9824-951725473fa9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:46.244150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae62d0-6092-4702-9824-951725473fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:46.244437 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae62d0-6092-4702-9824-951725473fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:46.300122 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:46.365027 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-75ae62d0-6092-4702-9824-951725473fa9 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:23:46.367030 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-75ae62d0-6092-4702-9824-951725473fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:46.526280 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 673/1357] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:23:46.845774 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a1627-c852-4046-9727-ab7d68f4e43b None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:46.846309 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a1627-c852-4046-9727-ab7d68f4e43b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:46.846787 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a1627-c852-4046-9727-ab7d68f4e43b None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:46.849387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 685/1358] 10.222.0.96 () {54 vars in 962 bytes} [Wed Aug 24 04:23:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:23:46.859021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540bb4c-8bd0-460a-942c-ce201e25c404 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:46.859602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540bb4c-8bd0-460a-942c-ce201e25c404 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:46.860330 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540bb4c-8bd0-460a-942c-ce201e25c404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:46.950707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6540bb4c-8bd0-460a-942c-ce201e25c404 None None] MFA Rules not processed for user `3539784b4e91472eb20addc6707dc30d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:23:46.952155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6540bb4c-8bd0-460a-942c-ce201e25c404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:47.004332 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:47.085496 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 674/1359] 10.222.0.96 () {58 vars in 1059 bytes} [Wed Aug 24 04:23:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:23:47.093121 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a1627-c852-4046-9727-ab7d68f4e43b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:23:47.094662 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-552a1627-c852-4046-9727-ab7d68f4e43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:47.261735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a1627-c852-4046-9727-ab7d68f4e43b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:23:47.340807 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:47.384435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cc8c9-1694-4890-92ac-fcb49bfe4eda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:23:47.385079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cc8c9-1694-4890-92ac-fcb49bfe4eda service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:47.385361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cc8c9-1694-4890-92ac-fcb49bfe4eda service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:47.385633 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cc8c9-1694-4890-92ac-fcb49bfe4eda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:47.387223 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-066cc8c9-1694-4890-92ac-fcb49bfe4eda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:47.481819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066cc8c9-1694-4890-92ac-fcb49bfe4eda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:23:47.483469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066cc8c9-1694-4890-92ac-fcb49bfe4eda service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:23:47.502951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 686/1360] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:23:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:23:49.646202 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955fdbc-5a6d-4b35-905c-9097f89bdcfe None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:49.646736 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955fdbc-5a6d-4b35-905c-9097f89bdcfe None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:49.646736 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955fdbc-5a6d-4b35-905c-9097f89bdcfe None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:49.648183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 675/1361] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:23:49.653353 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ec284-c8fb-4e01-9ad1-be2c8c5fec2c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:49.653852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ec284-c8fb-4e01-9ad1-be2c8c5fec2c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:49.653945 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ec284-c8fb-4e01-9ad1-be2c8c5fec2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:49.726930 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f07ec284-c8fb-4e01-9ad1-be2c8c5fec2c None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:23:49.728298 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f07ec284-c8fb-4e01-9ad1-be2c8c5fec2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:49.773302 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:49.846417 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 687/1362] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:23:50.149259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955fdbc-5a6d-4b35-905c-9097f89bdcfe None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:23:50.151098 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d955fdbc-5a6d-4b35-905c-9097f89bdcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:50.322387 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955fdbc-5a6d-4b35-905c-9097f89bdcfe None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:23:50.333513 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:50.460071 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105162c3-1a90-4ee3-8b61-bbf1643e2ec2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:23:50.460866 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105162c3-1a90-4ee3-8b61-bbf1643e2ec2 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:50.461213 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105162c3-1a90-4ee3-8b61-bbf1643e2ec2 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:50.461548 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105162c3-1a90-4ee3-8b61-bbf1643e2ec2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:50.463302 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-105162c3-1a90-4ee3-8b61-bbf1643e2ec2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:50.570735 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105162c3-1a90-4ee3-8b61-bbf1643e2ec2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:23:50.572548 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105162c3-1a90-4ee3-8b61-bbf1643e2ec2 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:23:50.593811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 676/1363] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:23:52.919034 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d65b5-d916-42ae-9994-db487177d512 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:52.919602 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d65b5-d916-42ae-9994-db487177d512 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:52.919602 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d65b5-d916-42ae-9994-db487177d512 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:52.920985 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 688/1364] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:23:52.926348 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833c4b5-7a46-455a-b71a-497c31dfcb00 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:52.927269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833c4b5-7a46-455a-b71a-497c31dfcb00 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:52.927476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833c4b5-7a46-455a-b71a-497c31dfcb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:52.944605 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:53.000651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-7833c4b5-7a46-455a-b71a-497c31dfcb00 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:23:53.001924 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7833c4b5-7a46-455a-b71a-497c31dfcb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:53.118461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 677/1365] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:23:53.416927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78e17b-caa7-443f-bfb6-0693467ea662 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:53.417358 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78e17b-caa7-443f-bfb6-0693467ea662 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:53.417807 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78e17b-caa7-443f-bfb6-0693467ea662 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:53.419314 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 689/1366] 10.222.0.96 () {54 vars in 962 bytes} [Wed Aug 24 04:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:23:53.425038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098e9e1-64ad-4cf7-ae77-32e9fd591554 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:53.425332 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098e9e1-64ad-4cf7-ae77-32e9fd591554 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:53.425608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098e9e1-64ad-4cf7-ae77-32e9fd591554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:53.509917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-1098e9e1-64ad-4cf7-ae77-32e9fd591554 None None] MFA Rules not processed for user `3539784b4e91472eb20addc6707dc30d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:23:53.511131 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1098e9e1-64ad-4cf7-ae77-32e9fd591554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:53.550562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:53.642582 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 678/1367] 10.222.0.96 () {58 vars in 1059 bytes} [Wed Aug 24 04:23:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:23:53.651017 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78e17b-caa7-443f-bfb6-0693467ea662 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:23:53.652530 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fd78e17b-caa7-443f-bfb6-0693467ea662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:53.816911 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78e17b-caa7-443f-bfb6-0693467ea662 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:23:53.849612 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:53.956922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99aeb4-221d-424b-b69b-328a00b4c85e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:23:53.957602 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99aeb4-221d-424b-b69b-328a00b4c85e service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:53.958590 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99aeb4-221d-424b-b69b-328a00b4c85e service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:53.958922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99aeb4-221d-424b-b69b-328a00b4c85e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:53.960589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ca99aeb4-221d-424b-b69b-328a00b4c85e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:54.054171 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99aeb4-221d-424b-b69b-328a00b4c85e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:23:54.055896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99aeb4-221d-424b-b69b-328a00b4c85e service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:23:54.075398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 690/1368] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:23:54.510228 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4123b5-020d-453f-9c2b-8fa5943c8f6c None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:54.510792 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4123b5-020d-453f-9c2b-8fa5943c8f6c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:54.510792 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4123b5-020d-453f-9c2b-8fa5943c8f6c None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:54.512153 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 679/1369] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:23:54.517637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71570b95-144a-463e-8ca8-bd87f1cce5da None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:54.517934 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71570b95-144a-463e-8ca8-bd87f1cce5da None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:54.518220 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71570b95-144a-463e-8ca8-bd87f1cce5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:54.552323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:54.590698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-71570b95-144a-463e-8ca8-bd87f1cce5da None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:23:54.591939 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-71570b95-144a-463e-8ca8-bd87f1cce5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:54.704362 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 691/1370] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:23:55.258723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43592b0-2279-45d4-98b4-2a6614e605ea None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:55.259027 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43592b0-2279-45d4-98b4-2a6614e605ea None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:55.259296 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43592b0-2279-45d4-98b4-2a6614e605ea None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:55.260726 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 680/1371] 10.222.0.96 () {54 vars in 964 bytes} [Wed Aug 24 04:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:23:55.265779 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38becab2-81c7-40f1-976d-0248b04ac6bc None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:55.266230 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38becab2-81c7-40f1-976d-0248b04ac6bc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:55.266403 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38becab2-81c7-40f1-976d-0248b04ac6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:55.346257 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-38becab2-81c7-40f1-976d-0248b04ac6bc None None] MFA Rules not processed for user `b182bf0bbbcf4a808626443c6c2a7a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:23:55.347485 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-38becab2-81c7-40f1-976d-0248b04ac6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:55.401680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:55.437237 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 692/1372] 10.222.0.96 () {58 vars in 1061 bytes} [Wed Aug 24 04:23:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:23:55.445394 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43592b0-2279-45d4-98b4-2a6614e605ea None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:23:55.446917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e43592b0-2279-45d4-98b4-2a6614e605ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:55.556560 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43592b0-2279-45d4-98b4-2a6614e605ea None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:23:55.600087 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:55.638408 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd755cc-3746-44a8-a3d6-382ea9ce23ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:23:55.639056 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd755cc-3746-44a8-a3d6-382ea9ce23ca service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:55.639370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd755cc-3746-44a8-a3d6-382ea9ce23ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:55.639657 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd755cc-3746-44a8-a3d6-382ea9ce23ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:55.641292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ddd755cc-3746-44a8-a3d6-382ea9ce23ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:55.764001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd755cc-3746-44a8-a3d6-382ea9ce23ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:23:55.765595 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd755cc-3746-44a8-a3d6-382ea9ce23ca service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:23:55.796806 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 681/1373] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:23:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:23:56.073102 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8ccee-b4ca-4722-a659-031ca8e2f2b4 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:56.073396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8ccee-b4ca-4722-a659-031ca8e2f2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:56.073667 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8ccee-b4ca-4722-a659-031ca8e2f2b4 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:56.075033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 693/1374] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:23:56.080598 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc4b69-0c10-47a7-93f7-0b450c4769e8 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:56.080935 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc4b69-0c10-47a7-93f7-0b450c4769e8 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:56.081223 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc4b69-0c10-47a7-93f7-0b450c4769e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:56.148964 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-82dc4b69-0c10-47a7-93f7-0b450c4769e8 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:23:56.150424 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-82dc4b69-0c10-47a7-93f7-0b450c4769e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:56.172802 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:56.252166 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 682/1375] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:23:56.555142 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8ccee-b4ca-4722-a659-031ca8e2f2b4 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:23:56.556818 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-95e8ccee-b4ca-4722-a659-031ca8e2f2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:56.717472 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8ccee-b4ca-4722-a659-031ca8e2f2b4 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:23:56.774270 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:56.845626 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55cbf5-2363-454a-b359-4eba9fba0025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:23:56.847225 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55cbf5-2363-454a-b359-4eba9fba0025 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:56.847505 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55cbf5-2363-454a-b359-4eba9fba0025 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:56.847774 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55cbf5-2363-454a-b359-4eba9fba0025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:56.850185 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7c55cbf5-2363-454a-b359-4eba9fba0025 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:56.941259 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55cbf5-2363-454a-b359-4eba9fba0025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:23:56.943482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55cbf5-2363-454a-b359-4eba9fba0025 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:23:56.961935 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 694/1376] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:23:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:23:58.956648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cd06c-70a7-45dc-b52e-c9e9b9e8ae68 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:58.957295 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cd06c-70a7-45dc-b52e-c9e9b9e8ae68 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:58.957295 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cd06c-70a7-45dc-b52e-c9e9b9e8ae68 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:58.958672 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 683/1377] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:23:58.964369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a71fbd-414d-4fdc-8ce1-3ef9844d9461 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:58.964936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a71fbd-414d-4fdc-8ce1-3ef9844d9461 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:58.964936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a71fbd-414d-4fdc-8ce1-3ef9844d9461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:59.030227 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-85a71fbd-414d-4fdc-8ce1-3ef9844d9461 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:23:59.031408 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-85a71fbd-414d-4fdc-8ce1-3ef9844d9461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:59.038214 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:59.133184 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 695/1378] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:23:59.442054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89cd06c-70a7-45dc-b52e-c9e9b9e8ae68 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:23:59.443696 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f89cd06c-70a7-45dc-b52e-c9e9b9e8ae68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:59.623710 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89cd06c-70a7-45dc-b52e-c9e9b9e8ae68 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:23:59.628120 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:59.758119 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a552ac-21e9-42b9-8472-982a1c6123bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:23:59.758733 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a552ac-21e9-42b9-8472-982a1c6123bb service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:59.759018 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a552ac-21e9-42b9-8472-982a1c6123bb service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:59.759291 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a552ac-21e9-42b9-8472-982a1c6123bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:59.760959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-96a552ac-21e9-42b9-8472-982a1c6123bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:59.859483 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a552ac-21e9-42b9-8472-982a1c6123bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:23:59.861145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a552ac-21e9-42b9-8472-982a1c6123bb service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:23:59.880477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 684/1379] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:23:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:24:01.849814 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b23b1-6c91-4472-8e8c-a9bab3d7b3d1 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:01.850323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b23b1-6c91-4472-8e8c-a9bab3d7b3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:01.850408 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b23b1-6c91-4472-8e8c-a9bab3d7b3d1 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:01.851710 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 696/1380] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:24:01.857524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe569a9-136c-4437-a0f3-4d521d792fcc None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:01.857954 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe569a9-136c-4437-a0f3-4d521d792fcc None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:01.858128 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe569a9-136c-4437-a0f3-4d521d792fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:01.870560 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:01.931139 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-bfe569a9-136c-4437-a0f3-4d521d792fcc None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:01.932356 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-bfe569a9-136c-4437-a0f3-4d521d792fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:02.036814 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 685/1381] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:24:02.335716 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b23b1-6c91-4472-8e8c-a9bab3d7b3d1 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:24:02.337328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-029b23b1-6c91-4472-8e8c-a9bab3d7b3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:02.486646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:02.499205 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b23b1-6c91-4472-8e8c-a9bab3d7b3d1 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:24:02.623604 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde248cb-405b-4143-9457-2b5761443db0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:24:02.624137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde248cb-405b-4143-9457-2b5761443db0 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:02.624420 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde248cb-405b-4143-9457-2b5761443db0 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:02.624713 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde248cb-405b-4143-9457-2b5761443db0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:02.626500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fde248cb-405b-4143-9457-2b5761443db0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:02.732272 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde248cb-405b-4143-9457-2b5761443db0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:24:02.733968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde248cb-405b-4143-9457-2b5761443db0 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:24:02.746037 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:02.755763 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 697/1382] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:24:04.757973 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf141f-ce50-43b5-ab86-0590550df1d5 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:04.758532 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf141f-ce50-43b5-ab86-0590550df1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:04.758532 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf141f-ce50-43b5-ab86-0590550df1d5 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:04.759973 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 686/1383] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:24:04.766127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ef894-5454-4d6b-b5cf-8864a8f87960 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:04.766528 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ef894-5454-4d6b-b5cf-8864a8f87960 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:04.766844 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ef894-5454-4d6b-b5cf-8864a8f87960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:04.854905 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6d9ef894-5454-4d6b-b5cf-8864a8f87960 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:04.856149 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6d9ef894-5454-4d6b-b5cf-8864a8f87960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:04.956006 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 698/1384] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:24:05.258627 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf141f-ce50-43b5-ab86-0590550df1d5 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:24:05.260215 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9daf141f-ce50-43b5-ab86-0590550df1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:05.349281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:05.415768 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf141f-ce50-43b5-ab86-0590550df1d5 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:24:05.548171 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4413fa-ed3d-4479-a6d5-272ed93199f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:24:05.548855 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4413fa-ed3d-4479-a6d5-272ed93199f0 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:05.549211 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4413fa-ed3d-4479-a6d5-272ed93199f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:05.549547 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4413fa-ed3d-4479-a6d5-272ed93199f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:05.552338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7d4413fa-ed3d-4479-a6d5-272ed93199f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:05.615340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:05.665897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4413fa-ed3d-4479-a6d5-272ed93199f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:24:05.667942 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4413fa-ed3d-4479-a6d5-272ed93199f0 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:24:05.691491 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 687/1385] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:24:07.683289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a618c4-0a0a-418f-90fa-24b8501fd2a6 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:07.683799 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a618c4-0a0a-418f-90fa-24b8501fd2a6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:07.683919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a618c4-0a0a-418f-90fa-24b8501fd2a6 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:07.685382 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 699/1386] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:24:07.690855 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b6b89-c145-4008-a416-d6ff37410488 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:07.691262 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b6b89-c145-4008-a416-d6ff37410488 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:07.691439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b6b89-c145-4008-a416-d6ff37410488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:07.768063 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-2a7b6b89-c145-4008-a416-d6ff37410488 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:07.769383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2a7b6b89-c145-4008-a416-d6ff37410488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:07.873775 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 688/1387] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:24:08.165115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a618c4-0a0a-418f-90fa-24b8501fd2a6 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:24:08.166647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-70a618c4-0a0a-418f-90fa-24b8501fd2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:08.247893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:08.328076 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a618c4-0a0a-418f-90fa-24b8501fd2a6 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:24:08.447471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59aeffd-d323-4f77-8dd8-508b2d94e40b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:24:08.447955 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aeffd-d323-4f77-8dd8-508b2d94e40b service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:08.448229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aeffd-d323-4f77-8dd8-508b2d94e40b service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:08.448512 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aeffd-d323-4f77-8dd8-508b2d94e40b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:08.450156 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f59aeffd-d323-4f77-8dd8-508b2d94e40b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:08.489873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:08.552263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59aeffd-d323-4f77-8dd8-508b2d94e40b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:24:08.554059 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59aeffd-d323-4f77-8dd8-508b2d94e40b service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:24:08.575397 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 700/1388] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:24:10.560011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a750db-d6a2-4bf3-9ab5-91b494b951a1 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:10.560582 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a750db-d6a2-4bf3-9ab5-91b494b951a1 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:10.560582 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a750db-d6a2-4bf3-9ab5-91b494b951a1 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:10.561976 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 689/1389] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:24:10.567382 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267ad49-3279-4d0d-8547-6d026208181e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:10.567994 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267ad49-3279-4d0d-8547-6d026208181e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:10.567994 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267ad49-3279-4d0d-8547-6d026208181e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:10.634991 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e267ad49-3279-4d0d-8547-6d026208181e None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:10.636228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e267ad49-3279-4d0d-8547-6d026208181e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:10.733145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 701/1390] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:24:11.027997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a750db-d6a2-4bf3-9ab5-91b494b951a1 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:24:11.029562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-10a750db-d6a2-4bf3-9ab5-91b494b951a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:11.046246 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac0868-04d9-452c-bc13-ff46d704f429 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:11.046543 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac0868-04d9-452c-bc13-ff46d704f429 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:11.046818 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac0868-04d9-452c-bc13-ff46d704f429 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:11.048192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 702/1391] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:24:11.054338 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d8ba6-3dc2-4871-81bd-975493691456 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:11.054688 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d8ba6-3dc2-4871-81bd-975493691456 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:11.055030 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d8ba6-3dc2-4871-81bd-975493691456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:11.061895 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:11.071557 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:11.124593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-fd9d8ba6-3dc2-4871-81bd-975493691456 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:11.125750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fd9d8ba6-3dc2-4871-81bd-975493691456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:11.187512 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a750db-d6a2-4bf3-9ab5-91b494b951a1 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:24:11.230146 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 703/1392] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:24:11.300785 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:11.315818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9e932-2029-491d-8053-c065e7af3ff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:24:11.316433 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9e932-2029-491d-8053-c065e7af3ff2 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:11.316749 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9e932-2029-491d-8053-c065e7af3ff2 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:11.317036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9e932-2029-491d-8053-c065e7af3ff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:11.318643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-82a9e932-2029-491d-8053-c065e7af3ff2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:11.409256 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9e932-2029-491d-8053-c065e7af3ff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:24:11.411770 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9e932-2029-491d-8053-c065e7af3ff2 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:24:11.430064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 690/1393] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:24:11.538991 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdee384-063d-4716-b144-01b1251cc370 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:11.539367 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdee384-063d-4716-b144-01b1251cc370 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:11.539956 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdee384-063d-4716-b144-01b1251cc370 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:11.542325 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 704/1394] 10.222.0.96 () {54 vars in 967 bytes} [Wed Aug 24 04:24:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:24:11.549450 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b50371-115a-46b6-bd3d-86d9cff36f44 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:11.549911 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b50371-115a-46b6-bd3d-86d9cff36f44 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:11.550321 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b50371-115a-46b6-bd3d-86d9cff36f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:11.636052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-75b50371-115a-46b6-bd3d-86d9cff36f44 None None] MFA Rules not processed for user `6106a46199b74f649cd29a0d02610049`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:11.637291 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-75b50371-115a-46b6-bd3d-86d9cff36f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:11.690714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:11.715548 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 691/1395] 10.222.0.96 () {58 vars in 1064 bytes} [Wed Aug 24 04:24:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:24:11.724051 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdee384-063d-4716-b144-01b1251cc370 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:24:11.725460 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-dfdee384-063d-4716-b144-01b1251cc370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:11.827767 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:11.836704 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdee384-063d-4716-b144-01b1251cc370 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:24:11.917266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91684c41-4bb7-4fc8-8f87-cf6bfdaddd0e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6106a46199b74f649cd29a0d02610049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:24:11.917906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91684c41-4bb7-4fc8-8f87-cf6bfdaddd0e service glance] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:11.918188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91684c41-4bb7-4fc8-8f87-cf6bfdaddd0e service glance] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:11.918462 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91684c41-4bb7-4fc8-8f87-cf6bfdaddd0e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:11.922367 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-91684c41-4bb7-4fc8-8f87-cf6bfdaddd0e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:12.062642 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91684c41-4bb7-4fc8-8f87-cf6bfdaddd0e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:24:12.064015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91684c41-4bb7-4fc8-8f87-cf6bfdaddd0e service glance] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:24:12.083404 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 705/1396] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:24:12.854784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557577-a322-4db8-920f-10d0c56519d8 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:12.855269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557577-a322-4db8-920f-10d0c56519d8 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:12.855368 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557577-a322-4db8-920f-10d0c56519d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:12.934121 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-39557577-a322-4db8-920f-10d0c56519d8 None None] MFA Rules not processed for user `e9ffc48d1f6d49f49d00d1c2e762b987`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:12.935346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-39557577-a322-4db8-920f-10d0c56519d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:13.027175 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 692/1397] 10.222.0.96 () {58 vars in 1009 bytes} [Wed Aug 24 04:24:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:24:13.070716 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8bf40-e595-4ff8-b1f6-71155b60024a None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:13.071210 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8bf40-e595-4ff8-b1f6-71155b60024a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:13.071307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8bf40-e595-4ff8-b1f6-71155b60024a None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:13.072618 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 706/1398] 10.222.0.96 () {54 vars in 943 bytes} [Wed Aug 24 04:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:24:13.079576 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cb5ff-e8f7-4cbc-9a39-1b8b29df4d73 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:13.079932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cb5ff-e8f7-4cbc-9a39-1b8b29df4d73 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:13.080209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cb5ff-e8f7-4cbc-9a39-1b8b29df4d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:13.159148 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-627cb5ff-e8f7-4cbc-9a39-1b8b29df4d73 None None] MFA Rules not processed for user `953d2dbd5e7d435f9148fd043b4ce7a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:13.160287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-627cb5ff-e8f7-4cbc-9a39-1b8b29df4d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:13.173967 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:13.274514 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 693/1399] 10.222.0.96 () {58 vars in 1040 bytes} [Wed Aug 24 04:24:13 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:24:13.284118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8bf40-e595-4ff8-b1f6-71155b60024a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:24:13.285681 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-58e8bf40-e595-4ff8-b1f6-71155b60024a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:13.310482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:13.404463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221128f-fbdc-4942-ac9f-7fa74630e31d None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:13.404862 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221128f-fbdc-4942-ac9f-7fa74630e31d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:13.405075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221128f-fbdc-4942-ac9f-7fa74630e31d None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:13.406426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 694/1400] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:24:13.412189 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81199a-26a6-4525-9ef5-cbbc284696b9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:13.412444 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81199a-26a6-4525-9ef5-cbbc284696b9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:13.412764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81199a-26a6-4525-9ef5-cbbc284696b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:13.427710 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8bf40-e595-4ff8-b1f6-71155b60024a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:24:13.481818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-3f81199a-26a6-4525-9ef5-cbbc284696b9 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:13.483044 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3f81199a-26a6-4525-9ef5-cbbc284696b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:13.538534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f862d9-1f9c-4259-a97f-319e6e913f93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953d2dbd5e7d435f9148fd043b4ce7a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:24:13.539150 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f862d9-1f9c-4259-a97f-319e6e913f93 service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:13.539434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f862d9-1f9c-4259-a97f-319e6e913f93 service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:13.539714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f862d9-1f9c-4259-a97f-319e6e913f93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:13.541388 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-12f862d9-1f9c-4259-a97f-319e6e913f93 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:13.548847 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:13.563218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:13.587593 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 695/1401] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:24:13.627506 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f862d9-1f9c-4259-a97f-319e6e913f93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:24:13.629418 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f862d9-1f9c-4259-a97f-319e6e913f93 service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:24:13.639044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 707/1402] 10.222.0.96 () {60 vars in 1384 bytes} [Wed Aug 24 04:24:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:24:13.884866 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81199a-26a6-4525-9ef5-cbbc284696b9 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:24:13.886525 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3f81199a-26a6-4525-9ef5-cbbc284696b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:14.023929 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81199a-26a6-4525-9ef5-cbbc284696b9 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:24:14.128274 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:14.157460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a21208-e900-41c8-a9b7-b086b8a53e2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:24:14.158081 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a21208-e900-41c8-a9b7-b086b8a53e2b service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:14.158360 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a21208-e900-41c8-a9b7-b086b8a53e2b service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:14.158632 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a21208-e900-41c8-a9b7-b086b8a53e2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:14.160245 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-38a21208-e900-41c8-a9b7-b086b8a53e2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:14.271360 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a21208-e900-41c8-a9b7-b086b8a53e2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:24:14.273049 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a21208-e900-41c8-a9b7-b086b8a53e2b service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:24:14.292571 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 696/1403] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:24:16.309338 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e3e98-2e72-45cb-b3dd-9e4eefe0a977 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:16.309902 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e3e98-2e72-45cb-b3dd-9e4eefe0a977 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:16.309902 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e3e98-2e72-45cb-b3dd-9e4eefe0a977 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:16.315398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 708/1404] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:24:16.319082 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50f46f-a779-41c8-a1f4-8742b106216a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:16.319529 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50f46f-a779-41c8-a1f4-8742b106216a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:16.319634 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50f46f-a779-41c8-a1f4-8742b106216a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:16.399420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-cc50f46f-a779-41c8-a1f4-8742b106216a None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:16.400581 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cc50f46f-a779-41c8-a1f4-8742b106216a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:16.466108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:16.521051 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 697/1405] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:24:16.823950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e3e98-2e72-45cb-b3dd-9e4eefe0a977 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:24:16.826000 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fb1e3e98-2e72-45cb-b3dd-9e4eefe0a977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:17.139340 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e3e98-2e72-45cb-b3dd-9e4eefe0a977 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:24:17.143662 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:17.332113 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a18cf1-943c-4018-b3d9-61c69485ea4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:24:17.333490 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a18cf1-943c-4018-b3d9-61c69485ea4b service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:17.333820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a18cf1-943c-4018-b3d9-61c69485ea4b service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:17.334125 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a18cf1-943c-4018-b3d9-61c69485ea4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:17.335775 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-80a18cf1-943c-4018-b3d9-61c69485ea4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:17.441441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a18cf1-943c-4018-b3d9-61c69485ea4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:24:17.443721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a18cf1-943c-4018-b3d9-61c69485ea4b service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:24:17.465488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 709/1406] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:24:19.445647 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462540c7-0252-4eb3-b978-d811371bc320 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:19.447194 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462540c7-0252-4eb3-b978-d811371bc320 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:19.447663 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462540c7-0252-4eb3-b978-d811371bc320 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:19.449231 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 698/1407] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:24:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:24:19.455004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0fe35-ab9b-4d59-b115-e950a5211f0d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:19.455424 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0fe35-ab9b-4d59-b115-e950a5211f0d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:19.455632 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0fe35-ab9b-4d59-b115-e950a5211f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:19.465459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:19.531261 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b6e0fe35-ab9b-4d59-b115-e950a5211f0d None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:19.532516 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b6e0fe35-ab9b-4d59-b115-e950a5211f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:19.651804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 710/1408] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:24:19.946842 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462540c7-0252-4eb3-b978-d811371bc320 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:24:19.948774 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-462540c7-0252-4eb3-b978-d811371bc320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:20.148229 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462540c7-0252-4eb3-b978-d811371bc320 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:24:20.191456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:20.287198 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b7a4e-523d-4931-bf7d-f6d299750024 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:24:20.287734 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b7a4e-523d-4931-bf7d-f6d299750024 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:20.288014 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b7a4e-523d-4931-bf7d-f6d299750024 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:20.288309 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b7a4e-523d-4931-bf7d-f6d299750024 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:20.290060 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-685b7a4e-523d-4931-bf7d-f6d299750024 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:20.396634 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b7a4e-523d-4931-bf7d-f6d299750024 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:24:20.398291 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b7a4e-523d-4931-bf7d-f6d299750024 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:24:20.422022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 699/1409] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:24:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:24:29.647528 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=62 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:30.419613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=82 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:35.862199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78f5b8-17a4-4de1-8f2a-722e14c22d64 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:35.862693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78f5b8-17a4-4de1-8f2a-722e14c22d64 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:35.862799 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78f5b8-17a4-4de1-8f2a-722e14c22d64 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:35.865069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 711/1410] 10.222.0.96 () {54 vars in 918 bytes} [Wed Aug 24 04:24:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:24:35.870465 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632842d-437d-48d1-94dc-0df9b9cba205 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:35.870964 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632842d-437d-48d1-94dc-0df9b9cba205 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:35.871062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632842d-437d-48d1-94dc-0df9b9cba205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:35.947473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-8632842d-437d-48d1-94dc-0df9b9cba205 None None] MFA Rules not processed for user `d1f7fe9af30947dbae1f2334b18f630d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:35.948719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8632842d-437d-48d1-94dc-0df9b9cba205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:36.058690 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 700/1411] 10.222.0.96 () {58 vars in 1015 bytes} [Wed Aug 24 04:24:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:24:36.073559 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305d0db-f7b2-46bd-a849-8281b18cce20 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:36.073850 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305d0db-f7b2-46bd-a849-8281b18cce20 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:36.074129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305d0db-f7b2-46bd-a849-8281b18cce20 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:36.075461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 712/1412] 10.222.0.96 () {54 vars in 918 bytes} [Wed Aug 24 04:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:24:36.080429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84932c7-f4fb-4607-abb3-fdc983f0ffa0 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:36.080750 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84932c7-f4fb-4607-abb3-fdc983f0ffa0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:36.081031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84932c7-f4fb-4607-abb3-fdc983f0ffa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:36.157861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:36.161800 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d84932c7-f4fb-4607-abb3-fdc983f0ffa0 None None] MFA Rules not processed for user `3539784b4e91472eb20addc6707dc30d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:36.163621 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d84932c7-f4fb-4607-abb3-fdc983f0ffa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:36.281544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 701/1413] 10.222.0.96 () {58 vars in 1015 bytes} [Wed Aug 24 04:24:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:24:38.674889 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc52676-5030-4e8b-96c6-667f759dbd97 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:38.675425 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc52676-5030-4e8b-96c6-667f759dbd97 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:38.675425 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc52676-5030-4e8b-96c6-667f759dbd97 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:38.677451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:24:38.682757 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df5a5c-3b0e-4a4d-8553-20509984b970 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:38.683173 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df5a5c-3b0e-4a4d-8553-20509984b970 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:38.683325 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df5a5c-3b0e-4a4d-8553-20509984b970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:38.751517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-89df5a5c-3b0e-4a4d-8553-20509984b970 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:38.752753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-89df5a5c-3b0e-4a4d-8553-20509984b970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:38.807511 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:38.853420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:24:39.147734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc52676-5030-4e8b-96c6-667f759dbd97 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:24:39.149312 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-fcc52676-5030-4e8b-96c6-667f759dbd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:39.310182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc52676-5030-4e8b-96c6-667f759dbd97 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:24:39.386564 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:39.428762 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b16e0-348c-442a-93e2-7cea01933d97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:24:39.429380 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b16e0-348c-442a-93e2-7cea01933d97 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:39.429663 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b16e0-348c-442a-93e2-7cea01933d97 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:39.429938 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b16e0-348c-442a-93e2-7cea01933d97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:39.431544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-458b16e0-348c-442a-93e2-7cea01933d97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:39.528942 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b16e0-348c-442a-93e2-7cea01933d97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:24:39.530559 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b16e0-348c-442a-93e2-7cea01933d97 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:24:39.549216 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 714/1416] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:24:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:24:40.449969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55c460-de46-4f13-9558-20f9012b23e0 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:40.450512 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55c460-de46-4f13-9558-20f9012b23e0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:40.450512 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55c460-de46-4f13-9558-20f9012b23e0 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:40.451959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:24:40.457179 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b243a4d-496c-4b85-89fc-b3ebfcf2d939 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:40.457583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b243a4d-496c-4b85-89fc-b3ebfcf2d939 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:40.457879 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b243a4d-496c-4b85-89fc-b3ebfcf2d939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:40.534289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9b243a4d-496c-4b85-89fc-b3ebfcf2d939 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:40.536048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9b243a4d-496c-4b85-89fc-b3ebfcf2d939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:40.563342 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:40.634383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:24:40.784833 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55c460-de46-4f13-9558-20f9012b23e0 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:24:40.786859 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6c55c460-de46-4f13-9558-20f9012b23e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:40.934861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55c460-de46-4f13-9558-20f9012b23e0 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:24:40.975397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:41.050730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66225a99-f91b-46ac-a808-a135af002850 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:24:41.051257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66225a99-f91b-46ac-a808-a135af002850 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:41.051542 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66225a99-f91b-46ac-a808-a135af002850 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:41.051815 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66225a99-f91b-46ac-a808-a135af002850 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:41.053489 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-66225a99-f91b-46ac-a808-a135af002850 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:41.146080 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66225a99-f91b-46ac-a808-a135af002850 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:24:41.147681 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66225a99-f91b-46ac-a808-a135af002850 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:24:41.166225 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 704/1419] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:24:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:24:42.073212 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a92cc-86e5-4a72-93ec-37ce471e5621 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:42.073752 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a92cc-86e5-4a72-93ec-37ce471e5621 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:42.073752 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a92cc-86e5-4a72-93ec-37ce471e5621 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:42.075118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:24:42.080497 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d91b4-86cb-4228-88db-1ea72044a89f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:42.080989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d91b4-86cb-4228-88db-1ea72044a89f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:42.081126 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d91b4-86cb-4228-88db-1ea72044a89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:42.136184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:42.157855 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9c1d91b4-86cb-4228-88db-1ea72044a89f None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:42.159059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9c1d91b4-86cb-4228-88db-1ea72044a89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:42.256211 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:24:42.412917 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a92cc-86e5-4a72-93ec-37ce471e5621 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:24:42.414421 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-dc2a92cc-86e5-4a72-93ec-37ce471e5621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:42.562267 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a92cc-86e5-4a72-93ec-37ce471e5621 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:24:42.574926 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:42.675516 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252650a-4432-416b-b8a5-4330a9e939d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:24:42.676631 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252650a-4432-416b-b8a5-4330a9e939d9 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:42.676945 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252650a-4432-416b-b8a5-4330a9e939d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:42.677221 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252650a-4432-416b-b8a5-4330a9e939d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:42.678825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e252650a-4432-416b-b8a5-4330a9e939d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:42.768806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252650a-4432-416b-b8a5-4330a9e939d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:24:42.770432 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252650a-4432-416b-b8a5-4330a9e939d9 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:24:42.788695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 717/1422] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:24:43.673423 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a21efe-43ea-44bb-b308-5abaf2238459 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:43.673985 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a21efe-43ea-44bb-b308-5abaf2238459 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:43.673985 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a21efe-43ea-44bb-b308-5abaf2238459 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:43.675235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:24:43.680256 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23d7b9-4f25-40ac-9250-b86953b79509 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:43.680677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23d7b9-4f25-40ac-9250-b86953b79509 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:43.680852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23d7b9-4f25-40ac-9250-b86953b79509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:43.700808 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:43.757188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8d23d7b9-4f25-40ac-9250-b86953b79509 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:43.758389 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8d23d7b9-4f25-40ac-9250-b86953b79509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:43.859175 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:24:44.013685 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a21efe-43ea-44bb-b308-5abaf2238459 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:24:44.015212 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-44a21efe-43ea-44bb-b308-5abaf2238459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:44.128205 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:44.166090 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a21efe-43ea-44bb-b308-5abaf2238459 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:24:44.281539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59848f05-0281-4235-b5f8-4da2e2a852a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:24:44.282063 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59848f05-0281-4235-b5f8-4da2e2a852a7 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:44.282340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59848f05-0281-4235-b5f8-4da2e2a852a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:44.282613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59848f05-0281-4235-b5f8-4da2e2a852a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:44.284212 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-59848f05-0281-4235-b5f8-4da2e2a852a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:44.366816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:44.381223 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59848f05-0281-4235-b5f8-4da2e2a852a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:24:44.382835 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59848f05-0281-4235-b5f8-4da2e2a852a7 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:24:44.401608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 707/1425] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:24:45.291041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3882c5-bf37-4aa6-8d37-c2daf8791247 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:45.291632 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3882c5-bf37-4aa6-8d37-c2daf8791247 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:45.291632 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3882c5-bf37-4aa6-8d37-c2daf8791247 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:45.292891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:24:45.297851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf08c67-a4e9-4842-8efa-2d8b2a13ec6c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:45.298290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf08c67-a4e9-4842-8efa-2d8b2a13ec6c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:45.298436 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf08c67-a4e9-4842-8efa-2d8b2a13ec6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:45.376115 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-edf08c67-a4e9-4842-8efa-2d8b2a13ec6c None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:45.377383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-edf08c67-a4e9-4842-8efa-2d8b2a13ec6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:45.477723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:24:45.636754 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3882c5-bf37-4aa6-8d37-c2daf8791247 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:24:45.638366 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cd3882c5-bf37-4aa6-8d37-c2daf8791247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:45.724995 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:45.790417 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3882c5-bf37-4aa6-8d37-c2daf8791247 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:24:45.917451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b84a47-7d23-4356-a647-1ffc5899c73a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:24:45.918427 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b84a47-7d23-4356-a647-1ffc5899c73a service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:45.918936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b84a47-7d23-4356-a647-1ffc5899c73a service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:45.919235 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b84a47-7d23-4356-a647-1ffc5899c73a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:45.920911 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b3b84a47-7d23-4356-a647-1ffc5899c73a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:45.975465 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:46.025206 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b84a47-7d23-4356-a647-1ffc5899c73a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:24:46.026834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b84a47-7d23-4356-a647-1ffc5899c73a service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:24:46.051631 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 720/1428] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:24:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:24:46.951283 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39efd94-f858-43d8-8105-73e91b55e60e None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:46.952126 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39efd94-f858-43d8-8105-73e91b55e60e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:46.952613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39efd94-f858-43d8-8105-73e91b55e60e None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:46.954031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:24:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:24:46.959352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f55ff0-8beb-4653-a2a3-e3b04debf8f0 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:46.959794 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f55ff0-8beb-4653-a2a3-e3b04debf8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:46.959899 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f55ff0-8beb-4653-a2a3-e3b04debf8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:47.049222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b2f55ff0-8beb-4653-a2a3-e3b04debf8f0 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:47.051210 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b2f55ff0-8beb-4653-a2a3-e3b04debf8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:47.153177 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:24:47.313945 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39efd94-f858-43d8-8105-73e91b55e60e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:24:47.315514 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f39efd94-f858-43d8-8105-73e91b55e60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:47.382922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:47.484390 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39efd94-f858-43d8-8105-73e91b55e60e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:24:47.605045 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d61df6-5b3a-4f4a-8bab-820807bccb60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:24:47.605654 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d61df6-5b3a-4f4a-8bab-820807bccb60 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:47.605933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d61df6-5b3a-4f4a-8bab-820807bccb60 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:47.606206 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d61df6-5b3a-4f4a-8bab-820807bccb60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:47.607807 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-30d61df6-5b3a-4f4a-8bab-820807bccb60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:47.615191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:47.702286 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d61df6-5b3a-4f4a-8bab-820807bccb60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:24:47.704061 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d61df6-5b3a-4f4a-8bab-820807bccb60 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:24:47.725676 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 710/1431] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:24:48.549715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce22382-4fff-4692-8a51-8e3d992d98b3 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:48.550129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce22382-4fff-4692-8a51-8e3d992d98b3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:48.550242 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce22382-4fff-4692-8a51-8e3d992d98b3 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:48.552587 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:24:48.557618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862ae3c-3a61-4879-a205-3d1995016749 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:48.558076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862ae3c-3a61-4879-a205-3d1995016749 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:48.558174 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862ae3c-3a61-4879-a205-3d1995016749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:48.639580 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e862ae3c-3a61-4879-a205-3d1995016749 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:48.640830 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e862ae3c-3a61-4879-a205-3d1995016749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:48.709615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:48.739811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:24:48.893837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce22382-4fff-4692-8a51-8e3d992d98b3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:24:48.895492 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7ce22382-4fff-4692-8a51-8e3d992d98b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:48.913604 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:49.042768 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce22382-4fff-4692-8a51-8e3d992d98b3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:24:49.131039 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:49.157210 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a08bd-30f4-4d4c-9da9-dfc3fff3d089 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:24:49.157824 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a08bd-30f4-4d4c-9da9-dfc3fff3d089 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:49.158107 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a08bd-30f4-4d4c-9da9-dfc3fff3d089 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:49.158384 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a08bd-30f4-4d4c-9da9-dfc3fff3d089 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:49.160596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-091a08bd-30f4-4d4c-9da9-dfc3fff3d089 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:49.249556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a08bd-30f4-4d4c-9da9-dfc3fff3d089 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:24:49.251424 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a08bd-30f4-4d4c-9da9-dfc3fff3d089 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:24:49.270333 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 723/1434] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:24:50.091913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0f13c-6fff-46db-af0c-419dee563779 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:50.092380 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0f13c-6fff-46db-af0c-419dee563779 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:50.092503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0f13c-6fff-46db-af0c-419dee563779 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:50.093930 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:24:50.099169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da6f00-e45b-4bc0-8569-ab7cbf013a6b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:50.099590 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da6f00-e45b-4bc0-8569-ab7cbf013a6b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:50.099712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da6f00-e45b-4bc0-8569-ab7cbf013a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:50.174886 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f7da6f00-e45b-4bc0-8569-ab7cbf013a6b None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:50.176828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f7da6f00-e45b-4bc0-8569-ab7cbf013a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:50.217926 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:50.274787 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:24:50.425519 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0f13c-6fff-46db-af0c-419dee563779 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:24:50.427812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-37c0f13c-6fff-46db-af0c-419dee563779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:50.575008 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0f13c-6fff-46db-af0c-419dee563779 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:24:50.629778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:50.689802 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda6d08-f2d7-4d9e-b1ec-57571f8fdf2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:24:50.690419 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda6d08-f2d7-4d9e-b1ec-57571f8fdf2b service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:50.690702 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda6d08-f2d7-4d9e-b1ec-57571f8fdf2b service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:50.690977 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda6d08-f2d7-4d9e-b1ec-57571f8fdf2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:50.692817 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5cda6d08-f2d7-4d9e-b1ec-57571f8fdf2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:50.783214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda6d08-f2d7-4d9e-b1ec-57571f8fdf2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:24:50.784839 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda6d08-f2d7-4d9e-b1ec-57571f8fdf2b service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:24:50.803506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 713/1437] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:24:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:24:51.618000 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b26fd-3a77-471c-84ef-4fe92d9f9061 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:51.618549 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b26fd-3a77-471c-84ef-4fe92d9f9061 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:51.618679 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b26fd-3a77-471c-84ef-4fe92d9f9061 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:51.619914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:24:51.624918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0aafa-9361-497d-9392-b559af4be9c3 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:51.625408 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0aafa-9361-497d-9392-b559af4be9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:51.625505 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0aafa-9361-497d-9392-b559af4be9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:51.701782 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-13b0aafa-9361-497d-9392-b559af4be9c3 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:51.703262 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-13b0aafa-9361-497d-9392-b559af4be9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:51.705356 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:51.802892 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:24:51.953479 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b26fd-3a77-471c-84ef-4fe92d9f9061 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:24:51.954921 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c70b26fd-3a77-471c-84ef-4fe92d9f9061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:52.101507 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b26fd-3a77-471c-84ef-4fe92d9f9061 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:24:52.128922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:52.221889 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505d4a0-c720-4b47-bf61-cc7f4fffbc81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:24:52.222447 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505d4a0-c720-4b47-bf61-cc7f4fffbc81 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:52.223449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505d4a0-c720-4b47-bf61-cc7f4fffbc81 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:52.223834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505d4a0-c720-4b47-bf61-cc7f4fffbc81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:52.225775 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b505d4a0-c720-4b47-bf61-cc7f4fffbc81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:52.317504 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505d4a0-c720-4b47-bf61-cc7f4fffbc81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:24:52.319105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b505d4a0-c720-4b47-bf61-cc7f4fffbc81 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:24:52.338598 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 726/1440] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:24:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:24:54.169646 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f8596-50c6-47ed-a282-ba5db35b25ef None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:54.170180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f8596-50c6-47ed-a282-ba5db35b25ef None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:54.170180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f8596-50c6-47ed-a282-ba5db35b25ef None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:54.171562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:24:54.177393 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a9f82-5f2f-49db-942b-6682a8839105 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:54.177837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a9f82-5f2f-49db-942b-6682a8839105 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:54.177956 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a9f82-5f2f-49db-942b-6682a8839105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:54.219757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:54.244970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-346a9f82-5f2f-49db-942b-6682a8839105 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:54.246193 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-346a9f82-5f2f-49db-942b-6682a8839105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:54.344080 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:24:54.636238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f8596-50c6-47ed-a282-ba5db35b25ef None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:24:54.637854 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-837f8596-50c6-47ed-a282-ba5db35b25ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:54.741434 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f8596-50c6-47ed-a282-ba5db35b25ef None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:24:54.773109 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:54.816051 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fdabb-f966-429b-9cbc-958118d38d9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:24:54.816755 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fdabb-f966-429b-9cbc-958118d38d9a service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:54.817040 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fdabb-f966-429b-9cbc-958118d38d9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:54.817314 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fdabb-f966-429b-9cbc-958118d38d9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:54.818919 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-080fdabb-f966-429b-9cbc-958118d38d9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:54.936081 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fdabb-f966-429b-9cbc-958118d38d9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:24:54.937459 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fdabb-f966-429b-9cbc-958118d38d9a service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:24:54.955834 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 716/1443] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:24:57.028742 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0644283-a8e2-4967-ad62-8ea17808ac78 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:57.029295 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0644283-a8e2-4967-ad62-8ea17808ac78 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:57.029295 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0644283-a8e2-4967-ad62-8ea17808ac78 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:57.030672 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:24:57.036642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6276d-e71c-4cc1-8de8-86286c29694c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:57.037075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6276d-e71c-4cc1-8de8-86286c29694c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:57.037243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6276d-e71c-4cc1-8de8-86286c29694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:57.103801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-0ab6276d-e71c-4cc1-8de8-86286c29694c None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:24:57.104986 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0ab6276d-e71c-4cc1-8de8-86286c29694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:57.118480 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:57.203842 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:24:57.496591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0644283-a8e2-4967-ad62-8ea17808ac78 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:24:57.498178 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c0644283-a8e2-4967-ad62-8ea17808ac78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:57.603452 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0644283-a8e2-4967-ad62-8ea17808ac78 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:24:57.615593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:24:57.677072 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05b2c5-3f01-402c-836e-7065bb5f599c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:24:57.677680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05b2c5-3f01-402c-836e-7065bb5f599c service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:24:57.677963 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05b2c5-3f01-402c-836e-7065bb5f599c service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:24:57.678237 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05b2c5-3f01-402c-836e-7065bb5f599c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:24:57.679839 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4c05b2c5-3f01-402c-836e-7065bb5f599c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:24:57.793870 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05b2c5-3f01-402c-836e-7065bb5f599c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:24:57.795320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05b2c5-3f01-402c-836e-7065bb5f599c service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:24:57.813739 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 729/1446] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:25:00.035155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b15f5-93aa-4dd2-a9dd-7113a9cdb313 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:00.035705 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b15f5-93aa-4dd2-a9dd-7113a9cdb313 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:00.035705 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b15f5-93aa-4dd2-a9dd-7113a9cdb313 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:00.037010 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:25:00.042826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643e763-a785-4c86-8025-a088b78e8efe None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:00.043239 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643e763-a785-4c86-8025-a088b78e8efe None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:00.043381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643e763-a785-4c86-8025-a088b78e8efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:00.092516 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:00.110533 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8643e763-a785-4c86-8025-a088b78e8efe None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:25:00.111760 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8643e763-a785-4c86-8025-a088b78e8efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:00.208978 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:25:00.498308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b15f5-93aa-4dd2-a9dd-7113a9cdb313 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:25:00.500124 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ba1b15f5-93aa-4dd2-a9dd-7113a9cdb313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:00.605517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b15f5-93aa-4dd2-a9dd-7113a9cdb313 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:25:00.651267 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:00.686844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e20f3e-7b91-45b3-96ef-8edb02513aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:25:00.687453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e20f3e-7b91-45b3-96ef-8edb02513aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:00.687739 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e20f3e-7b91-45b3-96ef-8edb02513aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:00.688016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e20f3e-7b91-45b3-96ef-8edb02513aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:00.689670 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c6e20f3e-7b91-45b3-96ef-8edb02513aa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:00.798821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e20f3e-7b91-45b3-96ef-8edb02513aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:25:00.800194 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e20f3e-7b91-45b3-96ef-8edb02513aa5 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:25:00.818907 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 719/1449] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:25:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:25:02.881062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe2341-5072-4773-915c-43c9a7db3a65 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:02.881595 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe2341-5072-4773-915c-43c9a7db3a65 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:02.881595 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe2341-5072-4773-915c-43c9a7db3a65 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:02.882966 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:25:02.888368 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a30a14-56c8-4560-9a02-83c105dbe7d3 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:02.888858 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a30a14-56c8-4560-9a02-83c105dbe7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:02.888966 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a30a14-56c8-4560-9a02-83c105dbe7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:02.956567 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-c4a30a14-56c8-4560-9a02-83c105dbe7d3 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:25:02.957892 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c4a30a14-56c8-4560-9a02-83c105dbe7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:02.979099 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:03.056857 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:25:03.340527 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe2341-5072-4773-915c-43c9a7db3a65 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:25:03.342111 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9bbe2341-5072-4773-915c-43c9a7db3a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:03.447064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe2341-5072-4773-915c-43c9a7db3a65 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:25:03.471235 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:03.526265 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ba2b5-24cb-4014-bd6c-9c32f470d4ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:25:03.526870 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ba2b5-24cb-4014-bd6c-9c32f470d4ab service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:03.527151 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ba2b5-24cb-4014-bd6c-9c32f470d4ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:03.527425 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ba2b5-24cb-4014-bd6c-9c32f470d4ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:03.529047 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-096ba2b5-24cb-4014-bd6c-9c32f470d4ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:03.637385 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ba2b5-24cb-4014-bd6c-9c32f470d4ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:25:03.638775 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ba2b5-24cb-4014-bd6c-9c32f470d4ab service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:25:03.657502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 732/1452] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:25:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:25:05.642374 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2f6be-1617-4c31-9754-1528d9b44fa3 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:05.642951 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2f6be-1617-4c31-9754-1528d9b44fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:05.642951 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2f6be-1617-4c31-9754-1528d9b44fa3 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:05.644281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:25:05.650290 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88df90-94df-413f-8f27-d89963a0cf88 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:05.650724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88df90-94df-413f-8f27-d89963a0cf88 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:05.650859 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88df90-94df-413f-8f27-d89963a0cf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:05.714723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:05.717811 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3c88df90-94df-413f-8f27-d89963a0cf88 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:25:05.719384 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3c88df90-94df-413f-8f27-d89963a0cf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:05.817057 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:25:06.099737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2f6be-1617-4c31-9754-1528d9b44fa3 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:25:06.101338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-aed2f6be-1617-4c31-9754-1528d9b44fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:06.209942 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2f6be-1617-4c31-9754-1528d9b44fa3 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:25:06.259202 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:06.284148 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794790f-a6ca-40b9-9371-21b1e578e8a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:25:06.284776 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794790f-a6ca-40b9-9371-21b1e578e8a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:06.285064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794790f-a6ca-40b9-9371-21b1e578e8a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:06.285323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794790f-a6ca-40b9-9371-21b1e578e8a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:06.287557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1794790f-a6ca-40b9-9371-21b1e578e8a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:06.404318 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794790f-a6ca-40b9-9371-21b1e578e8a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:25:06.405683 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794790f-a6ca-40b9-9371-21b1e578e8a5 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:25:06.423921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 722/1455] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:25:08.389995 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d84ef-a273-4fdc-a6cb-a2676ab89bed None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:08.390575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d84ef-a273-4fdc-a6cb-a2676ab89bed None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:08.390575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d84ef-a273-4fdc-a6cb-a2676ab89bed None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:08.391963 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:25:08.397894 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae676ee-7d9a-42e6-b283-32f7d365cc35 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:08.398330 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae676ee-7d9a-42e6-b283-32f7d365cc35 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:08.398478 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae676ee-7d9a-42e6-b283-32f7d365cc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:08.465098 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-eae676ee-7d9a-42e6-b283-32f7d365cc35 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:25:08.466321 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-eae676ee-7d9a-42e6-b283-32f7d365cc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:08.496525 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:08.565738 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:25:08.862872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d84ef-a273-4fdc-a6cb-a2676ab89bed None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:25:08.864747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2d5d84ef-a273-4fdc-a6cb-a2676ab89bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:08.968757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d84ef-a273-4fdc-a6cb-a2676ab89bed None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:25:08.997377 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:09.046590 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1dbbec-5928-4663-98e9-beaf71584bc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:25:09.047203 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dbbec-5928-4663-98e9-beaf71584bc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:09.047488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dbbec-5928-4663-98e9-beaf71584bc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:09.047765 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dbbec-5928-4663-98e9-beaf71584bc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:09.049392 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2e1dbbec-5928-4663-98e9-beaf71584bc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:09.158259 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1dbbec-5928-4663-98e9-beaf71584bc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:25:09.159697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1dbbec-5928-4663-98e9-beaf71584bc1 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:25:09.178310 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 735/1458] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:25:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:25:11.132986 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa46f90-6619-4a50-ad43-6396d6c1ce2d None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:11.133516 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa46f90-6619-4a50-ad43-6396d6c1ce2d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:11.133516 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa46f90-6619-4a50-ad43-6396d6c1ce2d None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:11.134880 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:25:11.140575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9f2e0-9453-40b7-beb3-93574b87e0a8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:11.141028 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9f2e0-9453-40b7-beb3-93574b87e0a8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:11.141141 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9f2e0-9453-40b7-beb3-93574b87e0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:11.212174 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-dae9f2e0-9453-40b7-beb3-93574b87e0a8 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:25:11.213609 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-dae9f2e0-9453-40b7-beb3-93574b87e0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:11.223226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:11.320947 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:25:11.618670 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa46f90-6619-4a50-ad43-6396d6c1ce2d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:25:11.620222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2aa46f90-6619-4a50-ad43-6396d6c1ce2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:11.725394 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa46f90-6619-4a50-ad43-6396d6c1ce2d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:25:11.781173 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:11.800442 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ca999-82b9-47df-9034-a3fe7a368b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:25:11.801091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ca999-82b9-47df-9034-a3fe7a368b66 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:11.801376 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ca999-82b9-47df-9034-a3fe7a368b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:11.802321 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ca999-82b9-47df-9034-a3fe7a368b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:11.803952 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e98ca999-82b9-47df-9034-a3fe7a368b66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:11.914730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ca999-82b9-47df-9034-a3fe7a368b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:25:11.916105 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ca999-82b9-47df-9034-a3fe7a368b66 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:25:11.934940 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 725/1461] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:25:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:25:14.002939 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48893a1a-3ceb-4b9d-8307-9f3b14086889 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:14.003522 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48893a1a-3ceb-4b9d-8307-9f3b14086889 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:14.003522 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48893a1a-3ceb-4b9d-8307-9f3b14086889 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:14.005364 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:25:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:25:14.010718 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea7bfa-3cf2-489e-9dc0-8f97d97e145c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:14.011157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea7bfa-3cf2-489e-9dc0-8f97d97e145c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:14.011267 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea7bfa-3cf2-489e-9dc0-8f97d97e145c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:14.080846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9cea7bfa-3cf2-489e-9dc0-8f97d97e145c None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:25:14.082272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9cea7bfa-3cf2-489e-9dc0-8f97d97e145c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:14.128056 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:14.188367 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:25:14.474977 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48893a1a-3ceb-4b9d-8307-9f3b14086889 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:25:14.476568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-48893a1a-3ceb-4b9d-8307-9f3b14086889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:14.580792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48893a1a-3ceb-4b9d-8307-9f3b14086889 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:25:14.620179 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:14.656671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411cc951-0987-4450-a865-51a148351947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:25:14.657306 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cc951-0987-4450-a865-51a148351947 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:14.657589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cc951-0987-4450-a865-51a148351947 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:14.657869 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cc951-0987-4450-a865-51a148351947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:14.659470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-411cc951-0987-4450-a865-51a148351947 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:14.769830 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411cc951-0987-4450-a865-51a148351947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:25:14.771222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411cc951-0987-4450-a865-51a148351947 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:25:14.789581 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 738/1464] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:25:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:25:16.736805 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74ffbd-136a-41c7-aa48-033f04d90941 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:16.737369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74ffbd-136a-41c7-aa48-033f04d90941 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:16.737369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74ffbd-136a-41c7-aa48-033f04d90941 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:16.738701 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:25:16.744581 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17399f-90e0-413c-8ec8-4a54c890b7d3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:16.745074 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17399f-90e0-413c-8ec8-4a54c890b7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:16.745223 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17399f-90e0-413c-8ec8-4a54c890b7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:16.819100 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ca17399f-90e0-413c-8ec8-4a54c890b7d3 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:25:16.820320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ca17399f-90e0-413c-8ec8-4a54c890b7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:16.840373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:16.918673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:25:17.207149 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74ffbd-136a-41c7-aa48-033f04d90941 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:25:17.209282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6d74ffbd-136a-41c7-aa48-033f04d90941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:17.315749 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74ffbd-136a-41c7-aa48-033f04d90941 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:25:17.383006 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:17.390381 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5f3d3-c85b-4f9c-bcef-59a8210d4b93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:25:17.390990 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5f3d3-c85b-4f9c-bcef-59a8210d4b93 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:17.391277 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5f3d3-c85b-4f9c-bcef-59a8210d4b93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:17.391554 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5f3d3-c85b-4f9c-bcef-59a8210d4b93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:17.393195 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-76b5f3d3-c85b-4f9c-bcef-59a8210d4b93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:17.503361 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5f3d3-c85b-4f9c-bcef-59a8210d4b93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:25:17.504930 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5f3d3-c85b-4f9c-bcef-59a8210d4b93 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:25:17.532885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 728/1467] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:25:19.467710 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69469274-0b29-433a-8dd9-f21c08ca2599 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:19.468281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69469274-0b29-433a-8dd9-f21c08ca2599 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:19.468281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69469274-0b29-433a-8dd9-f21c08ca2599 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:19.469681 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:25:19.475038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46722c29-935c-49f4-bd60-d174f292bdf3 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:19.475485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46722c29-935c-49f4-bd60-d174f292bdf3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:19.475609 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46722c29-935c-49f4-bd60-d174f292bdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:19.542763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-46722c29-935c-49f4-bd60-d174f292bdf3 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:25:19.543983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-46722c29-935c-49f4-bd60-d174f292bdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:19.593864 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:19.646102 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:25:19.930866 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69469274-0b29-433a-8dd9-f21c08ca2599 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:25:19.932417 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-69469274-0b29-433a-8dd9-f21c08ca2599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:20.039674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69469274-0b29-433a-8dd9-f21c08ca2599 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:25:20.090977 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:20.118177 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f2945-363e-4790-bd48-ce1d66ab3af4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:25:20.118789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f2945-363e-4790-bd48-ce1d66ab3af4 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:20.119069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f2945-363e-4790-bd48-ce1d66ab3af4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:20.119344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f2945-363e-4790-bd48-ce1d66ab3af4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:20.120976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-362f2945-363e-4790-bd48-ce1d66ab3af4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:20.231570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f2945-363e-4790-bd48-ce1d66ab3af4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:25:20.233041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f2945-363e-4790-bd48-ce1d66ab3af4 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:25:20.252055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 741/1470] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:25:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:25:29.644255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=22 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:30.249509 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=66 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:39.933988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b41228-cf8f-4e96-a305-9885ef6e9797 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:39.934543 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b41228-cf8f-4e96-a305-9885ef6e9797 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:39.934543 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b41228-cf8f-4e96-a305-9885ef6e9797 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:39.935888 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 730/1471] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:25:39.941251 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68af785-904d-417e-8478-ba4876e420f6 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:39.941653 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68af785-904d-417e-8478-ba4876e420f6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:39.941858 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68af785-904d-417e-8478-ba4876e420f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:40.008117 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f68af785-904d-417e-8478-ba4876e420f6 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:25:40.009356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f68af785-904d-417e-8478-ba4876e420f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:40.108279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 742/1472] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:25:40.408596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef934b-9962-482a-9311-02175781ab3a None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:40.408918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef934b-9962-482a-9311-02175781ab3a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:40.409201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef934b-9962-482a-9311-02175781ab3a None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:40.410627 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 731/1473] 10.222.0.96 () {54 vars in 967 bytes} [Wed Aug 24 04:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:25:40.415493 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fe65f-98a5-448d-a1b2-9026c8d15fae None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:40.415783 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fe65f-98a5-448d-a1b2-9026c8d15fae None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:40.416060 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fe65f-98a5-448d-a1b2-9026c8d15fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:40.492097 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8c6fe65f-98a5-448d-a1b2-9026c8d15fae None None] MFA Rules not processed for user `6106a46199b74f649cd29a0d02610049`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:25:40.493344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8c6fe65f-98a5-448d-a1b2-9026c8d15fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:40.514839 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:40.571334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 743/1474] 10.222.0.96 () {58 vars in 1064 bytes} [Wed Aug 24 04:25:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:25:40.579166 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef934b-9962-482a-9311-02175781ab3a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:25:40.580678 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-58ef934b-9962-482a-9311-02175781ab3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:40.683241 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef934b-9962-482a-9311-02175781ab3a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:25:40.759721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b111470-d7a0-448f-a716-53c28f24d865 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6106a46199b74f649cd29a0d02610049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:25:40.760332 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b111470-d7a0-448f-a716-53c28f24d865 service glance] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:40.760611 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b111470-d7a0-448f-a716-53c28f24d865 service glance] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:40.760918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b111470-d7a0-448f-a716-53c28f24d865 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:40.762527 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4b111470-d7a0-448f-a716-53c28f24d865 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:40.817286 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:40.874674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b111470-d7a0-448f-a716-53c28f24d865 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:25:40.876123 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b111470-d7a0-448f-a716-53c28f24d865 service glance] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:25:40.894680 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 732/1475] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:25:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:25:42.897457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04a632-1d95-401a-b662-a2a86ef309fc None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:42.898009 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04a632-1d95-401a-b662-a2a86ef309fc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:42.898009 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04a632-1d95-401a-b662-a2a86ef309fc None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:42.899361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 744/1476] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:25:42.904627 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24058a08-46c1-434a-82fd-ec90459286f7 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:42.905057 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24058a08-46c1-434a-82fd-ec90459286f7 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:42.905215 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24058a08-46c1-434a-82fd-ec90459286f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:42.971619 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-24058a08-46c1-434a-82fd-ec90459286f7 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:25:42.972879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-24058a08-46c1-434a-82fd-ec90459286f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:43.070272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 733/1477] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:25:43.343038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04a632-1d95-401a-b662-a2a86ef309fc None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:25:43.344596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9e04a632-1d95-401a-b662-a2a86ef309fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:43.471305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04a632-1d95-401a-b662-a2a86ef309fc None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:25:43.520382 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:43.565996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15055a-db32-4f36-a120-8b79dde24fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:25:43.566604 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15055a-db32-4f36-a120-8b79dde24fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:43.567439 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15055a-db32-4f36-a120-8b79dde24fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:43.567718 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15055a-db32-4f36-a120-8b79dde24fe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:43.568356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15055a-db32-4f36-a120-8b79dde24fe8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:25:43.570186 dv-cinder-854263-1-smb devstack@keystone.service[81517]: WARNING py.warnings [None req-2d15055a-db32-4f36-a120-8b79dde24fe8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:25:43.570186 dv-cinder-854263-1-smb devstack@keystone.service[81517]: warnings.warn(msg) Aug 24 04:25:43.570186 dv-cinder-854263-1-smb devstack@keystone.service[81517]: Aug 24 04:25:43.571322 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15055a-db32-4f36-a120-8b79dde24fe8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:25:43.590368 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 745/1478] 10.222.0.96 () {56 vars in 1108 bytes} [Wed Aug 24 04:25:43 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:25:45.553638 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fe012-316f-4bda-8778-23b20301534d None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:45.554235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fe012-316f-4bda-8778-23b20301534d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:45.554235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fe012-316f-4bda-8778-23b20301534d None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:45.555549 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 734/1479] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:25:45.561627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb2681-9f6f-4ada-8e8e-44e20e3623ed None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:45.562073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb2681-9f6f-4ada-8e8e-44e20e3623ed None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:45.562179 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb2681-9f6f-4ada-8e8e-44e20e3623ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:45.631643 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-79fb2681-9f6f-4ada-8e8e-44e20e3623ed None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:25:45.632901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-79fb2681-9f6f-4ada-8e8e-44e20e3623ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:45.729445 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 746/1480] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:25:46.067227 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fe012-316f-4bda-8778-23b20301534d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:25:46.069009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f03fe012-316f-4bda-8778-23b20301534d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:46.081078 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:46.249527 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fe012-316f-4bda-8778-23b20301534d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:25:46.351717 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:46.393185 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f46e1a-b639-4918-84cd-dfea47765130 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:25:46.395883 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f46e1a-b639-4918-84cd-dfea47765130 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:46.396165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f46e1a-b639-4918-84cd-dfea47765130 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:46.397448 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f46e1a-b639-4918-84cd-dfea47765130 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:46.403529 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-01f46e1a-b639-4918-84cd-dfea47765130 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:46.524810 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f46e1a-b639-4918-84cd-dfea47765130 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:25:46.526419 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f46e1a-b639-4918-84cd-dfea47765130 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:25:46.550245 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 735/1481] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:25:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:25:48.730562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd0e12-3b55-4711-87b1-40f2bc0d6b93 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:48.731148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd0e12-3b55-4711-87b1-40f2bc0d6b93 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:48.731148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd0e12-3b55-4711-87b1-40f2bc0d6b93 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:48.732463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 747/1482] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:25:48.737905 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dd2c0-6089-4c45-8862-1b5d54dca58f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:48.738366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dd2c0-6089-4c45-8862-1b5d54dca58f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:48.739013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17dd2c0-6089-4c45-8862-1b5d54dca58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:48.806372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-b17dd2c0-6089-4c45-8862-1b5d54dca58f None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:25:48.807512 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b17dd2c0-6089-4c45-8862-1b5d54dca58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:48.856266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:48.909002 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 736/1483] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:25:49.197246 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd0e12-3b55-4711-87b1-40f2bc0d6b93 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:25:49.198793 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6bcd0e12-3b55-4711-87b1-40f2bc0d6b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:49.225087 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:49.308489 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd0e12-3b55-4711-87b1-40f2bc0d6b93 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:25:49.382646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff4377-517e-4519-b293-85db28846f6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:25:49.383262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff4377-517e-4519-b293-85db28846f6b service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:49.383549 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff4377-517e-4519-b293-85db28846f6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:49.383823 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff4377-517e-4519-b293-85db28846f6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:49.385472 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-77ff4377-517e-4519-b293-85db28846f6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:49.462340 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:49.498243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff4377-517e-4519-b293-85db28846f6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:25:49.499683 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff4377-517e-4519-b293-85db28846f6b service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:25:49.518097 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 748/1484] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:25:51.460377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237926bf-7e3c-4029-94db-61b1ffdc2a29 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:51.460970 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237926bf-7e3c-4029-94db-61b1ffdc2a29 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:51.461077 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237926bf-7e3c-4029-94db-61b1ffdc2a29 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:51.462361 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 737/1485] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:25:51.467851 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3192d-8632-41df-b701-e6cc1316cbe9 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:51.468283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3192d-8632-41df-b701-e6cc1316cbe9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:51.468391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3192d-8632-41df-b701-e6cc1316cbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:51.533670 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e1a3192d-8632-41df-b701-e6cc1316cbe9 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:25:51.534882 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e1a3192d-8632-41df-b701-e6cc1316cbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:51.631525 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 749/1486] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:25:51.918825 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237926bf-7e3c-4029-94db-61b1ffdc2a29 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:25:51.920400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-237926bf-7e3c-4029-94db-61b1ffdc2a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:52.039276 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237926bf-7e3c-4029-94db-61b1ffdc2a29 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:25:52.112618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:52.115193 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51fc0e-87e1-4d46-aab7-0705a70ab68b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:25:52.116007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51fc0e-87e1-4d46-aab7-0705a70ab68b service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:52.116498 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51fc0e-87e1-4d46-aab7-0705a70ab68b service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:52.117030 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51fc0e-87e1-4d46-aab7-0705a70ab68b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:52.118777 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ec51fc0e-87e1-4d46-aab7-0705a70ab68b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:52.231411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51fc0e-87e1-4d46-aab7-0705a70ab68b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:25:52.232877 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51fc0e-87e1-4d46-aab7-0705a70ab68b service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:25:52.251584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 738/1487] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:25:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:25:54.369332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806bdb0-3735-4048-9cfb-3ef427ef7824 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:54.369908 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806bdb0-3735-4048-9cfb-3ef427ef7824 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:54.369908 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806bdb0-3735-4048-9cfb-3ef427ef7824 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:54.371227 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 750/1488] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:25:54.376552 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34914c23-a567-4bbd-997f-f156884f50d9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:54.376958 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34914c23-a567-4bbd-997f-f156884f50d9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:54.377213 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34914c23-a567-4bbd-997f-f156884f50d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:54.445087 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-34914c23-a567-4bbd-997f-f156884f50d9 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:25:54.446313 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-34914c23-a567-4bbd-997f-f156884f50d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:54.500581 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:54.545875 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 739/1489] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:25:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:25:54.838435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806bdb0-3735-4048-9cfb-3ef427ef7824 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:25:54.839998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e806bdb0-3735-4048-9cfb-3ef427ef7824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:54.875669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:54.948051 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806bdb0-3735-4048-9cfb-3ef427ef7824 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:25:55.021106 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6bf01-8df5-4ceb-8ee1-5a2e3381903e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:25:55.021706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6bf01-8df5-4ceb-8ee1-5a2e3381903e service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:55.021983 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6bf01-8df5-4ceb-8ee1-5a2e3381903e service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:55.022256 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6bf01-8df5-4ceb-8ee1-5a2e3381903e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:55.023832 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-20d6bf01-8df5-4ceb-8ee1-5a2e3381903e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:55.105457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:55.136552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6bf01-8df5-4ceb-8ee1-5a2e3381903e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:25:55.138029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6bf01-8df5-4ceb-8ee1-5a2e3381903e service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:25:55.156540 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 751/1490] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:25:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:25:57.307876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72607536-1b62-4231-abe7-afdb64a5dfcb None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:57.308401 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72607536-1b62-4231-abe7-afdb64a5dfcb None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:57.308401 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72607536-1b62-4231-abe7-afdb64a5dfcb None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:57.309740 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 740/1491] 10.222.0.96 () {54 vars in 927 bytes} [Wed Aug 24 04:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:25:57.314965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2a6d5-e157-4024-a2cc-80b297f47a49 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:57.315395 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2a6d5-e157-4024-a2cc-80b297f47a49 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:57.315510 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2a6d5-e157-4024-a2cc-80b297f47a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:57.381774 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-64e2a6d5-e157-4024-a2cc-80b297f47a49 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:25:57.383014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-64e2a6d5-e157-4024-a2cc-80b297f47a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:57.481702 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 752/1492] 10.222.0.96 () {58 vars in 1024 bytes} [Wed Aug 24 04:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:25:57.776752 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72607536-1b62-4231-abe7-afdb64a5dfcb None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:25:57.778431 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-72607536-1b62-4231-abe7-afdb64a5dfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:57.886045 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72607536-1b62-4231-abe7-afdb64a5dfcb None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:25:57.959743 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58f40a-870d-4464-a1ce-ebefb56fd638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:25:57.960348 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58f40a-870d-4464-a1ce-ebefb56fd638 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:25:57.960629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58f40a-870d-4464-a1ce-ebefb56fd638 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:25:57.960928 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58f40a-870d-4464-a1ce-ebefb56fd638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:25:57.962520 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ef58f40a-870d-4464-a1ce-ebefb56fd638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:25:57.971630 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:25:58.079170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58f40a-870d-4464-a1ce-ebefb56fd638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:25:58.080622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58f40a-870d-4464-a1ce-ebefb56fd638 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:25:58.099011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 741/1493] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:25:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:26:07.479896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=82 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:26:08.096183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=50 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:27:21.468469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbe964-b5f9-433a-a830-4789b4ba24ae None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:27:21.469115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbe964-b5f9-433a-a830-4789b4ba24ae None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:27:21.469115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbe964-b5f9-433a-a830-4789b4ba24ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:27:21.545162 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5cdbe964-b5f9-433a-a830-4789b4ba24ae None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:27:21.546398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5cdbe964-b5f9-433a-a830-4789b4ba24ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:27:21.646234 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 753/1494] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:27:21.654516 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b191cf-59a9-45c5-a004-5e0390eb5976 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:27:21.655041 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b191cf-59a9-45c5-a004-5e0390eb5976 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:27:21.655153 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b191cf-59a9-45c5-a004-5e0390eb5976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:27:21.861672 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-54b191cf-59a9-45c5-a004-5e0390eb5976 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:27:21.862886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-54b191cf-59a9-45c5-a004-5e0390eb5976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:27:21.962604 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 742/1495] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:27:21.967679 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbe964-b5f9-433a-a830-4789b4ba24ae None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:27:21.968941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5cdbe964-b5f9-433a-a830-4789b4ba24ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:27:21.981143 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbe964-b5f9-433a-a830-4789b4ba24ae None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:27:22.043323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:27:22.078619 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65080803-a41d-47c4-a5ea-39f2cb312f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:27:22.079151 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65080803-a41d-47c4-a5ea-39f2cb312f71 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:27:22.079431 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65080803-a41d-47c4-a5ea-39f2cb312f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:27:22.079705 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65080803-a41d-47c4-a5ea-39f2cb312f71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:27:22.080612 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65080803-a41d-47c4-a5ea-39f2cb312f71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:27:22.080950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65080803-a41d-47c4-a5ea-39f2cb312f71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:27:22.081970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: WARNING py.warnings [None req-65080803-a41d-47c4-a5ea-39f2cb312f71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:27:22.081970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: warnings.warn(msg) Aug 24 04:27:22.081970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: Aug 24 04:27:22.083424 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65080803-a41d-47c4-a5ea-39f2cb312f71 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:27:22.094733 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 754/1496] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:27:22.103592 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b191cf-59a9-45c5-a004-5e0390eb5976 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:27:22.113347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b191cf-59a9-45c5-a004-5e0390eb5976 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:27:22.175263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:27:22.210419 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c18d32-0ff4-481d-8ee1-feafb753b613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:27:22.211026 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c18d32-0ff4-481d-8ee1-feafb753b613 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:27:22.211307 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c18d32-0ff4-481d-8ee1-feafb753b613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:27:22.211577 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c18d32-0ff4-481d-8ee1-feafb753b613 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:27:22.212206 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c18d32-0ff4-481d-8ee1-feafb753b613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:27:22.213934 dv-cinder-854263-1-smb devstack@keystone.service[81516]: WARNING py.warnings [None req-35c18d32-0ff4-481d-8ee1-feafb753b613 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:27:22.213934 dv-cinder-854263-1-smb devstack@keystone.service[81516]: warnings.warn(msg) Aug 24 04:27:22.213934 dv-cinder-854263-1-smb devstack@keystone.service[81516]: Aug 24 04:27:22.215187 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c18d32-0ff4-481d-8ee1-feafb753b613 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:27:22.271448 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 743/1497] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:27:22 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:27:22.275690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65080803-a41d-47c4-a5ea-39f2cb312f71 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:27:22.277269 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-65080803-a41d-47c4-a5ea-39f2cb312f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:27:22.310809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65080803-a41d-47c4-a5ea-39f2cb312f71 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:27:22.405729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ef17f-7033-4e96-89bb-d305946deb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:27:22.406266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ef17f-7033-4e96-89bb-d305946deb82 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:27:22.406560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ef17f-7033-4e96-89bb-d305946deb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:27:22.406871 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ef17f-7033-4e96-89bb-d305946deb82 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:27:22.407544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ef17f-7033-4e96-89bb-d305946deb82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:27:22.408560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: WARNING py.warnings [None req-258ef17f-7033-4e96-89bb-d305946deb82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:27:22.408560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: warnings.warn(msg) Aug 24 04:27:22.408560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: Aug 24 04:27:22.409830 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ef17f-7033-4e96-89bb-d305946deb82 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:27:22.453605 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 755/1498] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:27:22 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:27:22.458038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c18d32-0ff4-481d-8ee1-feafb753b613 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:27:22.459574 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-35c18d32-0ff4-481d-8ee1-feafb753b613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:27:22.523307 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c18d32-0ff4-481d-8ee1-feafb753b613 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:27:22.609246 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:27:22.621684 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08301b41-06fc-49bf-9e9d-3608367b85b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:27:22.622305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08301b41-06fc-49bf-9e9d-3608367b85b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:27:22.622584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08301b41-06fc-49bf-9e9d-3608367b85b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:27:22.622856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08301b41-06fc-49bf-9e9d-3608367b85b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:27:22.623506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08301b41-06fc-49bf-9e9d-3608367b85b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:27:22.624556 dv-cinder-854263-1-smb devstack@keystone.service[81516]: WARNING py.warnings [None req-08301b41-06fc-49bf-9e9d-3608367b85b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:27:22.624556 dv-cinder-854263-1-smb devstack@keystone.service[81516]: warnings.warn(msg) Aug 24 04:27:22.624556 dv-cinder-854263-1-smb devstack@keystone.service[81516]: Aug 24 04:27:22.625489 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08301b41-06fc-49bf-9e9d-3608367b85b8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:27:22.640135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 744/1499] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:27:22.644315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ef17f-7033-4e96-89bb-d305946deb82 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:27:22.645926 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-258ef17f-7033-4e96-89bb-d305946deb82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:27:22.657647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ef17f-7033-4e96-89bb-d305946deb82 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:27:22.683221 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:27:22.757211 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc430dd-6965-44c2-bf34-de6d4e587aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:27:22.757819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc430dd-6965-44c2-bf34-de6d4e587aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:27:22.758096 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc430dd-6965-44c2-bf34-de6d4e587aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:27:22.758366 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc430dd-6965-44c2-bf34-de6d4e587aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:27:22.759012 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc430dd-6965-44c2-bf34-de6d4e587aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:27:22.760024 dv-cinder-854263-1-smb devstack@keystone.service[81517]: WARNING py.warnings [None req-cbc430dd-6965-44c2-bf34-de6d4e587aa5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:27:22.760024 dv-cinder-854263-1-smb devstack@keystone.service[81517]: warnings.warn(msg) Aug 24 04:27:22.760024 dv-cinder-854263-1-smb devstack@keystone.service[81517]: Aug 24 04:27:22.760968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc430dd-6965-44c2-bf34-de6d4e587aa5 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:27:22.773527 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 756/1500] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:27:22.777739 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08301b41-06fc-49bf-9e9d-3608367b85b8 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:27:22.779289 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-08301b41-06fc-49bf-9e9d-3608367b85b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:27:22.814064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08301b41-06fc-49bf-9e9d-3608367b85b8 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:27:22.932257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86fd57-67d8-4a51-b0ae-2956a8a9c23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:27:22.932874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86fd57-67d8-4a51-b0ae-2956a8a9c23d admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:27:22.933161 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86fd57-67d8-4a51-b0ae-2956a8a9c23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:27:22.933447 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86fd57-67d8-4a51-b0ae-2956a8a9c23d admin admin] PATH_INFO: `/v3/projects/b58d61a68b774a5fab64b684da2b4544/users/dd29ce9e2a294440975455a288b25f16/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:27:22.956457 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86fd57-67d8-4a51-b0ae-2956a8a9c23d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b58d61a68b774a5fab64b684da2b4544, user_id=dd29ce9e2a294440975455a288b25f16, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:27:22.957564 dv-cinder-854263-1-smb devstack@keystone.service[81516]: WARNING py.warnings [None req-fd86fd57-67d8-4a51-b0ae-2956a8a9c23d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:27:22.957564 dv-cinder-854263-1-smb devstack@keystone.service[81516]: warnings.warn(msg) Aug 24 04:27:22.957564 dv-cinder-854263-1-smb devstack@keystone.service[81516]: Aug 24 04:27:22.959508 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86fd57-67d8-4a51-b0ae-2956a8a9c23d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:27:22.985518 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 745/1501] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:27:22 2022] PUT /identity/v3/projects/b58d61a68b774a5fab64b684da2b4544/users/dd29ce9e2a294440975455a288b25f16/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:27:22.998595 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946b31a-6c64-4bc8-9ab0-8d92811b5da9 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:27:22.998907 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946b31a-6c64-4bc8-9ab0-8d92811b5da9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:27:22.999190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946b31a-6c64-4bc8-9ab0-8d92811b5da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:27:23.059059 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b946b31a-6c64-4bc8-9ab0-8d92811b5da9 None None] MFA Rules not processed for user `dd29ce9e2a294440975455a288b25f16`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:27:23.060335 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b946b31a-6c64-4bc8-9ab0-8d92811b5da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:27:23.142313 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 757/1502] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:27:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:27:23.156131 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3412056-ef89-49a4-bbd1-3d74f783c36f None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:27:23.156443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3412056-ef89-49a4-bbd1-3d74f783c36f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:27:23.156749 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3412056-ef89-49a4-bbd1-3d74f783c36f None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:27:23.158100 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 746/1503] 10.222.0.96 () {54 vars in 964 bytes} [Wed Aug 24 04:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:27:23.163916 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc9863-4415-4ee1-8e12-66bb91881970 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:27:23.164216 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc9863-4415-4ee1-8e12-66bb91881970 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:27:23.164498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc9863-4415-4ee1-8e12-66bb91881970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:27:23.196721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:27:23.243338 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f3fc9863-4415-4ee1-8e12-66bb91881970 None None] MFA Rules not processed for user `b182bf0bbbcf4a808626443c6c2a7a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:27:23.244578 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f3fc9863-4415-4ee1-8e12-66bb91881970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:27:23.324303 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 758/1504] 10.222.0.96 () {58 vars in 1061 bytes} [Wed Aug 24 04:27:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:27:23.332856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3412056-ef89-49a4-bbd1-3d74f783c36f None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:27:23.334428 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e3412056-ef89-49a4-bbd1-3d74f783c36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:27:23.385992 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:27:23.442060 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3412056-ef89-49a4-bbd1-3d74f783c36f None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:27:23.518862 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032b54c-3125-4262-835d-346e73a43520 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:27:23.519381 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032b54c-3125-4262-835d-346e73a43520 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:27:23.519662 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032b54c-3125-4262-835d-346e73a43520 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:27:23.520550 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032b54c-3125-4262-835d-346e73a43520 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:27:23.522337 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f032b54c-3125-4262-835d-346e73a43520 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:27:23.625777 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032b54c-3125-4262-835d-346e73a43520 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:27:23.627237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032b54c-3125-4262-835d-346e73a43520 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:27:23.631485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:27:23.647858 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 747/1505] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:27:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:27:23.693397 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4a15c-e6b5-45f2-8076-6becb6d854e3 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:27:23.693848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4a15c-e6b5-45f2-8076-6becb6d854e3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:27:23.693986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4a15c-e6b5-45f2-8076-6becb6d854e3 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:27:23.695420 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 759/1506] 10.222.0.96 () {52 vars in 830 bytes} [Wed Aug 24 04:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:27:23.699067 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032b54c-3125-4262-835d-346e73a43520 service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:27:23.700307 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f032b54c-3125-4262-835d-346e73a43520 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:27:23.803232 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032b54c-3125-4262-835d-346e73a43520 service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:27:23.899896 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817af3f-c229-4b97-aa20-ef7404da7f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:27:23.900529 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817af3f-c229-4b97-aa20-ef7404da7f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:27:23.900839 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817af3f-c229-4b97-aa20-ef7404da7f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:27:23.901115 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817af3f-c229-4b97-aa20-ef7404da7f21 admin admin] PATH_INFO: `/v3/users/dd29ce9e2a294440975455a288b25f16` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:27:23.913469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817af3f-c229-4b97-aa20-ef7404da7f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd29ce9e2a294440975455a288b25f16)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:27:23.914503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: WARNING py.warnings [None req-b817af3f-c229-4b97-aa20-ef7404da7f21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:27:23.914503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: warnings.warn(msg) Aug 24 04:27:23.914503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: Aug 24 04:27:23.915719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817af3f-c229-4b97-aa20-ef7404da7f21 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:27:23.925627 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:27:23.985451 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b817af3f-c229-4b97-aa20-ef7404da7f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd29ce9e2a294440975455a288b25f16'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:27:23.985895 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b817af3f-c229-4b97-aa20-ef7404da7f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd29ce9e2a294440975455a288b25f16'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:27:24.001216 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b817af3f-c229-4b97-aa20-ef7404da7f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd29ce9e2a294440975455a288b25f16'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:27:24.001801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b817af3f-c229-4b97-aa20-ef7404da7f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd29ce9e2a294440975455a288b25f16'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:27:24.012890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b817af3f-c229-4b97-aa20-ef7404da7f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd29ce9e2a294440975455a288b25f16'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:27:24.041487 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 748/1507] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:27:23 2022] DELETE /identity/v3/users/dd29ce9e2a294440975455a288b25f16 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:27:24.045893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee09bec-6aa8-444a-b765-34e72597705e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:27:24.046182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee09bec-6aa8-444a-b765-34e72597705e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:27:24.046464 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee09bec-6aa8-444a-b765-34e72597705e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:27:24.105075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8ee09bec-6aa8-444a-b765-34e72597705e None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:27:24.106330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8ee09bec-6aa8-444a-b765-34e72597705e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:27:24.183075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:27:24.197328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 760/1508] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:27:24.207182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817af3f-c229-4b97-aa20-ef7404da7f21 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:27:24.208779 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b817af3f-c229-4b97-aa20-ef7404da7f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:27:24.312345 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817af3f-c229-4b97-aa20-ef7404da7f21 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:27:24.370611 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:27:24.392415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44b93b-40da-40d7-8f60-5241dcf5e55e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:27:24.393075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44b93b-40da-40d7-8f60-5241dcf5e55e service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:27:24.393385 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44b93b-40da-40d7-8f60-5241dcf5e55e service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:27:24.393656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44b93b-40da-40d7-8f60-5241dcf5e55e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:27:24.395415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-fa44b93b-40da-40d7-8f60-5241dcf5e55e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:27:24.506962 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44b93b-40da-40d7-8f60-5241dcf5e55e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:27:24.508415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44b93b-40da-40d7-8f60-5241dcf5e55e service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:27:24.527176 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 749/1509] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:27:24.894405 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee09bec-6aa8-444a-b765-34e72597705e None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:27:24.895780 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8ee09bec-6aa8-444a-b765-34e72597705e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:27:24.907285 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee09bec-6aa8-444a-b765-34e72597705e None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:27:25.008419 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490d0ec-1fac-4e95-b184-539a8c235946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:27:25.009295 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490d0ec-1fac-4e95-b184-539a8c235946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:27:25.009581 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490d0ec-1fac-4e95-b184-539a8c235946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:27:25.009860 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490d0ec-1fac-4e95-b184-539a8c235946 admin admin] PATH_INFO: `/v3/projects/b58d61a68b774a5fab64b684da2b4544` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:27:25.020170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490d0ec-1fac-4e95-b184-539a8c235946 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b58d61a68b774a5fab64b684da2b4544)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:27:25.021439 dv-cinder-854263-1-smb devstack@keystone.service[81517]: WARNING py.warnings [None req-9490d0ec-1fac-4e95-b184-539a8c235946 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:27:25.021439 dv-cinder-854263-1-smb devstack@keystone.service[81517]: warnings.warn(msg) Aug 24 04:27:25.021439 dv-cinder-854263-1-smb devstack@keystone.service[81517]: Aug 24 04:27:25.022666 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490d0ec-1fac-4e95-b184-539a8c235946 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:27:25.084857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9490d0ec-1fac-4e95-b184-539a8c235946 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b58d61a68b774a5fab64b684da2b4544', 'request_id': 'req-9490d0ec-1fac-4e95-b184-539a8c235946'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:27:25.094684 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9490d0ec-1fac-4e95-b184-539a8c235946 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b58d61a68b774a5fab64b684da2b4544', 'request_id': 'req-9490d0ec-1fac-4e95-b184-539a8c235946'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:27:25.101853 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9490d0ec-1fac-4e95-b184-539a8c235946 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b58d61a68b774a5fab64b684da2b4544', 'request_id': 'req-9490d0ec-1fac-4e95-b184-539a8c235946'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:27:25.132445 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9490d0ec-1fac-4e95-b184-539a8c235946 admin admin] The token cache is being invalidate because project b58d61a68b774a5fab64b684da2b4544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:27:25.132768 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9490d0ec-1fac-4e95-b184-539a8c235946 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:27:25.133205 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9490d0ec-1fac-4e95-b184-539a8c235946 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:27:25.134628 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 761/1510] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:27:24 2022] DELETE /identity/v3/projects/b58d61a68b774a5fab64b684da2b4544 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:27:34.524860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=62 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:27:35.130518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:29:04.591056 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cb6bd-2a99-4742-917c-466294a414b0 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:04.591687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cb6bd-2a99-4742-917c-466294a414b0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:04.591687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cb6bd-2a99-4742-917c-466294a414b0 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:04.593040 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:29:04.599931 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d42c71-4769-41dd-9b38-fe56ba8992f5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:04.600524 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d42c71-4769-41dd-9b38-fe56ba8992f5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:04.600524 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d42c71-4769-41dd-9b38-fe56ba8992f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:04.692789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-64d42c71-4769-41dd-9b38-fe56ba8992f5 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:29:04.694129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-64d42c71-4769-41dd-9b38-fe56ba8992f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:29:04.809130 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:29:04.967596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cb6bd-2a99-4742-917c-466294a414b0 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:29:04.970173 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-427cb6bd-2a99-4742-917c-466294a414b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:29:05.109616 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cb6bd-2a99-4742-917c-466294a414b0 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:29:05.116643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a97e6-a5e6-4b6e-aeb7-c18caeefe7ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:29:05.117295 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a97e6-a5e6-4b6e-aeb7-c18caeefe7ae service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:05.117580 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a97e6-a5e6-4b6e-aeb7-c18caeefe7ae service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:05.117855 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a97e6-a5e6-4b6e-aeb7-c18caeefe7ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:05.127055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a97e6-a5e6-4b6e-aeb7-c18caeefe7ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:29:05.129349 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a97e6-a5e6-4b6e-aeb7-c18caeefe7ae service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:29:05.139591 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 751/1513] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:29:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:29:06.007677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab4b14-9321-4b06-811a-6701306546f9 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:06.008243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab4b14-9321-4b06-811a-6701306546f9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:06.008352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab4b14-9321-4b06-811a-6701306546f9 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:06.010178 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:29:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:29:06.015148 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda27b0b-0e31-4abe-a5f8-b3cf617758f0 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:06.015643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda27b0b-0e31-4abe-a5f8-b3cf617758f0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:06.015753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda27b0b-0e31-4abe-a5f8-b3cf617758f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:06.038082 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-eda27b0b-0e31-4abe-a5f8-b3cf617758f0 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:29:06.039328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-eda27b0b-0e31-4abe-a5f8-b3cf617758f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:29:06.047396 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:29:06.215425 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab4b14-9321-4b06-811a-6701306546f9 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:29:06.235308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab4b14-9321-4b06-811a-6701306546f9 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:29:06.241678 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172e569-acd4-46cc-9b40-af71967e104c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:29:06.242289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172e569-acd4-46cc-9b40-af71967e104c service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:06.242578 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172e569-acd4-46cc-9b40-af71967e104c service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:06.242857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172e569-acd4-46cc-9b40-af71967e104c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:06.252908 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172e569-acd4-46cc-9b40-af71967e104c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:29:06.254548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172e569-acd4-46cc-9b40-af71967e104c service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:29:06.266753 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 764/1516] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:29:07.763164 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f878986-742e-4bf7-a3fe-b4e1f7656257 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:07.763769 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f878986-742e-4bf7-a3fe-b4e1f7656257 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:07.763769 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f878986-742e-4bf7-a3fe-b4e1f7656257 None None] PATH_INFO: `/v3` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:07.765246 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 753/1517] 10.222.0.100 () {54 vars in 926 bytes} [Wed Aug 24 04:29:07 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:29:07.773391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789397bb-e1ba-424e-839e-f342178365fa None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:07.774262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789397bb-e1ba-424e-839e-f342178365fa None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:07.774438 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789397bb-e1ba-424e-839e-f342178365fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:07.862357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-789397bb-e1ba-424e-839e-f342178365fa None None] MFA Rules not processed for user `d1f7fe9af30947dbae1f2334b18f630d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:29:07.865638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-789397bb-e1ba-424e-839e-f342178365fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:29:07.885910 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:29:07.946480 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 765/1518] 10.222.0.100 () {58 vars in 1016 bytes} [Wed Aug 24 04:29:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:29:11.912383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af35a3-367d-4794-be2e-2f54d54ce773 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:11.913092 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af35a3-367d-4794-be2e-2f54d54ce773 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:11.913092 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af35a3-367d-4794-be2e-2f54d54ce773 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:11.914358 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 754/1519] 10.222.0.96 () {54 vars in 961 bytes} [Wed Aug 24 04:29:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:29:11.919514 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db59569-9b13-4d30-8f4d-058570dcc885 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:11.919990 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db59569-9b13-4d30-8f4d-058570dcc885 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:11.920108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db59569-9b13-4d30-8f4d-058570dcc885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:11.940732 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1db59569-9b13-4d30-8f4d-058570dcc885 None None] MFA Rules not processed for user `d1f7fe9af30947dbae1f2334b18f630d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:29:11.941986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1db59569-9b13-4d30-8f4d-058570dcc885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:29:11.950953 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 766/1520] 10.222.0.96 () {58 vars in 1058 bytes} [Wed Aug 24 04:29:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:29:11.959268 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af35a3-367d-4794-be2e-2f54d54ce773 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:29:11.976800 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af35a3-367d-4794-be2e-2f54d54ce773 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:29:11.983076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572f80b-b02b-423c-85d9-bc56568837c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f7fe9af30947dbae1f2334b18f630d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:29:11.983725 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572f80b-b02b-423c-85d9-bc56568837c6 service placement] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:11.984018 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572f80b-b02b-423c-85d9-bc56568837c6 service placement] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:11.984384 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572f80b-b02b-423c-85d9-bc56568837c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:11.994589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572f80b-b02b-423c-85d9-bc56568837c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:29:11.996368 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572f80b-b02b-423c-85d9-bc56568837c6 service placement] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:29:12.007247 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 755/1521] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:29:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:29:17.528670 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07de08-c7c5-47f9-8591-5fbc4f57823c None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:17.529273 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07de08-c7c5-47f9-8591-5fbc4f57823c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:17.529384 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07de08-c7c5-47f9-8591-5fbc4f57823c None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:17.530826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:29:17.536134 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60992eee-b02e-4cb7-8f13-1bfedbd7c0f6 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:17.536676 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60992eee-b02e-4cb7-8f13-1bfedbd7c0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:17.536995 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60992eee-b02e-4cb7-8f13-1bfedbd7c0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:17.557807 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-60992eee-b02e-4cb7-8f13-1bfedbd7c0f6 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:29:17.559028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-60992eee-b02e-4cb7-8f13-1bfedbd7c0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:29:17.567676 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:29:17.732265 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07de08-c7c5-47f9-8591-5fbc4f57823c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:29:17.747509 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07de08-c7c5-47f9-8591-5fbc4f57823c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:29:17.753012 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5740e-8c0d-4229-8239-78f5437c5e8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:29:17.753622 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5740e-8c0d-4229-8239-78f5437c5e8c service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:17.753933 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5740e-8c0d-4229-8239-78f5437c5e8c service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:17.754853 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5740e-8c0d-4229-8239-78f5437c5e8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:17.763752 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5740e-8c0d-4229-8239-78f5437c5e8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:29:17.765519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5740e-8c0d-4229-8239-78f5437c5e8c service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:29:17.781952 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 768/1524] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:29:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:29:18.662201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5244a37-ea5b-47e5-8441-443256c7c26d None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:18.662734 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5244a37-ea5b-47e5-8441-443256c7c26d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:18.662862 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5244a37-ea5b-47e5-8441-443256c7c26d None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:18.664155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:29:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:29:18.671815 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b9485-af97-4d85-b2b6-03d501504fd5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:18.673001 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b9485-af97-4d85-b2b6-03d501504fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:18.673001 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b9485-af97-4d85-b2b6-03d501504fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:18.695137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-459b9485-af97-4d85-b2b6-03d501504fd5 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:29:18.696367 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-459b9485-af97-4d85-b2b6-03d501504fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:29:18.704292 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:29:18.868613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5244a37-ea5b-47e5-8441-443256c7c26d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:29:18.883989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5244a37-ea5b-47e5-8441-443256c7c26d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:29:18.889564 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7240b8-3b0f-4810-a2c7-5a90d6389c06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:29:18.890163 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7240b8-3b0f-4810-a2c7-5a90d6389c06 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:18.890441 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7240b8-3b0f-4810-a2c7-5a90d6389c06 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:18.890714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7240b8-3b0f-4810-a2c7-5a90d6389c06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:18.900135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7240b8-3b0f-4810-a2c7-5a90d6389c06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:29:18.901755 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7240b8-3b0f-4810-a2c7-5a90d6389c06 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:29:18.912673 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 758/1527] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:29:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:29:23.057789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d60742-7a0e-488c-9166-4e93644a7f4a None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:23.058297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d60742-7a0e-488c-9166-4e93644a7f4a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:23.058297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d60742-7a0e-488c-9166-4e93644a7f4a None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:23.059623 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:29:23.065139 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0245bd1-9953-48ea-87eb-dc585a7211a1 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:23.065620 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0245bd1-9953-48ea-87eb-dc585a7211a1 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:23.065726 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0245bd1-9953-48ea-87eb-dc585a7211a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:23.085589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f0245bd1-9953-48ea-87eb-dc585a7211a1 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:29:23.086764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f0245bd1-9953-48ea-87eb-dc585a7211a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:29:23.094565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:29:23.386450 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d60742-7a0e-488c-9166-4e93644a7f4a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:29:23.388543 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-41d60742-7a0e-488c-9166-4e93644a7f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:29:23.486226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d60742-7a0e-488c-9166-4e93644a7f4a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:29:23.490769 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f9ed4-f9b4-4581-9592-73f42d778722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:29:23.491381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f9ed4-f9b4-4581-9592-73f42d778722 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:23.491655 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f9ed4-f9b4-4581-9592-73f42d778722 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:23.491924 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f9ed4-f9b4-4581-9592-73f42d778722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:23.502439 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f9ed4-f9b4-4581-9592-73f42d778722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:29:23.503930 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f9ed4-f9b4-4581-9592-73f42d778722 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:29:23.515596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 771/1530] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:29:25.496791 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa62d6e-825f-432a-b6ee-4f784e6ab6f9 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:25.497339 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa62d6e-825f-432a-b6ee-4f784e6ab6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:25.497503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa62d6e-825f-432a-b6ee-4f784e6ab6f9 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:25.498712 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:29:25.504208 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ef563-8eb7-4bd9-8a7b-30dbb32f6ef0 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:25.504636 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ef563-8eb7-4bd9-8a7b-30dbb32f6ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:25.504858 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ef563-8eb7-4bd9-8a7b-30dbb32f6ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:25.525961 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f26ef563-8eb7-4bd9-8a7b-30dbb32f6ef0 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:29:25.527216 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f26ef563-8eb7-4bd9-8a7b-30dbb32f6ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:29:25.535972 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:29:25.818489 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa62d6e-825f-432a-b6ee-4f784e6ab6f9 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:29:25.837022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa62d6e-825f-432a-b6ee-4f784e6ab6f9 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:29:25.840161 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170da2a6-8369-417c-806e-bb2781002a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:29:25.840798 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170da2a6-8369-417c-806e-bb2781002a26 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:25.841081 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170da2a6-8369-417c-806e-bb2781002a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:25.841360 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170da2a6-8369-417c-806e-bb2781002a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:25.852123 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170da2a6-8369-417c-806e-bb2781002a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:29:25.853697 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170da2a6-8369-417c-806e-bb2781002a26 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:29:25.865496 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 761/1533] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:29:29.346150 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c36d0-d41c-48e5-8b9f-9d2c1e10cc2c None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:29.346773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c36d0-d41c-48e5-8b9f-9d2c1e10cc2c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:29.346773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c36d0-d41c-48e5-8b9f-9d2c1e10cc2c None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:29.348234 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:29:29.353835 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f9d17-9261-43ee-b784-700921ff3a5c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:29.354310 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f9d17-9261-43ee-b784-700921ff3a5c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:29.354416 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f9d17-9261-43ee-b784-700921ff3a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:29.373960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-047f9d17-9261-43ee-b784-700921ff3a5c None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:29:29.375196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-047f9d17-9261-43ee-b784-700921ff3a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:29:29.384139 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:29:29.948565 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c36d0-d41c-48e5-8b9f-9d2c1e10cc2c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:29:29.950260 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4e2c36d0-d41c-48e5-8b9f-9d2c1e10cc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:29:30.021993 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:29:30.036246 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c36d0-d41c-48e5-8b9f-9d2c1e10cc2c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:29:30.039872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3686d99-98e3-4b64-8951-1e7727acf692 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:29:30.040493 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3686d99-98e3-4b64-8951-1e7727acf692 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:30.040809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3686d99-98e3-4b64-8951-1e7727acf692 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:30.041092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3686d99-98e3-4b64-8951-1e7727acf692 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:30.050249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3686d99-98e3-4b64-8951-1e7727acf692 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:29:30.051714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3686d99-98e3-4b64-8951-1e7727acf692 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:29:30.061087 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 774/1536] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:29:32.054703 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af289d3b-5756-4d4b-87d8-94cba97dd546 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:32.055282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af289d3b-5756-4d4b-87d8-94cba97dd546 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:32.055282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af289d3b-5756-4d4b-87d8-94cba97dd546 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:32.056585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:29:32.061946 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04caf034-16fd-476b-9343-6a51ac733263 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:32.062355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04caf034-16fd-476b-9343-6a51ac733263 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:32.062494 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04caf034-16fd-476b-9343-6a51ac733263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:32.082896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-04caf034-16fd-476b-9343-6a51ac733263 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:29:32.084088 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-04caf034-16fd-476b-9343-6a51ac733263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:29:32.092630 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:29:32.667475 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af289d3b-5756-4d4b-87d8-94cba97dd546 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:29:32.669231 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-af289d3b-5756-4d4b-87d8-94cba97dd546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:29:32.682326 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af289d3b-5756-4d4b-87d8-94cba97dd546 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:29:32.685910 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb1982-93b7-487c-be61-a6ecc2ad20f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:29:32.686517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb1982-93b7-487c-be61-a6ecc2ad20f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:29:32.686802 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb1982-93b7-487c-be61-a6ecc2ad20f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:29:32.687079 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb1982-93b7-487c-be61-a6ecc2ad20f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:29:32.696357 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb1982-93b7-487c-be61-a6ecc2ad20f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:29:32.697847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb1982-93b7-487c-be61-a6ecc2ad20f4 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:29:32.708855 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 764/1539] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:29:42.077381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=11 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:29:42.703465 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:02.866877 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa391f-f578-4079-b7fd-d5082df45362 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:02.868895 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa391f-f578-4079-b7fd-d5082df45362 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:02.868895 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa391f-f578-4079-b7fd-d5082df45362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:02.899755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d8aa391f-f578-4079-b7fd-d5082df45362 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:02.901087 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d8aa391f-f578-4079-b7fd-d5082df45362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:02.916801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 776/1540] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:02.926659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd43e2-6e0a-44c7-8f7d-e73b7f61444f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:02.927791 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd43e2-6e0a-44c7-8f7d-e73b7f61444f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:02.928342 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd43e2-6e0a-44c7-8f7d-e73b7f61444f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:02.961221 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-3ebd43e2-6e0a-44c7-8f7d-e73b7f61444f None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:02.962968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3ebd43e2-6e0a-44c7-8f7d-e73b7f61444f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:02.976491 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 765/1541] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:02.982585 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa391f-f578-4079-b7fd-d5082df45362 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:02.999099 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa391f-f578-4079-b7fd-d5082df45362 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:03.011879 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9934a8f-8a67-4727-ac97-048f424ddbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:03.012879 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9934a8f-8a67-4727-ac97-048f424ddbdc admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.013334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9934a8f-8a67-4727-ac97-048f424ddbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.013798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9934a8f-8a67-4727-ac97-048f424ddbdc admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.014624 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9934a8f-8a67-4727-ac97-048f424ddbdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:03.015104 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9934a8f-8a67-4727-ac97-048f424ddbdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:03.017105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9934a8f-8a67-4727-ac97-048f424ddbdc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:03.038526 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 777/1542] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:31:03.046771 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd43e2-6e0a-44c7-8f7d-e73b7f61444f None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:03.063679 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd43e2-6e0a-44c7-8f7d-e73b7f61444f None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:03.073259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b064d4e-f4a4-417e-a11d-c92ba00bcf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:03.073906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b064d4e-f4a4-417e-a11d-c92ba00bcf2c admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.074198 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b064d4e-f4a4-417e-a11d-c92ba00bcf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.074470 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b064d4e-f4a4-417e-a11d-c92ba00bcf2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.075115 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b064d4e-f4a4-417e-a11d-c92ba00bcf2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:03.077079 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b064d4e-f4a4-417e-a11d-c92ba00bcf2c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:03.148099 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9dae7-c17f-4b34-9489-ef53b699d8b4 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.148927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9dae7-c17f-4b34-9489-ef53b699d8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.149529 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9dae7-c17f-4b34-9489-ef53b699d8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.150383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 766/1543] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:03 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:03.156740 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b064d4e-f4a4-417e-a11d-c92ba00bcf2c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:03.185878 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e0c9dae7-c17f-4b34-9489-ef53b699d8b4 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:03.187570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e0c9dae7-c17f-4b34-9489-ef53b699d8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:03.277878 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b064d4e-f4a4-417e-a11d-c92ba00bcf2c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:03.302079 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed61266-bee0-4c5f-bf65-334a727d8463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:03.302079 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61266-bee0-4c5f-bf65-334a727d8463 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.302079 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61266-bee0-4c5f-bf65-334a727d8463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.302079 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61266-bee0-4c5f-bf65-334a727d8463 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.302574 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed61266-bee0-4c5f-bf65-334a727d8463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:03.302574 dv-cinder-854263-1-smb devstack@keystone.service[81516]: WARNING py.warnings [None req-4ed61266-bee0-4c5f-bf65-334a727d8463 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:31:03.302574 dv-cinder-854263-1-smb devstack@keystone.service[81516]: warnings.warn(msg) Aug 24 04:31:03.302574 dv-cinder-854263-1-smb devstack@keystone.service[81516]: Aug 24 04:31:03.302574 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed61266-bee0-4c5f-bf65-334a727d8463 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:03.305141 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 778/1544] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:03.306809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334735d8-5709-4097-a49a-0860a07cee26 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.307347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334735d8-5709-4097-a49a-0860a07cee26 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.307842 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334735d8-5709-4097-a49a-0860a07cee26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.338834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-334735d8-5709-4097-a49a-0860a07cee26 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:03.340220 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-334735d8-5709-4097-a49a-0860a07cee26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:03.352574 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 767/1545] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:03 2022] POST /identity/v3/users => generated 285 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:31:03.354055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06d10d-b196-410f-9bfb-580942401932 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.354348 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06d10d-b196-410f-9bfb-580942401932 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.354628 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06d10d-b196-410f-9bfb-580942401932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.356991 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 779/1546] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:03.359192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b70a3e-fa68-439a-bbb1-bed8d1fe6c69 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.359483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b70a3e-fa68-439a-bbb1-bed8d1fe6c69 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.359947 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b70a3e-fa68-439a-bbb1-bed8d1fe6c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.404804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-92b70a3e-fa68-439a-bbb1-bed8d1fe6c69 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:03.405951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-92b70a3e-fa68-439a-bbb1-bed8d1fe6c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:03.406708 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-3f06d10d-b196-410f-9bfb-580942401932 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:03.411449 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3f06d10d-b196-410f-9bfb-580942401932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:03.423634 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 780/1547] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:03.424552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b70a3e-fa68-439a-bbb1-bed8d1fe6c69 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:03.425559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 768/1548] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:03.434008 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c87b75-2603-48f7-96fb-c33a72dad8bf None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.434638 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c87b75-2603-48f7-96fb-c33a72dad8bf None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.435139 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c87b75-2603-48f7-96fb-c33a72dad8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.442925 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b70a3e-fa68-439a-bbb1-bed8d1fe6c69 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:03.449497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f27310-4513-46ad-89e3-87f1b52ff018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:03.450149 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f27310-4513-46ad-89e3-87f1b52ff018 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.450431 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f27310-4513-46ad-89e3-87f1b52ff018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.450708 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f27310-4513-46ad-89e3-87f1b52ff018 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.451449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f27310-4513-46ad-89e3-87f1b52ff018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:03.457980 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f27310-4513-46ad-89e3-87f1b52ff018 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:03.471150 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 781/1549] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:03.471378 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-92c87b75-2603-48f7-96fb-c33a72dad8bf None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:03.471482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783e9b0-b92c-43c7-9187-c3a78b93536d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.471482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783e9b0-b92c-43c7-9187-c3a78b93536d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.471482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783e9b0-b92c-43c7-9187-c3a78b93536d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.471723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-92c87b75-2603-48f7-96fb-c33a72dad8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:03.479795 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 769/1550] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:03.481186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31065c3-647c-4661-aeb6-5bb74d8a9ce9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.481481 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31065c3-647c-4661-aeb6-5bb74d8a9ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.481759 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31065c3-647c-4661-aeb6-5bb74d8a9ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.499439 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a783e9b0-b92c-43c7-9187-c3a78b93536d None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:03.501018 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a783e9b0-b92c-43c7-9187-c3a78b93536d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:03.502365 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f31065c3-647c-4661-aeb6-5bb74d8a9ce9 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:03.504280 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f31065c3-647c-4661-aeb6-5bb74d8a9ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:03.512733 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 770/1551] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:03.513236 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 782/1552] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:03.513932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31065c3-647c-4661-aeb6-5bb74d8a9ce9 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:03.515062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faba77b-0e08-4722-98a5-558489dad8b0 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.515351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faba77b-0e08-4722-98a5-558489dad8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.515623 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faba77b-0e08-4722-98a5-558489dad8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.529279 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31065c3-647c-4661-aeb6-5bb74d8a9ce9 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:03.534098 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35114722-c173-4361-bf3e-8e63ce8e9162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:03.535605 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35114722-c173-4361-bf3e-8e63ce8e9162 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.536063 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35114722-c173-4361-bf3e-8e63ce8e9162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.536371 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35114722-c173-4361-bf3e-8e63ce8e9162 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.537089 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35114722-c173-4361-bf3e-8e63ce8e9162 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:03.537403 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35114722-c173-4361-bf3e-8e63ce8e9162 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:03.538767 dv-cinder-854263-1-smb devstack@keystone.service[81516]: WARNING py.warnings [None req-35114722-c173-4361-bf3e-8e63ce8e9162 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:31:03.538767 dv-cinder-854263-1-smb devstack@keystone.service[81516]: warnings.warn(msg) Aug 24 04:31:03.538767 dv-cinder-854263-1-smb devstack@keystone.service[81516]: Aug 24 04:31:03.539614 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35114722-c173-4361-bf3e-8e63ce8e9162 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:03.539745 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1faba77b-0e08-4722-98a5-558489dad8b0 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:03.540920 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1faba77b-0e08-4722-98a5-558489dad8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:03.549228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 783/1553] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:03.550873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafa1a8-8edd-4ac3-afa7-9507433336db None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.551349 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafa1a8-8edd-4ac3-afa7-9507433336db None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.551853 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafa1a8-8edd-4ac3-afa7-9507433336db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.554555 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 771/1554] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:31:03.555746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35114722-c173-4361-bf3e-8e63ce8e9162 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:03.571056 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35114722-c173-4361-bf3e-8e63ce8e9162 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:03.576069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb27c3b-23b8-498e-9e93-3e7f166bdd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:03.576920 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb27c3b-23b8-498e-9e93-3e7f166bdd3a admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.577387 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb27c3b-23b8-498e-9e93-3e7f166bdd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.577664 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb27c3b-23b8-498e-9e93-3e7f166bdd3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.578315 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb27c3b-23b8-498e-9e93-3e7f166bdd3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:03.580013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb27c3b-23b8-498e-9e93-3e7f166bdd3a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:03.583272 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-faafa1a8-8edd-4ac3-afa7-9507433336db None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:03.584813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-faafa1a8-8edd-4ac3-afa7-9507433336db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:03.596825 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 772/1555] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:03.597687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 784/1556] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:03.597687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafa1a8-8edd-4ac3-afa7-9507433336db None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:03.597893 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665aeaec-192f-428f-87e8-c6cd545cd163 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.597893 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665aeaec-192f-428f-87e8-c6cd545cd163 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.597893 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665aeaec-192f-428f-87e8-c6cd545cd163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.608798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafa1a8-8edd-4ac3-afa7-9507433336db None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:03.615210 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2289e-d6f8-4bf4-89ff-94dcbe6f3d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:03.615896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2289e-d6f8-4bf4-89ff-94dcbe6f3d25 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.616180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2289e-d6f8-4bf4-89ff-94dcbe6f3d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.616514 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2289e-d6f8-4bf4-89ff-94dcbe6f3d25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.617288 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2289e-d6f8-4bf4-89ff-94dcbe6f3d25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:03.617615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2289e-d6f8-4bf4-89ff-94dcbe6f3d25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:03.619355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2289e-d6f8-4bf4-89ff-94dcbe6f3d25 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:03.620157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-665aeaec-192f-428f-87e8-c6cd545cd163 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:03.621821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-665aeaec-192f-428f-87e8-c6cd545cd163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:03.630343 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 773/1557] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:03.631532 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2e50e-d2f8-4ba1-aad2-a489d7df966b None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.631814 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2e50e-d2f8-4ba1-aad2-a489d7df966b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.632209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2e50e-d2f8-4ba1-aad2-a489d7df966b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.640493 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 785/1558] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:31:03.640493 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b7739-c70a-4446-91ae-f85502136cd8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.640493 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b7739-c70a-4446-91ae-f85502136cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.640493 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b7739-c70a-4446-91ae-f85502136cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.652924 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-76a2e50e-d2f8-4ba1-aad2-a489d7df966b None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:03.654137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-76a2e50e-d2f8-4ba1-aad2-a489d7df966b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:03.655351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f15b7739-c70a-4446-91ae-f85502136cd8 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:03.656477 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f15b7739-c70a-4446-91ae-f85502136cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:03.663028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 774/1559] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:03.663622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2e50e-d2f8-4ba1-aad2-a489d7df966b None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:03.667585 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 786/1560] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:03.668400 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b7739-c70a-4446-91ae-f85502136cd8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:03.673993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2e50e-d2f8-4ba1-aad2-a489d7df966b None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:03.679131 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b7739-c70a-4446-91ae-f85502136cd8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:03.679622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf3c66-f010-457f-874e-2aace9fdc5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:03.680240 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf3c66-f010-457f-874e-2aace9fdc5fb admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.680601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf3c66-f010-457f-874e-2aace9fdc5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.680865 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf3c66-f010-457f-874e-2aace9fdc5fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.681493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf3c66-f010-457f-874e-2aace9fdc5fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:03.683399 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf3c66-f010-457f-874e-2aace9fdc5fb admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:03.684176 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e00d5-10dc-4edd-acce-c5674fd266d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:03.684882 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e00d5-10dc-4edd-acce-c5674fd266d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.685169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e00d5-10dc-4edd-acce-c5674fd266d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.685452 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e00d5-10dc-4edd-acce-c5674fd266d7 admin admin] PATH_INFO: `/v3/projects/9509b1c4477a444ba8ea47a6f5cc8807/users/f8861943f9ec47e2a0fb1d386851a909/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.700939 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e00d5-10dc-4edd-acce-c5674fd266d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9509b1c4477a444ba8ea47a6f5cc8807, user_id=f8861943f9ec47e2a0fb1d386851a909, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:03.702287 dv-cinder-854263-1-smb devstack@keystone.service[81517]: WARNING py.warnings [None req-9f4e00d5-10dc-4edd-acce-c5674fd266d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:31:03.702287 dv-cinder-854263-1-smb devstack@keystone.service[81517]: warnings.warn(msg) Aug 24 04:31:03.702287 dv-cinder-854263-1-smb devstack@keystone.service[81517]: Aug 24 04:31:03.704632 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e00d5-10dc-4edd-acce-c5674fd266d7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:03.719023 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 787/1561] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:03 2022] PUT /identity/v3/projects/9509b1c4477a444ba8ea47a6f5cc8807/users/f8861943f9ec47e2a0fb1d386851a909/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:03.720452 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e00d5-10dc-4edd-acce-c5674fd266d7 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:03.724620 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 775/1562] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:03 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:03.724620 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6e697-cc20-4824-9aa2-5c73ae2812b2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.724620 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6e697-cc20-4824-9aa2-5c73ae2812b2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.724620 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6e697-cc20-4824-9aa2-5c73ae2812b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.743390 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-25c6e697-cc20-4824-9aa2-5c73ae2812b2 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:03.744599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-25c6e697-cc20-4824-9aa2-5c73ae2812b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:03.776847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:03.781170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:03.794155 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e00d5-10dc-4edd-acce-c5674fd266d7 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:03.810623 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 776/1563] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:03.811575 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6e697-cc20-4824-9aa2-5c73ae2812b2 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:03.822622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6e697-cc20-4824-9aa2-5c73ae2812b2 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:03.827565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57998d-39b3-45b8-b7fa-23f6d4de1dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:03.828199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57998d-39b3-45b8-b7fa-23f6d4de1dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.828490 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57998d-39b3-45b8-b7fa-23f6d4de1dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.828810 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57998d-39b3-45b8-b7fa-23f6d4de1dd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.829490 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57998d-39b3-45b8-b7fa-23f6d4de1dd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:03.829805 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57998d-39b3-45b8-b7fa-23f6d4de1dd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:03.832040 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57998d-39b3-45b8-b7fa-23f6d4de1dd3 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:03.844722 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 777/1564] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:31:03.845482 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57998d-39b3-45b8-b7fa-23f6d4de1dd3 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:03.856513 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57998d-39b3-45b8-b7fa-23f6d4de1dd3 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:03.861498 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88f84f-b007-427d-b5fc-1c00460f47aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:03.862113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88f84f-b007-427d-b5fc-1c00460f47aa admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.862402 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88f84f-b007-427d-b5fc-1c00460f47aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.863406 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88f84f-b007-427d-b5fc-1c00460f47aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.864085 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88f84f-b007-427d-b5fc-1c00460f47aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:03.864587 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498ac33-59a0-4a3e-9187-1428a0fcfbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:03.865263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498ac33-59a0-4a3e-9187-1428a0fcfbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.865572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498ac33-59a0-4a3e-9187-1428a0fcfbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.865853 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498ac33-59a0-4a3e-9187-1428a0fcfbf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.866140 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88f84f-b007-427d-b5fc-1c00460f47aa admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:03.866511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498ac33-59a0-4a3e-9187-1428a0fcfbf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:03.866819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498ac33-59a0-4a3e-9187-1428a0fcfbf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:03.868424 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498ac33-59a0-4a3e-9187-1428a0fcfbf3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:03.881461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 788/1565] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:31:03.882416 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498ac33-59a0-4a3e-9187-1428a0fcfbf3 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:03.893261 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498ac33-59a0-4a3e-9187-1428a0fcfbf3 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:03.896651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 778/1566] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:03 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:03.897516 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88f84f-b007-427d-b5fc-1c00460f47aa admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:03.898432 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7504671-b1f6-45fd-8bb6-53445a2555b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:03.899114 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7504671-b1f6-45fd-8bb6-53445a2555b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.899350 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7504671-b1f6-45fd-8bb6-53445a2555b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.899898 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7504671-b1f6-45fd-8bb6-53445a2555b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.900464 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7504671-b1f6-45fd-8bb6-53445a2555b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:03.900826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7504671-b1f6-45fd-8bb6-53445a2555b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:03.902441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7504671-b1f6-45fd-8bb6-53445a2555b1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:03.915485 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 789/1567] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:31:03.916211 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7504671-b1f6-45fd-8bb6-53445a2555b1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:03.933147 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7504671-b1f6-45fd-8bb6-53445a2555b1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:03.963891 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88f84f-b007-427d-b5fc-1c00460f47aa admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:03.968857 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7578180-fc16-4a06-862e-acf583f91670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:03.969472 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7578180-fc16-4a06-862e-acf583f91670 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.969751 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7578180-fc16-4a06-862e-acf583f91670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.970023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7578180-fc16-4a06-862e-acf583f91670 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.970682 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7578180-fc16-4a06-862e-acf583f91670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:03.970995 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7578180-fc16-4a06-862e-acf583f91670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:03.972744 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7578180-fc16-4a06-862e-acf583f91670 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:03.992476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 779/1568] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:31:03.992476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a48303-697b-4a0d-9fa7-0bad46c9dcc2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.992476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a48303-697b-4a0d-9fa7-0bad46c9dcc2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.992476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a48303-697b-4a0d-9fa7-0bad46c9dcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.993734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74640e2-9612-4452-8c8c-5b5d2c77ae54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:03.994375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74640e2-9612-4452-8c8c-5b5d2c77ae54 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:03.994749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74640e2-9612-4452-8c8c-5b5d2c77ae54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:03.995027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74640e2-9612-4452-8c8c-5b5d2c77ae54 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:03.995671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74640e2-9612-4452-8c8c-5b5d2c77ae54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:03.997658 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74640e2-9612-4452-8c8c-5b5d2c77ae54 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.019777 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a6a48303-697b-4a0d-9fa7-0bad46c9dcc2 None None] MFA Rules not processed for user `f8861943f9ec47e2a0fb1d386851a909`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:04.023824 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 790/1569] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:03 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:04.024010 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a6a48303-697b-4a0d-9fa7-0bad46c9dcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:04.024147 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f833be-7125-4ecb-a1f5-72d6d64132a0 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.024147 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f833be-7125-4ecb-a1f5-72d6d64132a0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.024147 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f833be-7125-4ecb-a1f5-72d6d64132a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.042624 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-87f833be-7125-4ecb-a1f5-72d6d64132a0 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:04.044139 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-87f833be-7125-4ecb-a1f5-72d6d64132a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:04.052363 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 791/1570] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:04.053207 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f833be-7125-4ecb-a1f5-72d6d64132a0 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.062853 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f833be-7125-4ecb-a1f5-72d6d64132a0 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.068208 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0070dee-113c-4ab0-b7f5-ccace67e707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.068881 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0070dee-113c-4ab0-b7f5-ccace67e707b admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.069167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0070dee-113c-4ab0-b7f5-ccace67e707b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.069446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0070dee-113c-4ab0-b7f5-ccace67e707b admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.070080 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0070dee-113c-4ab0-b7f5-ccace67e707b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.071107 dv-cinder-854263-1-smb devstack@keystone.service[81517]: WARNING py.warnings [None req-a0070dee-113c-4ab0-b7f5-ccace67e707b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:31:04.071107 dv-cinder-854263-1-smb devstack@keystone.service[81517]: warnings.warn(msg) Aug 24 04:31:04.071107 dv-cinder-854263-1-smb devstack@keystone.service[81517]: Aug 24 04:31:04.072312 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0070dee-113c-4ab0-b7f5-ccace67e707b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.100176 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 780/1571] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:04.100176 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a48303-697b-4a0d-9fa7-0bad46c9dcc2 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.108173 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 792/1572] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:04 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:04.108173 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0070dee-113c-4ab0-b7f5-ccace67e707b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.108456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a48303-697b-4a0d-9fa7-0bad46c9dcc2 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.129878 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:04.161842 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:04.177848 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399254b-83dc-409d-927e-c82729a9b906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.178492 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399254b-83dc-409d-927e-c82729a9b906 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.178773 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399254b-83dc-409d-927e-c82729a9b906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.179045 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399254b-83dc-409d-927e-c82729a9b906 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.179675 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399254b-83dc-409d-927e-c82729a9b906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.180587 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0070dee-113c-4ab0-b7f5-ccace67e707b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.181798 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399254b-83dc-409d-927e-c82729a9b906 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.185231 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256000eb-8f53-4862-b4a1-18e4f31ceb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.185841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256000eb-8f53-4862-b4a1-18e4f31ceb27 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.186126 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256000eb-8f53-4862-b4a1-18e4f31ceb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.186407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256000eb-8f53-4862-b4a1-18e4f31ceb27 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.187035 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256000eb-8f53-4862-b4a1-18e4f31ceb27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.188989 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256000eb-8f53-4862-b4a1-18e4f31ceb27 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.211899 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 793/1573] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:04 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:04.213593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256000eb-8f53-4862-b4a1-18e4f31ceb27 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.221121 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 781/1574] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:04 2022] POST /identity/v3/projects => generated 391 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:04.223968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256000eb-8f53-4862-b4a1-18e4f31ceb27 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.225297 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399254b-83dc-409d-927e-c82729a9b906 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.289568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7c730-8f42-4eb2-aee4-1e04ef322a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.290187 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7c730-8f42-4eb2-aee4-1e04ef322a3b admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.290474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7c730-8f42-4eb2-aee4-1e04ef322a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.290760 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7c730-8f42-4eb2-aee4-1e04ef322a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.291396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7c730-8f42-4eb2-aee4-1e04ef322a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.293408 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7c730-8f42-4eb2-aee4-1e04ef322a3b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.294647 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399254b-83dc-409d-927e-c82729a9b906 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.299654 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb00e20-e79d-4a1c-9d0f-7a637771e5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.300443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb00e20-e79d-4a1c-9d0f-7a637771e5ab admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.300755 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb00e20-e79d-4a1c-9d0f-7a637771e5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.301067 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb00e20-e79d-4a1c-9d0f-7a637771e5ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.301733 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb00e20-e79d-4a1c-9d0f-7a637771e5ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.303673 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb00e20-e79d-4a1c-9d0f-7a637771e5ab admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.322776 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 794/1575] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:04 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:04.323917 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7c730-8f42-4eb2-aee4-1e04ef322a3b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.338072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 782/1576] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:04 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:04.338072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb00e20-e79d-4a1c-9d0f-7a637771e5ab admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.393161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7c730-8f42-4eb2-aee4-1e04ef322a3b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.398896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c6855-b136-4b43-98d1-4b8fe77cc9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.399458 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb00e20-e79d-4a1c-9d0f-7a637771e5ab admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.399587 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c6855-b136-4b43-98d1-4b8fe77cc9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.399798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c6855-b136-4b43-98d1-4b8fe77cc9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.400079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c6855-b136-4b43-98d1-4b8fe77cc9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.400850 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c6855-b136-4b43-98d1-4b8fe77cc9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.402553 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c6855-b136-4b43-98d1-4b8fe77cc9d4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.404727 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5a9d9-cc57-404d-b3ce-d621886e129b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.405365 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5a9d9-cc57-404d-b3ce-d621886e129b admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.405651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5a9d9-cc57-404d-b3ce-d621886e129b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.405930 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5a9d9-cc57-404d-b3ce-d621886e129b admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.410005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5a9d9-cc57-404d-b3ce-d621886e129b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:04.410005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5a9d9-cc57-404d-b3ce-d621886e129b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.410005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5a9d9-cc57-404d-b3ce-d621886e129b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.413461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 795/1577] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:04.414304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c6855-b136-4b43-98d1-4b8fe77cc9d4 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.424450 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c6855-b136-4b43-98d1-4b8fe77cc9d4 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.426575 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 783/1578] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:31:04.427983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1239684-9d04-44ed-b401-e194b0a44d20 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.428261 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1239684-9d04-44ed-b401-e194b0a44d20 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.428497 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1239684-9d04-44ed-b401-e194b0a44d20 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.429536 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e075334-87de-4a32-81e5-daab854242d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.429985 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 784/1579] 10.222.0.96 () {54 vars in 962 bytes} [Wed Aug 24 04:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:31:04.430167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e075334-87de-4a32-81e5-daab854242d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.430445 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e075334-87de-4a32-81e5-daab854242d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.431016 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e075334-87de-4a32-81e5-daab854242d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.431591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e075334-87de-4a32-81e5-daab854242d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.434681 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e075334-87de-4a32-81e5-daab854242d6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.434995 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1239684-9d04-44ed-b401-e194b0a44d20 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.450592 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1239684-9d04-44ed-b401-e194b0a44d20 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.455542 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f5f5f-0852-40c0-9377-cc8a507e2c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.457027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 796/1580] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:04 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:04.457627 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f5f5f-0852-40c0-9377-cc8a507e2c7a admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.457932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f5f5f-0852-40c0-9377-cc8a507e2c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.458186 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e075334-87de-4a32-81e5-daab854242d6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.458331 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f5f5f-0852-40c0-9377-cc8a507e2c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.459114 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f5f5f-0852-40c0-9377-cc8a507e2c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.460759 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f5f5f-0852-40c0-9377-cc8a507e2c7a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.469767 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e075334-87de-4a32-81e5-daab854242d6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.475183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 785/1581] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:04.475183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f5f5f-0852-40c0-9377-cc8a507e2c7a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.475556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30636489-ce3f-4f29-aa29-ae6fd448f698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.476183 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30636489-ce3f-4f29-aa29-ae6fd448f698 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.476472 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30636489-ce3f-4f29-aa29-ae6fd448f698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.476802 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30636489-ce3f-4f29-aa29-ae6fd448f698 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.477464 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30636489-ce3f-4f29-aa29-ae6fd448f698 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.479438 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30636489-ce3f-4f29-aa29-ae6fd448f698 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.483457 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f5f5f-0852-40c0-9377-cc8a507e2c7a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.489739 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709df2e8-00f3-4196-8827-b2cd8d237254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.490399 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709df2e8-00f3-4196-8827-b2cd8d237254 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.490688 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709df2e8-00f3-4196-8827-b2cd8d237254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.490966 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709df2e8-00f3-4196-8827-b2cd8d237254 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.491630 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709df2e8-00f3-4196-8827-b2cd8d237254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.493844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709df2e8-00f3-4196-8827-b2cd8d237254 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.507906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 797/1582] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:04 2022] POST /identity/v3/users => generated 296 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:04.508914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30636489-ce3f-4f29-aa29-ae6fd448f698 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.512156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:04.519046 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30636489-ce3f-4f29-aa29-ae6fd448f698 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.521570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 786/1583] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:04 2022] POST /identity/v3/users => generated 290 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:04.524122 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96aad8-f035-491e-9290-60b3c68a5764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.524862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96aad8-f035-491e-9290-60b3c68a5764 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.525152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96aad8-f035-491e-9290-60b3c68a5764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.525429 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96aad8-f035-491e-9290-60b3c68a5764 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.525815 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709df2e8-00f3-4196-8827-b2cd8d237254 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.526060 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96aad8-f035-491e-9290-60b3c68a5764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.527998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96aad8-f035-491e-9290-60b3c68a5764 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.536371 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709df2e8-00f3-4196-8827-b2cd8d237254 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.542210 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b3ae4-d44b-461d-abb7-87f4da784922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.542826 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b3ae4-d44b-461d-abb7-87f4da784922 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.543109 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b3ae4-d44b-461d-abb7-87f4da784922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.543386 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b3ae4-d44b-461d-abb7-87f4da784922 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.544033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b3ae4-d44b-461d-abb7-87f4da784922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.545438 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:04.545672 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b3ae4-d44b-461d-abb7-87f4da784922 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.553093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 798/1584] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:04 2022] POST /identity/v3/users => generated 287 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:04.554051 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96aad8-f035-491e-9290-60b3c68a5764 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.560024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 787/1585] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:04.560024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16965b79-8112-4192-bc8e-66058496bf17 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.560024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16965b79-8112-4192-bc8e-66058496bf17 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.560024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16965b79-8112-4192-bc8e-66058496bf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.564679 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96aad8-f035-491e-9290-60b3c68a5764 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.570665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcda32-f091-4fd4-a4e2-49bbc19c718b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.571288 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcda32-f091-4fd4-a4e2-49bbc19c718b admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.571578 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcda32-f091-4fd4-a4e2-49bbc19c718b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.571858 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcda32-f091-4fd4-a4e2-49bbc19c718b admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.572492 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcda32-f091-4fd4-a4e2-49bbc19c718b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.574502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfcda32-f091-4fd4-a4e2-49bbc19c718b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.597613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-16965b79-8112-4192-bc8e-66058496bf17 None None] MFA Rules not processed for user `3539784b4e91472eb20addc6707dc30d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:04.598950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-16965b79-8112-4192-bc8e-66058496bf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:04.602764 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 799/1586] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:04 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:04.603764 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcda32-f091-4fd4-a4e2-49bbc19c718b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.674415 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfcda32-f091-4fd4-a4e2-49bbc19c718b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.680127 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 788/1587] 10.222.0.96 () {58 vars in 1059 bytes} [Wed Aug 24 04:31:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:04.680278 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8462e-b273-469e-8358-af0b5348d723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.680674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8462e-b273-469e-8358-af0b5348d723 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.680830 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16965b79-8112-4192-bc8e-66058496bf17 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.680983 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8462e-b273-469e-8358-af0b5348d723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.681265 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8462e-b273-469e-8358-af0b5348d723 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.681988 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8462e-b273-469e-8358-af0b5348d723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.683619 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8462e-b273-469e-8358-af0b5348d723 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.691405 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16965b79-8112-4192-bc8e-66058496bf17 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.695306 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 800/1588] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:04.696176 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8462e-b273-469e-8358-af0b5348d723 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.700231 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9085380-8067-4538-93e2-755eaaf66f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.700887 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9085380-8067-4538-93e2-755eaaf66f9c admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.701171 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9085380-8067-4538-93e2-755eaaf66f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.701454 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9085380-8067-4538-93e2-755eaaf66f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.702118 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9085380-8067-4538-93e2-755eaaf66f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.703728 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9085380-8067-4538-93e2-755eaaf66f9c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.718584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 789/1589] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:04.718584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9085380-8067-4538-93e2-755eaaf66f9c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.718876 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8462e-b273-469e-8358-af0b5348d723 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.725017 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780008e-3af6-48dc-a333-85cdaaf8be11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.726018 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780008e-3af6-48dc-a333-85cdaaf8be11 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.726187 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9085380-8067-4538-93e2-755eaaf66f9c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.726512 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780008e-3af6-48dc-a333-85cdaaf8be11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.727013 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780008e-3af6-48dc-a333-85cdaaf8be11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.728175 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780008e-3af6-48dc-a333-85cdaaf8be11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.730845 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70775d-0e68-4bfc-ac21-3c4e7c2afbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.731240 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780008e-3af6-48dc-a333-85cdaaf8be11 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.731440 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70775d-0e68-4bfc-ac21-3c4e7c2afbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.731725 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70775d-0e68-4bfc-ac21-3c4e7c2afbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.731999 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70775d-0e68-4bfc-ac21-3c4e7c2afbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.732638 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70775d-0e68-4bfc-ac21-3c4e7c2afbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.734249 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70775d-0e68-4bfc-ac21-3c4e7c2afbe3 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.745610 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 790/1590] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:04.746449 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70775d-0e68-4bfc-ac21-3c4e7c2afbe3 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.753862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 801/1591] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:04.753862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780008e-3af6-48dc-a333-85cdaaf8be11 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.759371 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70775d-0e68-4bfc-ac21-3c4e7c2afbe3 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.763952 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052a85a-d057-4d46-91d8-aa56d88f9586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.764557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052a85a-d057-4d46-91d8-aa56d88f9586 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.764872 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052a85a-d057-4d46-91d8-aa56d88f9586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.765150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052a85a-d057-4d46-91d8-aa56d88f9586 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.765791 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052a85a-d057-4d46-91d8-aa56d88f9586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.767387 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052a85a-d057-4d46-91d8-aa56d88f9586 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.769007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780008e-3af6-48dc-a333-85cdaaf8be11 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.776552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668927fa-9add-4562-ae0c-2b58ee4ed863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.777709 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668927fa-9add-4562-ae0c-2b58ee4ed863 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.780986 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 791/1592] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:04.781117 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668927fa-9add-4562-ae0c-2b58ee4ed863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.781117 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668927fa-9add-4562-ae0c-2b58ee4ed863 admin admin] PATH_INFO: `/v3/projects/6aa6fb2787a94156b22265026f980067/users/1b58a3839f564119a8403e3685cc4305/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.781302 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052a85a-d057-4d46-91d8-aa56d88f9586 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.790829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052a85a-d057-4d46-91d8-aa56d88f9586 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.795617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3303078-9153-496e-a0a4-3e8daf60e0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.796226 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3303078-9153-496e-a0a4-3e8daf60e0cd admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.796512 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3303078-9153-496e-a0a4-3e8daf60e0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.796830 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3303078-9153-496e-a0a4-3e8daf60e0cd admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.797486 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3303078-9153-496e-a0a4-3e8daf60e0cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.799431 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3303078-9153-496e-a0a4-3e8daf60e0cd admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.804386 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668927fa-9add-4562-ae0c-2b58ee4ed863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa6fb2787a94156b22265026f980067, user_id=1b58a3839f564119a8403e3685cc4305, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.807130 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668927fa-9add-4562-ae0c-2b58ee4ed863 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.827461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 802/1593] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:04 2022] PUT /identity/v3/projects/6aa6fb2787a94156b22265026f980067/users/1b58a3839f564119a8403e3685cc4305/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:04.828461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668927fa-9add-4562-ae0c-2b58ee4ed863 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.828859 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 792/1594] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:04 2022] POST /identity/v3/users => generated 294 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:04.829879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3303078-9153-496e-a0a4-3e8daf60e0cd admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.845800 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3303078-9153-496e-a0a4-3e8daf60e0cd admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.908822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905aaf0a-9398-4745-a621-6580fc772e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.909562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905aaf0a-9398-4745-a621-6580fc772e24 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.909853 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905aaf0a-9398-4745-a621-6580fc772e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.910129 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905aaf0a-9398-4745-a621-6580fc772e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.910790 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905aaf0a-9398-4745-a621-6580fc772e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.912406 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905aaf0a-9398-4745-a621-6580fc772e24 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.922081 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668927fa-9add-4562-ae0c-2b58ee4ed863 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.922824 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 793/1595] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:04.923676 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905aaf0a-9398-4745-a621-6580fc772e24 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.927973 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486bb3f-8b3e-4248-b8fe-0ce509f03e98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.928599 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486bb3f-8b3e-4248-b8fe-0ce509f03e98 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.928928 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486bb3f-8b3e-4248-b8fe-0ce509f03e98 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.929279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486bb3f-8b3e-4248-b8fe-0ce509f03e98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.933827 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905aaf0a-9398-4745-a621-6580fc772e24 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:04.938346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93d11d-b999-4415-ba64-6f1a8d3c52d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:04.938998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93d11d-b999-4415-ba64-6f1a8d3c52d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:04.939287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93d11d-b999-4415-ba64-6f1a8d3c52d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:04.939565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93d11d-b999-4415-ba64-6f1a8d3c52d0 admin admin] PATH_INFO: `/v3/projects/15cc1a2b39a24bef8efc317a855e24df/users/43faacda34454b53aff4892d357b34f7/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:04.949012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:04.959223 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93d11d-b999-4415-ba64-6f1a8d3c52d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15cc1a2b39a24bef8efc317a855e24df, user_id=43faacda34454b53aff4892d357b34f7, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.961996 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93d11d-b999-4415-ba64-6f1a8d3c52d0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:04.968563 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:04.975478 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 794/1596] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:04 2022] PUT /identity/v3/projects/15cc1a2b39a24bef8efc317a855e24df/users/43faacda34454b53aff4892d357b34f7/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:04.976724 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93d11d-b999-4415-ba64-6f1a8d3c52d0 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:04.995918 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486bb3f-8b3e-4248-b8fe-0ce509f03e98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:04.997631 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486bb3f-8b3e-4248-b8fe-0ce509f03e98 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:05.008302 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 803/1597] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:05.009180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486bb3f-8b3e-4248-b8fe-0ce509f03e98 service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:05.021061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486bb3f-8b3e-4248-b8fe-0ce509f03e98 service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:05.060223 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93d11d-b999-4415-ba64-6f1a8d3c52d0 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:05.066244 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933826f-84c3-480c-bf78-353cb8bf4dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:05.067350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933826f-84c3-480c-bf78-353cb8bf4dfc admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:05.067647 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933826f-84c3-480c-bf78-353cb8bf4dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:05.067924 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933826f-84c3-480c-bf78-353cb8bf4dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:05.068593 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933826f-84c3-480c-bf78-353cb8bf4dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:05.070251 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933826f-84c3-480c-bf78-353cb8bf4dfc admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:05.085604 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 795/1598] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:05.085604 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933826f-84c3-480c-bf78-353cb8bf4dfc admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:05.093268 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933826f-84c3-480c-bf78-353cb8bf4dfc admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:05.094411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e51a0-1867-4338-91e1-9f9090d1e154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:05.095446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e51a0-1867-4338-91e1-9f9090d1e154 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:05.095975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e51a0-1867-4338-91e1-9f9090d1e154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:05.096523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e51a0-1867-4338-91e1-9f9090d1e154 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:05.098121 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e51a0-1867-4338-91e1-9f9090d1e154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:05.098429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542516aa-e934-410f-8595-c1c97b1c7ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:05.099040 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542516aa-e934-410f-8595-c1c97b1c7ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:05.099329 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542516aa-e934-410f-8595-c1c97b1c7ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:05.099616 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542516aa-e934-410f-8595-c1c97b1c7ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:05.100264 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542516aa-e934-410f-8595-c1c97b1c7ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:05.101017 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e51a0-1867-4338-91e1-9f9090d1e154 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:05.101899 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542516aa-e934-410f-8595-c1c97b1c7ad4 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:05.114351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 804/1599] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:05.115072 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e51a0-1867-4338-91e1-9f9090d1e154 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:05.115503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 796/1600] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:05.117026 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062bc0f-6b67-4c51-93b0-3ba938bf06c3 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:05.117318 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062bc0f-6b67-4c51-93b0-3ba938bf06c3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:05.117592 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062bc0f-6b67-4c51-93b0-3ba938bf06c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:05.127561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e51a0-1867-4338-91e1-9f9090d1e154 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:05.132820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cdd08-0665-4250-873a-2c5b8677799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:05.133443 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cdd08-0665-4250-873a-2c5b8677799a admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:05.133729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cdd08-0665-4250-873a-2c5b8677799a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:05.134006 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cdd08-0665-4250-873a-2c5b8677799a admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:05.134659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cdd08-0665-4250-873a-2c5b8677799a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:05.136286 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cdd08-0665-4250-873a-2c5b8677799a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:05.147756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 805/1601] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:05.149819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cdd08-0665-4250-873a-2c5b8677799a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:05.155748 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a062bc0f-6b67-4c51-93b0-3ba938bf06c3 None None] MFA Rules not processed for user `1b58a3839f564119a8403e3685cc4305`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:05.157829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a062bc0f-6b67-4c51-93b0-3ba938bf06c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:05.163207 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cdd08-0665-4250-873a-2c5b8677799a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:05.168654 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980dfa5-6962-4c91-b5f9-7b8c208ce406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:05.169357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980dfa5-6962-4c91-b5f9-7b8c208ce406 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:05.169644 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980dfa5-6962-4c91-b5f9-7b8c208ce406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:05.169920 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980dfa5-6962-4c91-b5f9-7b8c208ce406 admin admin] PATH_INFO: `/v3/projects/ff4d3b11017c450b98f0b886cb1df9a9/users/eb1e6a4cdfac4210933fe91c1bf0cdec/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:05.186453 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980dfa5-6962-4c91-b5f9-7b8c208ce406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff4d3b11017c450b98f0b886cb1df9a9, user_id=eb1e6a4cdfac4210933fe91c1bf0cdec, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:05.189321 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980dfa5-6962-4c91-b5f9-7b8c208ce406 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:05.205224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 806/1602] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:05 2022] PUT /identity/v3/projects/ff4d3b11017c450b98f0b886cb1df9a9/users/eb1e6a4cdfac4210933fe91c1bf0cdec/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:05.207214 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf5e70-401e-4497-982a-13e8f6840245 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:05.207601 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf5e70-401e-4497-982a-13e8f6840245 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:05.207977 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf5e70-401e-4497-982a-13e8f6840245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:05.242734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-28cf5e70-401e-4497-982a-13e8f6840245 None None] MFA Rules not processed for user `43faacda34454b53aff4892d357b34f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:05.244155 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-28cf5e70-401e-4497-982a-13e8f6840245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:05.249526 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 797/1603] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:05.254624 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062bc0f-6b67-4c51-93b0-3ba938bf06c3 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:05.265456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062bc0f-6b67-4c51-93b0-3ba938bf06c3 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:05.315097 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 807/1604] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:05.316903 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf5e70-401e-4497-982a-13e8f6840245 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:05.330389 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e28cb7-6133-4680-8f6f-825ee1ccdd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:05.331159 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e28cb7-6133-4680-8f6f-825ee1ccdd15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:05.332280 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e28cb7-6133-4680-8f6f-825ee1ccdd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:05.332556 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e28cb7-6133-4680-8f6f-825ee1ccdd15 admin admin] PATH_INFO: `/v3/projects/2f6c3ac4d44848cb8f6cccbeb080e6d4/users/340f60f0efd54b1db12c6b08cb794a84/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:05.336256 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:05.350291 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:05.350534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e28cb7-6133-4680-8f6f-825ee1ccdd15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6c3ac4d44848cb8f6cccbeb080e6d4, user_id=340f60f0efd54b1db12c6b08cb794a84, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:05.353323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e28cb7-6133-4680-8f6f-825ee1ccdd15 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:05.368120 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 798/1605] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:05 2022] PUT /identity/v3/projects/2f6c3ac4d44848cb8f6cccbeb080e6d4/users/340f60f0efd54b1db12c6b08cb794a84/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:05.368968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e28cb7-6133-4680-8f6f-825ee1ccdd15 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:05.386750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf5e70-401e-4497-982a-13e8f6840245 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:05.436673 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e28cb7-6133-4680-8f6f-825ee1ccdd15 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:05.441452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bebf9-b93b-46ab-b66b-11d7d53fcb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:05.442239 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bebf9-b93b-46ab-b66b-11d7d53fcb5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:05.442525 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bebf9-b93b-46ab-b66b-11d7d53fcb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:05.442806 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8bebf9-b93b-46ab-b66b-11d7d53fcb5e admin admin] PATH_INFO: `/v3/projects/ff0a9e8cbf06404a8f1ad645c037e763/users/c0a2c80ee21c45af9028106a50db4791/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:05.447029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2e714-b54a-4786-95ae-afaf7be3917d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:05.447739 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2e714-b54a-4786-95ae-afaf7be3917d admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:05.448023 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2e714-b54a-4786-95ae-afaf7be3917d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:05.448301 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2e714-b54a-4786-95ae-afaf7be3917d admin admin] PATH_INFO: `/v3/projects/a17dbdfccf5b422ba3dd14a812555966/users/880398bb54f24491899ad3cc0b8d15cf/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:05.459446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bebf9-b93b-46ab-b66b-11d7d53fcb5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff0a9e8cbf06404a8f1ad645c037e763, user_id=c0a2c80ee21c45af9028106a50db4791, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:05.462273 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8bebf9-b93b-46ab-b66b-11d7d53fcb5e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:05.463974 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2e714-b54a-4786-95ae-afaf7be3917d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a17dbdfccf5b422ba3dd14a812555966, user_id=880398bb54f24491899ad3cc0b8d15cf, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:05.466695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2e714-b54a-4786-95ae-afaf7be3917d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:05.478301 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 799/1606] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:05 2022] PUT /identity/v3/projects/ff0a9e8cbf06404a8f1ad645c037e763/users/c0a2c80ee21c45af9028106a50db4791/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:05.479203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bebf9-b93b-46ab-b66b-11d7d53fcb5e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:05.481270 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 808/1607] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:05 2022] PUT /identity/v3/projects/a17dbdfccf5b422ba3dd14a812555966/users/880398bb54f24491899ad3cc0b8d15cf/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:05.482624 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb94b5f-7484-4617-af91-520449e022bf None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:05.483018 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb94b5f-7484-4617-af91-520449e022bf None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:05.483370 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb94b5f-7484-4617-af91-520449e022bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:05.516546 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2cb94b5f-7484-4617-af91-520449e022bf None None] MFA Rules not processed for user `eb1e6a4cdfac4210933fe91c1bf0cdec`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:05.518076 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2cb94b5f-7484-4617-af91-520449e022bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:05.554911 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8bebf9-b93b-46ab-b66b-11d7d53fcb5e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:05.586333 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 809/1608] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:05.587394 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb94b5f-7484-4617-af91-520449e022bf None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:05.624863 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497f7e4-6486-48ca-b6e9-cf84e5d00116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:05.625680 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497f7e4-6486-48ca-b6e9-cf84e5d00116 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:05.626015 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497f7e4-6486-48ca-b6e9-cf84e5d00116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:05.626340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497f7e4-6486-48ca-b6e9-cf84e5d00116 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:05.627108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497f7e4-6486-48ca-b6e9-cf84e5d00116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:05.629031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497f7e4-6486-48ca-b6e9-cf84e5d00116 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:05.639815 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 800/1609] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:05.641154 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363bb40-9374-4c2f-b283-4242ca081f0e None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:05.641449 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363bb40-9374-4c2f-b283-4242ca081f0e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:05.641731 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363bb40-9374-4c2f-b283-4242ca081f0e None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:05.643284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 801/1610] 10.222.0.96 () {54 vars in 912 bytes} [Wed Aug 24 04:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:31:05.644282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363bb40-9374-4c2f-b283-4242ca081f0e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:05.658910 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363bb40-9374-4c2f-b283-4242ca081f0e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:05.660854 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:05.665814 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b77519-d192-40e7-a1bb-4ac7b4647a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:05.666450 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b77519-d192-40e7-a1bb-4ac7b4647a33 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:05.666727 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b77519-d192-40e7-a1bb-4ac7b4647a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:05.666999 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b77519-d192-40e7-a1bb-4ac7b4647a33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:05.667768 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b77519-d192-40e7-a1bb-4ac7b4647a33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:05.669746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b77519-d192-40e7-a1bb-4ac7b4647a33 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:05.681393 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:05.688936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb94b5f-7484-4617-af91-520449e022bf None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:05.694070 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352159f0-446c-4136-afa5-a32cbc8924a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:05.694724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352159f0-446c-4136-afa5-a32cbc8924a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:05.695008 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352159f0-446c-4136-afa5-a32cbc8924a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:05.695287 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352159f0-446c-4136-afa5-a32cbc8924a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:05.695924 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352159f0-446c-4136-afa5-a32cbc8924a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:05.697915 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352159f0-446c-4136-afa5-a32cbc8924a4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:05.705770 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 802/1611] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:05 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:05.705770 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f774878-5397-4fba-ae53-a280a5458ac2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:05.705770 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f774878-5397-4fba-ae53-a280a5458ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:05.705770 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f774878-5397-4fba-ae53-a280a5458ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:05.725507 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-5f774878-5397-4fba-ae53-a280a5458ac2 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:05.726835 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5f774878-5397-4fba-ae53-a280a5458ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:05.737358 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 810/1612] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:05 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:05.739556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a7319-08af-44eb-8537-1ba32fcb5d85 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:05.739843 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a7319-08af-44eb-8537-1ba32fcb5d85 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:05.740118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a7319-08af-44eb-8537-1ba32fcb5d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:05.763677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d52a7319-08af-44eb-8537-1ba32fcb5d85 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:05.764953 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d52a7319-08af-44eb-8537-1ba32fcb5d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:05.803795 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 803/1613] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:05.803795 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd0086-f2be-4b37-8c46-ae6435e14e6b None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:05.803795 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd0086-f2be-4b37-8c46-ae6435e14e6b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:05.803795 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd0086-f2be-4b37-8c46-ae6435e14e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:05.838944 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a6bd0086-f2be-4b37-8c46-ae6435e14e6b None None] MFA Rules not processed for user `880398bb54f24491899ad3cc0b8d15cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:05.840209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a6bd0086-f2be-4b37-8c46-ae6435e14e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:05.842883 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 811/1614] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:05.843113 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e5f45-e699-4eb6-b445-5714fa9dd87d None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:05.843415 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e5f45-e699-4eb6-b445-5714fa9dd87d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:05.843697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e5f45-e699-4eb6-b445-5714fa9dd87d None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:05.845027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 812/1615] 10.222.0.96 () {54 vars in 962 bytes} [Wed Aug 24 04:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:31:05.845731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e5f45-e699-4eb6-b445-5714fa9dd87d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:05.859507 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e5f45-e699-4eb6-b445-5714fa9dd87d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:05.864589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b05fa-8b3e-49a5-a343-cc657ff2d479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:05.865304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b05fa-8b3e-49a5-a343-cc657ff2d479 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:05.865590 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b05fa-8b3e-49a5-a343-cc657ff2d479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:05.865872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b05fa-8b3e-49a5-a343-cc657ff2d479 admin admin] PATH_INFO: `/v3/projects/fdb28ea39dab4188b02b498378fe37d6/users/eb97bbb6260a45f3bfeb404b8c9fa815/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:05.884425 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b05fa-8b3e-49a5-a343-cc657ff2d479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb28ea39dab4188b02b498378fe37d6, user_id=eb97bbb6260a45f3bfeb404b8c9fa815, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:05.887208 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b05fa-8b3e-49a5-a343-cc657ff2d479 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:05.903299 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 813/1616] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:05 2022] PUT /identity/v3/projects/fdb28ea39dab4188b02b498378fe37d6/users/eb97bbb6260a45f3bfeb404b8c9fa815/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:05.904952 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dc0bb-a796-442c-be44-7f197eb295ad None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:05.905245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dc0bb-a796-442c-be44-7f197eb295ad None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:05.905526 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dc0bb-a796-442c-be44-7f197eb295ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:05.924850 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 804/1617] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:05.926556 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd0086-f2be-4b37-8c46-ae6435e14e6b None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:05.932376 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-764dc0bb-a796-442c-be44-7f197eb295ad None None] MFA Rules not processed for user `3539784b4e91472eb20addc6707dc30d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:05.934447 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-764dc0bb-a796-442c-be44-7f197eb295ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:05.944260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd0086-f2be-4b37-8c46-ae6435e14e6b None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:06.006072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac38a5-97f4-436d-9983-8732063caa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:06.007129 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac38a5-97f4-436d-9983-8732063caa73 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:06.007499 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac38a5-97f4-436d-9983-8732063caa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:06.007884 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac38a5-97f4-436d-9983-8732063caa73 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:06.008719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac38a5-97f4-436d-9983-8732063caa73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:06.011262 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac38a5-97f4-436d-9983-8732063caa73 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:06.016562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 814/1618] 10.222.0.96 () {58 vars in 1009 bytes} [Wed Aug 24 04:31:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:06.017247 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dc0bb-a796-442c-be44-7f197eb295ad None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:06.030287 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dc0bb-a796-442c-be44-7f197eb295ad None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:06.036914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec0c11-594a-4537-bd52-bb4334d7d8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:06.037569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 805/1619] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:05 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:06.037929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec0c11-594a-4537-bd52-bb4334d7d8fb admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:06.038272 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec0c11-594a-4537-bd52-bb4334d7d8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:06.038757 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac38a5-97f4-436d-9983-8732063caa73 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:06.038875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec0c11-594a-4537-bd52-bb4334d7d8fb admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:06.039289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec0c11-594a-4537-bd52-bb4334d7d8fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:06.041603 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec0c11-594a-4537-bd52-bb4334d7d8fb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:06.051777 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:06.064872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 815/1620] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:06 2022] POST /identity/v3/users => generated 296 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:06.066350 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba71bd-6723-4d7b-a4aa-f4631adbe6d0 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:06.066643 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba71bd-6723-4d7b-a4aa-f4631adbe6d0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:06.067038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba71bd-6723-4d7b-a4aa-f4631adbe6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:06.092126 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a4ba71bd-6723-4d7b-a4aa-f4631adbe6d0 None None] MFA Rules not processed for user `3539784b4e91472eb20addc6707dc30d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:06.093407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a4ba71bd-6723-4d7b-a4aa-f4631adbe6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:06.103777 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac38a5-97f4-436d-9983-8732063caa73 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:06.104919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 816/1621] 10.222.0.96 () {58 vars in 1059 bytes} [Wed Aug 24 04:31:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:06.105834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba71bd-6723-4d7b-a4aa-f4631adbe6d0 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:06.107743 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f11f8-646d-4fe6-8dfa-433f30fdcb5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:06.108362 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f11f8-646d-4fe6-8dfa-433f30fdcb5d service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:06.108649 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f11f8-646d-4fe6-8dfa-433f30fdcb5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:06.108962 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f11f8-646d-4fe6-8dfa-433f30fdcb5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:06.115162 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba71bd-6723-4d7b-a4aa-f4631adbe6d0 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:06.119128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbee777-579f-49e1-ac59-9b9da6088869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:06.119675 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f11f8-646d-4fe6-8dfa-433f30fdcb5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:06.119820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbee777-579f-49e1-ac59-9b9da6088869 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:06.120050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbee777-579f-49e1-ac59-9b9da6088869 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:06.120330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbee777-579f-49e1-ac59-9b9da6088869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:06.121420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f11f8-646d-4fe6-8dfa-433f30fdcb5d service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:06.131405 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbee777-579f-49e1-ac59-9b9da6088869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:06.132782 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 806/1622] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:06.132922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbee777-579f-49e1-ac59-9b9da6088869 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:06.135016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cf88d-65c6-4595-ac62-8cf4eb0176f3 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:06.135501 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cf88d-65c6-4595-ac62-8cf4eb0176f3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:06.136037 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cf88d-65c6-4595-ac62-8cf4eb0176f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:06.146359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 817/1623] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:06.148775 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbee777-579f-49e1-ac59-9b9da6088869 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:06.157245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:06.161576 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-1c1cf88d-65c6-4595-ac62-8cf4eb0176f3 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:06.162940 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1c1cf88d-65c6-4595-ac62-8cf4eb0176f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:06.175479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 807/1624] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:06.175479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cf88d-65c6-4595-ac62-8cf4eb0176f3 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:06.187207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cf88d-65c6-4595-ac62-8cf4eb0176f3 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:06.193230 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7afc0-f185-4f8b-91e2-a4eafdad1bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:06.194293 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7afc0-f185-4f8b-91e2-a4eafdad1bde admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:06.194595 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7afc0-f185-4f8b-91e2-a4eafdad1bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:06.194968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7afc0-f185-4f8b-91e2-a4eafdad1bde admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:06.195796 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7afc0-f185-4f8b-91e2-a4eafdad1bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:06.197648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7afc0-f185-4f8b-91e2-a4eafdad1bde admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:06.221212 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 808/1625] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:06.221212 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7afc0-f185-4f8b-91e2-a4eafdad1bde admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:06.235103 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7afc0-f185-4f8b-91e2-a4eafdad1bde admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:06.240542 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b4f3f-e096-4684-be41-4df8a9415b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:06.241405 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b4f3f-e096-4684-be41-4df8a9415b4d admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:06.241689 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b4f3f-e096-4684-be41-4df8a9415b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:06.242040 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b4f3f-e096-4684-be41-4df8a9415b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:06.242767 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b4f3f-e096-4684-be41-4df8a9415b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:06.244470 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b4f3f-e096-4684-be41-4df8a9415b4d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:06.248581 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbee777-579f-49e1-ac59-9b9da6088869 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:06.253525 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714d8c9-5856-462a-9889-154208b306f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:06.254468 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714d8c9-5856-462a-9889-154208b306f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:06.254468 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714d8c9-5856-462a-9889-154208b306f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:06.254841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714d8c9-5856-462a-9889-154208b306f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:06.258187 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 809/1626] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:06.258968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b4f3f-e096-4684-be41-4df8a9415b4d admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:06.270621 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714d8c9-5856-462a-9889-154208b306f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:06.272095 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714d8c9-5856-462a-9889-154208b306f3 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:06.274925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b4f3f-e096-4684-be41-4df8a9415b4d admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:06.283791 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149096a-c4d7-4c9f-ad91-3cf1f1f2899a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:06.285291 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149096a-c4d7-4c9f-ad91-3cf1f1f2899a service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:06.285708 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149096a-c4d7-4c9f-ad91-3cf1f1f2899a service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:06.286017 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149096a-c4d7-4c9f-ad91-3cf1f1f2899a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:06.287099 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 818/1627] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:06.288928 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714d8c9-5856-462a-9889-154208b306f3 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:06.290374 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f714d8c9-5856-462a-9889-154208b306f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:06.310018 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714d8c9-5856-462a-9889-154208b306f3 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:06.315327 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2922f-0247-4cc6-ae66-548dbb8c2edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:06.317722 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2922f-0247-4cc6-ae66-548dbb8c2edc service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:06.318208 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2922f-0247-4cc6-ae66-548dbb8c2edc service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:06.318657 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2922f-0247-4cc6-ae66-548dbb8c2edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:06.334334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2922f-0247-4cc6-ae66-548dbb8c2edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:06.335901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2922f-0247-4cc6-ae66-548dbb8c2edc service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:06.360935 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 819/1628] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:06.360935 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2922f-0247-4cc6-ae66-548dbb8c2edc service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:06.381679 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2922f-0247-4cc6-ae66-548dbb8c2edc service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:06.382833 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149096a-c4d7-4c9f-ad91-3cf1f1f2899a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:06.386531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7149096a-c4d7-4c9f-ad91-3cf1f1f2899a service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:06.389573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0978ea3-f79e-439b-acef-a5c28eb43dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:06.390327 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0978ea3-f79e-439b-acef-a5c28eb43dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:06.390648 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0978ea3-f79e-439b-acef-a5c28eb43dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:06.390885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0978ea3-f79e-439b-acef-a5c28eb43dd6 admin admin] PATH_INFO: `/v3/projects/4efb4b72a0264c1a9a9659fc84262319/users/bad251995fb64a8bb7397ae30c2d4dec/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:06.420708 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0978ea3-f79e-439b-acef-a5c28eb43dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4efb4b72a0264c1a9a9659fc84262319, user_id=bad251995fb64a8bb7397ae30c2d4dec, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:06.423997 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0978ea3-f79e-439b-acef-a5c28eb43dd6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:06.428313 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 810/1629] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:06.429677 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149096a-c4d7-4c9f-ad91-3cf1f1f2899a service nova] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:06.447329 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149096a-c4d7-4c9f-ad91-3cf1f1f2899a service nova] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:06.450850 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 820/1630] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:06 2022] PUT /identity/v3/projects/4efb4b72a0264c1a9a9659fc84262319/users/bad251995fb64a8bb7397ae30c2d4dec/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:06.451811 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0978ea3-f79e-439b-acef-a5c28eb43dd6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:06.610527 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76f259-9013-470c-8f50-47803a027c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:06.611226 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76f259-9013-470c-8f50-47803a027c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:06.611443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76f259-9013-470c-8f50-47803a027c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:06.611727 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76f259-9013-470c-8f50-47803a027c31 admin admin] PATH_INFO: `/v3/projects/c090c5dd17104ad2ac72d21b2976e116/users/50367ed819364c28918b6deb25d180f0/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:06.613964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0978ea3-f79e-439b-acef-a5c28eb43dd6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:06.620372 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b891274-28c1-48a4-b9eb-44c3b48b348b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:06.621240 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b891274-28c1-48a4-b9eb-44c3b48b348b admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:06.621354 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b891274-28c1-48a4-b9eb-44c3b48b348b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:06.621587 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b891274-28c1-48a4-b9eb-44c3b48b348b admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:06.622530 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b891274-28c1-48a4-b9eb-44c3b48b348b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:06.623851 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b891274-28c1-48a4-b9eb-44c3b48b348b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:06.643009 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 821/1631] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:06.647611 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b891274-28c1-48a4-b9eb-44c3b48b348b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:06.670793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76f259-9013-470c-8f50-47803a027c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c090c5dd17104ad2ac72d21b2976e116, user_id=50367ed819364c28918b6deb25d180f0, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:06.673757 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76f259-9013-470c-8f50-47803a027c31 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:06.700064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b891274-28c1-48a4-b9eb-44c3b48b348b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:06.726310 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 811/1632] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:06 2022] PUT /identity/v3/projects/c090c5dd17104ad2ac72d21b2976e116/users/50367ed819364c28918b6deb25d180f0/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:06.729730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76f259-9013-470c-8f50-47803a027c31 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:06.751366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:06.894659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71910a3a-e5c9-4ebd-9987-30bf5e392713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:06.895532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71910a3a-e5c9-4ebd-9987-30bf5e392713 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:06.895938 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71910a3a-e5c9-4ebd-9987-30bf5e392713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:06.896573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71910a3a-e5c9-4ebd-9987-30bf5e392713 admin admin] PATH_INFO: `/v3/projects/4efb4b72a0264c1a9a9659fc84262319/users/bad251995fb64a8bb7397ae30c2d4dec/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:06.900701 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71910a3a-e5c9-4ebd-9987-30bf5e392713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4efb4b72a0264c1a9a9659fc84262319, user_id=bad251995fb64a8bb7397ae30c2d4dec, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:06.904636 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71910a3a-e5c9-4ebd-9987-30bf5e392713 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:06.913679 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:06.922020 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 822/1633] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:06 2022] PUT /identity/v3/projects/4efb4b72a0264c1a9a9659fc84262319/users/bad251995fb64a8bb7397ae30c2d4dec/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:31:06.924005 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92a8fd-1038-4ce5-b434-ec75329c68a3 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:06.924274 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76f259-9013-470c-8f50-47803a027c31 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:06.924805 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92a8fd-1038-4ce5-b434-ec75329c68a3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:06.925355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92a8fd-1038-4ce5-b434-ec75329c68a3 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:06.927387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 823/1634] 10.222.0.96 () {54 vars in 912 bytes} [Wed Aug 24 04:31:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:31:06.933152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e49b4e-d2c4-4feb-b30a-2cd4493f090d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:06.934234 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e49b4e-d2c4-4feb-b30a-2cd4493f090d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:06.934735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e49b4e-d2c4-4feb-b30a-2cd4493f090d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:06.973318 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-26e49b4e-d2c4-4feb-b30a-2cd4493f090d None None] MFA Rules not processed for user `bad251995fb64a8bb7397ae30c2d4dec`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:06.975182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-26e49b4e-d2c4-4feb-b30a-2cd4493f090d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:07.022835 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458652e5-f222-434a-ab84-424bd28f67a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:07.024043 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458652e5-f222-434a-ab84-424bd28f67a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:07.024488 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458652e5-f222-434a-ab84-424bd28f67a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:07.025123 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458652e5-f222-434a-ab84-424bd28f67a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:07.026485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458652e5-f222-434a-ab84-424bd28f67a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:07.028436 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458652e5-f222-434a-ab84-424bd28f67a5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:07.045853 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 812/1635] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:07.047914 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2729f-206f-426e-8764-5354030ff345 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:07.048367 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2729f-206f-426e-8764-5354030ff345 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:07.048837 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2729f-206f-426e-8764-5354030ff345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:07.074440 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-cbc2729f-206f-426e-8764-5354030ff345 None None] MFA Rules not processed for user `3539784b4e91472eb20addc6707dc30d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:07.076238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cbc2729f-206f-426e-8764-5354030ff345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:07.085886 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 824/1636] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:31:07.085886 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e49b4e-d2c4-4feb-b30a-2cd4493f090d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:07.101401 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e49b4e-d2c4-4feb-b30a-2cd4493f090d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:07.107756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e48f4-bfaa-48c2-9e85-032b179cc542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:07.108923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e48f4-bfaa-48c2-9e85-032b179cc542 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:07.109504 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e48f4-bfaa-48c2-9e85-032b179cc542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:07.109896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e48f4-bfaa-48c2-9e85-032b179cc542 admin admin] PATH_INFO: `/v3/projects/c090c5dd17104ad2ac72d21b2976e116/users/50367ed819364c28918b6deb25d180f0/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:07.114012 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e48f4-bfaa-48c2-9e85-032b179cc542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c090c5dd17104ad2ac72d21b2976e116, user_id=50367ed819364c28918b6deb25d180f0, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:07.121280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e48f4-bfaa-48c2-9e85-032b179cc542 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:07.157353 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 825/1637] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:07 2022] PUT /identity/v3/projects/c090c5dd17104ad2ac72d21b2976e116/users/50367ed819364c28918b6deb25d180f0/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:07.157353 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e48f4-bfaa-48c2-9e85-032b179cc542 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:07.209086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 813/1638] 10.222.0.96 () {58 vars in 1009 bytes} [Wed Aug 24 04:31:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:07.210661 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca91ae-7da9-462c-b88d-7d484188ef97 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:07.210955 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca91ae-7da9-462c-b88d-7d484188ef97 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:07.211314 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca91ae-7da9-462c-b88d-7d484188ef97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:07.282090 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-3eca91ae-7da9-462c-b88d-7d484188ef97 None None] MFA Rules not processed for user `50367ed819364c28918b6deb25d180f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:07.285370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3eca91ae-7da9-462c-b88d-7d484188ef97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:07.329980 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e48f4-bfaa-48c2-9e85-032b179cc542 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:07.338499 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719f064-f2dd-4cec-a9a1-43f89626f036 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:07.340681 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719f064-f2dd-4cec-a9a1-43f89626f036 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:07.341169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719f064-f2dd-4cec-a9a1-43f89626f036 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:07.342130 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719f064-f2dd-4cec-a9a1-43f89626f036 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:07.345777 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:07.410474 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 814/1639] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:07 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:07.410474 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca91ae-7da9-462c-b88d-7d484188ef97 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:07.420794 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca91ae-7da9-462c-b88d-7d484188ef97 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:07.427369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9aeb5c-4a48-4534-84a0-ebf2c49f96cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:07.428352 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9aeb5c-4a48-4534-84a0-ebf2c49f96cc service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:07.428493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9aeb5c-4a48-4534-84a0-ebf2c49f96cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:07.428727 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9aeb5c-4a48-4534-84a0-ebf2c49f96cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:07.445380 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719f064-f2dd-4cec-a9a1-43f89626f036 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:07.447723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719f064-f2dd-4cec-a9a1-43f89626f036 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:07.461711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 826/1640] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:07.572910 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9aeb5c-4a48-4534-84a0-ebf2c49f96cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:07.575455 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9aeb5c-4a48-4534-84a0-ebf2c49f96cc service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:07.605066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 815/1641] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:07.720615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9aeb5c-4a48-4534-84a0-ebf2c49f96cc service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:07.725568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719f064-f2dd-4cec-a9a1-43f89626f036 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:07.754222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9aeb5c-4a48-4534-84a0-ebf2c49f96cc service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:07.769592 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074984e5-0f74-4df7-8a91-c95b85b15338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:07.769865 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719f064-f2dd-4cec-a9a1-43f89626f036 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:07.773388 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074984e5-0f74-4df7-8a91-c95b85b15338 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:07.774271 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074984e5-0f74-4df7-8a91-c95b85b15338 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:07.775578 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074984e5-0f74-4df7-8a91-c95b85b15338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:07.782895 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342a27b-eabc-44f0-940f-773c5bc2920e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:07.783537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342a27b-eabc-44f0-940f-773c5bc2920e service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:07.783825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342a27b-eabc-44f0-940f-773c5bc2920e service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:07.784112 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342a27b-eabc-44f0-940f-773c5bc2920e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:07.816912 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074984e5-0f74-4df7-8a91-c95b85b15338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:07.821639 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074984e5-0f74-4df7-8a91-c95b85b15338 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:07.836159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:07.866554 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 816/1642] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:07.940230 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342a27b-eabc-44f0-940f-773c5bc2920e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:07.942480 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342a27b-eabc-44f0-940f-773c5bc2920e service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:07.986025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 827/1643] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:08.275297 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074984e5-0f74-4df7-8a91-c95b85b15338 service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:08.299350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074984e5-0f74-4df7-8a91-c95b85b15338 service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:08.308126 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f55e61-2110-450d-875e-781d068e96f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:08.312431 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f55e61-2110-450d-875e-781d068e96f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:08.313030 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f55e61-2110-450d-875e-781d068e96f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:08.314114 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f55e61-2110-450d-875e-781d068e96f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:08.508780 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f55e61-2110-450d-875e-781d068e96f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:08.510562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f55e61-2110-450d-875e-781d068e96f2 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:08.550293 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 817/1644] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:08.758025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342a27b-eabc-44f0-940f-773c5bc2920e service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:09.042720 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342a27b-eabc-44f0-940f-773c5bc2920e service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:09.054386 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c840ddd-fde7-40ad-81f3-eb235116b5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:09.055414 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c840ddd-fde7-40ad-81f3-eb235116b5dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:09.056185 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c840ddd-fde7-40ad-81f3-eb235116b5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:09.058734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c840ddd-fde7-40ad-81f3-eb235116b5dc admin admin] PATH_INFO: `/v3/users/880398bb54f24491899ad3cc0b8d15cf` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:09.062573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c840ddd-fde7-40ad-81f3-eb235116b5dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=880398bb54f24491899ad3cc0b8d15cf)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:09.065188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: WARNING py.warnings [None req-8c840ddd-fde7-40ad-81f3-eb235116b5dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:31:09.065188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: warnings.warn(msg) Aug 24 04:31:09.065188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: Aug 24 04:31:09.068739 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c840ddd-fde7-40ad-81f3-eb235116b5dc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:09.223910 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8c840ddd-fde7-40ad-81f3-eb235116b5dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '880398bb54f24491899ad3cc0b8d15cf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:09.226075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8c840ddd-fde7-40ad-81f3-eb235116b5dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '880398bb54f24491899ad3cc0b8d15cf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:09.249903 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8c840ddd-fde7-40ad-81f3-eb235116b5dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '880398bb54f24491899ad3cc0b8d15cf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:09.251331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8c840ddd-fde7-40ad-81f3-eb235116b5dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '880398bb54f24491899ad3cc0b8d15cf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:09.305213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8c840ddd-fde7-40ad-81f3-eb235116b5dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '880398bb54f24491899ad3cc0b8d15cf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:09.343350 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 828/1645] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:08 2022] DELETE /identity/v3/users/880398bb54f24491899ad3cc0b8d15cf => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:09.352862 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b6f76-9c83-4667-bfaf-bf14e953b762 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:09.353902 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b6f76-9c83-4667-bfaf-bf14e953b762 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:09.354335 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b6f76-9c83-4667-bfaf-bf14e953b762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:09.384390 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a32b6f76-9c83-4667-bfaf-bf14e953b762 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:09.386052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a32b6f76-9c83-4667-bfaf-bf14e953b762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:09.461400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:09.538793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 818/1646] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:09.570957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c840ddd-fde7-40ad-81f3-eb235116b5dc admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:09.571074 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8c840ddd-fde7-40ad-81f3-eb235116b5dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:09.748491 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:09.766545 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c840ddd-fde7-40ad-81f3-eb235116b5dc admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:09.782508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eeb3aa-6e5e-428d-9f79-8e1c8be5bb8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:09.783673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeb3aa-6e5e-428d-9f79-8e1c8be5bb8d service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:09.784163 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeb3aa-6e5e-428d-9f79-8e1c8be5bb8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:09.785521 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeb3aa-6e5e-428d-9f79-8e1c8be5bb8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:09.807124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eeb3aa-6e5e-428d-9f79-8e1c8be5bb8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:09.811387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eeb3aa-6e5e-428d-9f79-8e1c8be5bb8d service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:09.840316 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 829/1647] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:11.179072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b6f76-9c83-4667-bfaf-bf14e953b762 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:11.181758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a32b6f76-9c83-4667-bfaf-bf14e953b762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:11.232895 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b6f76-9c83-4667-bfaf-bf14e953b762 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:11.251927 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bebf9-5797-459e-83d8-e71867e93c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:11.255768 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bebf9-5797-459e-83d8-e71867e93c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:11.256157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bebf9-5797-459e-83d8-e71867e93c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:11.256983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bebf9-5797-459e-83d8-e71867e93c45 admin admin] PATH_INFO: `/v3/users/f8861943f9ec47e2a0fb1d386851a909` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:11.258900 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13bebf9-5797-459e-83d8-e71867e93c45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8861943f9ec47e2a0fb1d386851a909)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:11.262488 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13bebf9-5797-459e-83d8-e71867e93c45 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:11.353596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eeb3aa-6e5e-428d-9f79-8e1c8be5bb8d service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:11.357781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b7eeb3aa-6e5e-428d-9f79-8e1c8be5bb8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:11.418509 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eeb3aa-6e5e-428d-9f79-8e1c8be5bb8d service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:11.433252 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdb6e3-da91-4d41-96e9-28b1b1de1d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:11.439945 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdb6e3-da91-4d41-96e9-28b1b1de1d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:11.441960 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdb6e3-da91-4d41-96e9-28b1b1de1d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:11.442636 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdb6e3-da91-4d41-96e9-28b1b1de1d9a admin admin] PATH_INFO: `/v3/projects/a17dbdfccf5b422ba3dd14a812555966` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:11.444989 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdb6e3-da91-4d41-96e9-28b1b1de1d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a17dbdfccf5b422ba3dd14a812555966)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:11.447555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdb6e3-da91-4d41-96e9-28b1b1de1d9a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:11.491969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e13bebf9-5797-459e-83d8-e71867e93c45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8861943f9ec47e2a0fb1d386851a909'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:11.492429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e13bebf9-5797-459e-83d8-e71867e93c45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8861943f9ec47e2a0fb1d386851a909'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:11.527476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e13bebf9-5797-459e-83d8-e71867e93c45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8861943f9ec47e2a0fb1d386851a909'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:11.528643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e13bebf9-5797-459e-83d8-e71867e93c45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8861943f9ec47e2a0fb1d386851a909'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:11.552861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e13bebf9-5797-459e-83d8-e71867e93c45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8861943f9ec47e2a0fb1d386851a909'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:11.600816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 819/1648] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:11 2022] DELETE /identity/v3/users/f8861943f9ec47e2a0fb1d386851a909 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:11.605705 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae51bfa-034d-49e7-b419-a7368705b4bf None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:11.606220 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae51bfa-034d-49e7-b419-a7368705b4bf None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:11.609851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae51bfa-034d-49e7-b419-a7368705b4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:11.669990 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f9cdb6e3-da91-4d41-96e9-28b1b1de1d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a17dbdfccf5b422ba3dd14a812555966', 'request_id': 'req-f9cdb6e3-da91-4d41-96e9-28b1b1de1d9a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:11.697275 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f9cdb6e3-da91-4d41-96e9-28b1b1de1d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a17dbdfccf5b422ba3dd14a812555966', 'request_id': 'req-f9cdb6e3-da91-4d41-96e9-28b1b1de1d9a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:11.714840 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f9cdb6e3-da91-4d41-96e9-28b1b1de1d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a17dbdfccf5b422ba3dd14a812555966', 'request_id': 'req-f9cdb6e3-da91-4d41-96e9-28b1b1de1d9a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:11.729777 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-3ae51bfa-034d-49e7-b419-a7368705b4bf None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:11.729777 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3ae51bfa-034d-49e7-b419-a7368705b4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:11.753519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f9cdb6e3-da91-4d41-96e9-28b1b1de1d9a admin admin] The token cache is being invalidate because project a17dbdfccf5b422ba3dd14a812555966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:11.754122 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f9cdb6e3-da91-4d41-96e9-28b1b1de1d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:11.757776 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f9cdb6e3-da91-4d41-96e9-28b1b1de1d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:11.759574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 830/1649] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:11 2022] DELETE /identity/v3/projects/a17dbdfccf5b422ba3dd14a812555966 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:11.764897 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50e9ae-e226-4ceb-b959-844565c1793e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:11.765187 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50e9ae-e226-4ceb-b959-844565c1793e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:11.765465 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50e9ae-e226-4ceb-b959-844565c1793e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:11.818004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9b50e9ae-e226-4ceb-b959-844565c1793e None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:11.818004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9b50e9ae-e226-4ceb-b959-844565c1793e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:11.897651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 820/1650] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:11.915004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae51bfa-034d-49e7-b419-a7368705b4bf None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:11.917514 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3ae51bfa-034d-49e7-b419-a7368705b4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:12.095906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:12.103124 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae51bfa-034d-49e7-b419-a7368705b4bf None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:12.110072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac261bb-a391-4a60-861e-4864df222725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:12.111210 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac261bb-a391-4a60-861e-4864df222725 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:12.111837 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac261bb-a391-4a60-861e-4864df222725 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:12.112293 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac261bb-a391-4a60-861e-4864df222725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:12.127853 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 831/1651] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:12.132017 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac261bb-a391-4a60-861e-4864df222725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:12.133627 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac261bb-a391-4a60-861e-4864df222725 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:12.143170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50e9ae-e226-4ceb-b959-844565c1793e None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:12.148899 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9b50e9ae-e226-4ceb-b959-844565c1793e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:12.153680 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 821/1652] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:12.155483 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3189bf-70d4-4e27-bb18-bd4f899aee7f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:12.155781 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3189bf-70d4-4e27-bb18-bd4f899aee7f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:12.156071 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3189bf-70d4-4e27-bb18-bd4f899aee7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:12.186524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9a3189bf-70d4-4e27-bb18-bd4f899aee7f None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:12.188697 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9a3189bf-70d4-4e27-bb18-bd4f899aee7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:12.199754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 822/1653] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:12.204755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50e9ae-e226-4ceb-b959-844565c1793e None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:12.207142 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3189bf-70d4-4e27-bb18-bd4f899aee7f None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:12.232473 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fecfd6-e682-4ade-9bca-b6d340c6fbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:12.233691 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fecfd6-e682-4ade-9bca-b6d340c6fbaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:12.234255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fecfd6-e682-4ade-9bca-b6d340c6fbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:12.234904 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fecfd6-e682-4ade-9bca-b6d340c6fbaa admin admin] PATH_INFO: `/v3/users/43faacda34454b53aff4892d357b34f7` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:12.238525 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3189bf-70d4-4e27-bb18-bd4f899aee7f None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:12.239679 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fecfd6-e682-4ade-9bca-b6d340c6fbaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=43faacda34454b53aff4892d357b34f7)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:12.244995 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fecfd6-e682-4ade-9bca-b6d340c6fbaa admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:12.260633 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2bb05-857b-4a37-bdaf-387e8335880b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:12.261334 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2bb05-857b-4a37-bdaf-387e8335880b admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:12.261787 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2bb05-857b-4a37-bdaf-387e8335880b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:12.262221 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2bb05-857b-4a37-bdaf-387e8335880b admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:12.263047 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2bb05-857b-4a37-bdaf-387e8335880b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:12.263519 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2bb05-857b-4a37-bdaf-387e8335880b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:12.265421 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2bb05-857b-4a37-bdaf-387e8335880b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:12.299555 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 823/1654] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:31:12.301759 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2bb05-857b-4a37-bdaf-387e8335880b admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:12.327469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2bb05-857b-4a37-bdaf-387e8335880b admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:12.341475 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3301a8f-d055-4c0a-b7fa-9a37e4389954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:12.342423 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3301a8f-d055-4c0a-b7fa-9a37e4389954 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:12.342861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3301a8f-d055-4c0a-b7fa-9a37e4389954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:12.343282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3301a8f-d055-4c0a-b7fa-9a37e4389954 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:12.344079 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3301a8f-d055-4c0a-b7fa-9a37e4389954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:12.346204 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3301a8f-d055-4c0a-b7fa-9a37e4389954 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:12.374085 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-31fecfd6-e682-4ade-9bca-b6d340c6fbaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43faacda34454b53aff4892d357b34f7'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:12.376677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-31fecfd6-e682-4ade-9bca-b6d340c6fbaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43faacda34454b53aff4892d357b34f7'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:12.397830 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-31fecfd6-e682-4ade-9bca-b6d340c6fbaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43faacda34454b53aff4892d357b34f7'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:12.399253 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-31fecfd6-e682-4ade-9bca-b6d340c6fbaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43faacda34454b53aff4892d357b34f7'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:12.414155 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:12.436406 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 824/1655] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:12 2022] POST /identity/v3/projects => generated 353 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:12.441796 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3301a8f-d055-4c0a-b7fa-9a37e4389954 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:12.442651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-31fecfd6-e682-4ade-9bca-b6d340c6fbaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43faacda34454b53aff4892d357b34f7'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:12.452821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d3301a8f-d055-4c0a-b7fa-9a37e4389954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:12.474749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 832/1656] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:12 2022] DELETE /identity/v3/users/43faacda34454b53aff4892d357b34f7 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:12.480625 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9607b-c756-4dae-b0c4-780986c8ca41 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:12.481274 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9607b-c756-4dae-b0c4-780986c8ca41 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:12.481824 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9607b-c756-4dae-b0c4-780986c8ca41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:12.512523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-11f9607b-c756-4dae-b0c4-780986c8ca41 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:12.514222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-11f9607b-c756-4dae-b0c4-780986c8ca41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:12.628721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 833/1657] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:12.663166 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3301a8f-d055-4c0a-b7fa-9a37e4389954 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:12.680841 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69ba24-7feb-4929-86bd-60b55e635c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:12.681771 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69ba24-7feb-4929-86bd-60b55e635c0d admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:12.682467 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69ba24-7feb-4929-86bd-60b55e635c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:12.682930 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69ba24-7feb-4929-86bd-60b55e635c0d admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:12.683845 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69ba24-7feb-4929-86bd-60b55e635c0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:12.687695 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69ba24-7feb-4929-86bd-60b55e635c0d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:12.695644 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9607b-c756-4dae-b0c4-780986c8ca41 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:12.698257 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-11f9607b-c756-4dae-b0c4-780986c8ca41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:12.770390 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 825/1658] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:12 2022] POST /identity/v3/users => generated 277 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:12.773544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69ba24-7feb-4929-86bd-60b55e635c0d admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:12.809811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69ba24-7feb-4929-86bd-60b55e635c0d admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:12.834808 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6586dee-31c4-485f-98dd-36af1336f8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:12.841554 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6586dee-31c4-485f-98dd-36af1336f8fe admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:12.841930 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6586dee-31c4-485f-98dd-36af1336f8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:12.842749 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6586dee-31c4-485f-98dd-36af1336f8fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:12.846347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6586dee-31c4-485f-98dd-36af1336f8fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:12.852842 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6586dee-31c4-485f-98dd-36af1336f8fe admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:12.898483 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 826/1659] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:12.906237 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9607b-c756-4dae-b0c4-780986c8ca41 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:12.907473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6586dee-31c4-485f-98dd-36af1336f8fe admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:12.914160 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabab450-a9f4-4787-838a-d9d6baf6d187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:12.914885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabab450-a9f4-4787-838a-d9d6baf6d187 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:12.915110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabab450-a9f4-4787-838a-d9d6baf6d187 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:12.915387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabab450-a9f4-4787-838a-d9d6baf6d187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:12.928570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabab450-a9f4-4787-838a-d9d6baf6d187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:12.930649 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabab450-a9f4-4787-838a-d9d6baf6d187 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:12.937088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6586dee-31c4-485f-98dd-36af1336f8fe admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:12.950737 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 834/1660] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:12.965704 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3f283-a861-4804-9f0c-f731fd2b34b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:12.967751 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3f283-a861-4804-9f0c-f731fd2b34b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:12.971343 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3f283-a861-4804-9f0c-f731fd2b34b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:12.971856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3f283-a861-4804-9f0c-f731fd2b34b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:12.972955 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3f283-a861-4804-9f0c-f731fd2b34b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:12.976531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3f283-a861-4804-9f0c-f731fd2b34b0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:13.016807 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 827/1661] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:13.021718 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabab450-a9f4-4787-838a-d9d6baf6d187 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:13.039979 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabab450-a9f4-4787-838a-d9d6baf6d187 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:13.058704 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee28059-f055-4d61-a199-cdf7693a99a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:13.060170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee28059-f055-4d61-a199-cdf7693a99a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:13.060934 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee28059-f055-4d61-a199-cdf7693a99a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:13.061650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee28059-f055-4d61-a199-cdf7693a99a9 admin admin] PATH_INFO: `/v3/projects/7cb3f768b8ba4841a6a7841d78b5f747/users/5509c506f50348ecbbdb683f735b4424/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:13.101082 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee28059-f055-4d61-a199-cdf7693a99a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb3f768b8ba4841a6a7841d78b5f747, user_id=5509c506f50348ecbbdb683f735b4424, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:13.103936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee28059-f055-4d61-a199-cdf7693a99a9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:13.170115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 835/1662] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:13 2022] PUT /identity/v3/projects/7cb3f768b8ba4841a6a7841d78b5f747/users/5509c506f50348ecbbdb683f735b4424/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:13.172514 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031ed7d-3398-4fc0-a6fa-1a521ddd5617 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:13.173091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031ed7d-3398-4fc0-a6fa-1a521ddd5617 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:13.173571 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031ed7d-3398-4fc0-a6fa-1a521ddd5617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:13.265695 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d031ed7d-3398-4fc0-a6fa-1a521ddd5617 None None] MFA Rules not processed for user `5509c506f50348ecbbdb683f735b4424`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:13.267010 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d031ed7d-3398-4fc0-a6fa-1a521ddd5617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:13.431322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 828/1663] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:13 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:13.435877 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee28059-f055-4d61-a199-cdf7693a99a9 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:13.595282 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:13.605371 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee28059-f055-4d61-a199-cdf7693a99a9 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:13.633062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9c22e-437d-46ae-841b-1c54d04108f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:13.633950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9c22e-437d-46ae-841b-1c54d04108f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:13.634422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9c22e-437d-46ae-841b-1c54d04108f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:13.634876 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9c22e-437d-46ae-841b-1c54d04108f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:13.635858 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9c22e-437d-46ae-841b-1c54d04108f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:13.641210 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9c22e-437d-46ae-841b-1c54d04108f6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:13.679644 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031ed7d-3398-4fc0-a6fa-1a521ddd5617 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:13.681380 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d031ed7d-3398-4fc0-a6fa-1a521ddd5617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:13.714696 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 836/1664] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:13 2022] POST /identity/v3/projects => generated 355 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:13.716414 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031ed7d-3398-4fc0-a6fa-1a521ddd5617 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:13.726284 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9c22e-437d-46ae-841b-1c54d04108f6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:13.740202 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:13.876946 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9c22e-437d-46ae-841b-1c54d04108f6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:13.886386 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51212c-f9df-4af5-a1cb-489022298742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:13.907395 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51212c-f9df-4af5-a1cb-489022298742 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:13.907772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51212c-f9df-4af5-a1cb-489022298742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:13.908046 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51212c-f9df-4af5-a1cb-489022298742 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:13.911580 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51212c-f9df-4af5-a1cb-489022298742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:13.912189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51212c-f9df-4af5-a1cb-489022298742 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:13.973853 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde00ae-5672-49d5-80ba-cd279a68f125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:13.974487 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde00ae-5672-49d5-80ba-cd279a68f125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:13.974773 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde00ae-5672-49d5-80ba-cd279a68f125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:13.975054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde00ae-5672-49d5-80ba-cd279a68f125 admin admin] PATH_INFO: `/v3/projects/9509b1c4477a444ba8ea47a6f5cc8807` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:13.983156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde00ae-5672-49d5-80ba-cd279a68f125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9509b1c4477a444ba8ea47a6f5cc8807)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:13.983156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: WARNING py.warnings [None req-6fde00ae-5672-49d5-80ba-cd279a68f125 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:31:13.983156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: warnings.warn(msg) Aug 24 04:31:13.983156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: Aug 24 04:31:13.994803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde00ae-5672-49d5-80ba-cd279a68f125 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:14.000580 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 837/1665] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:13 2022] POST /identity/v3/users => generated 284 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:14.006004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51212c-f9df-4af5-a1cb-489022298742 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:14.033003 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51212c-f9df-4af5-a1cb-489022298742 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:14.044513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7ad92-e416-4f59-bbd8-068dd76d67f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:14.045120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7ad92-e416-4f59-bbd8-068dd76d67f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:14.061406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7ad92-e416-4f59-bbd8-068dd76d67f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:14.061406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7ad92-e416-4f59-bbd8-068dd76d67f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:14.061406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7ad92-e416-4f59-bbd8-068dd76d67f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:14.061406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7ad92-e416-4f59-bbd8-068dd76d67f9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:14.082224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 838/1666] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:14.083462 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7ad92-e416-4f59-bbd8-068dd76d67f9 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:14.088888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-eae7ad92-e416-4f59-bbd8-068dd76d67f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:14.116113 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7ad92-e416-4f59-bbd8-068dd76d67f9 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:14.130518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06f3b5-3b89-43f0-92df-2d3e778d2965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:14.132178 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06f3b5-3b89-43f0-92df-2d3e778d2965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:14.133078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06f3b5-3b89-43f0-92df-2d3e778d2965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:14.133608 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06f3b5-3b89-43f0-92df-2d3e778d2965 admin admin] PATH_INFO: `/v3/users/eb1e6a4cdfac4210933fe91c1bf0cdec` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:14.136722 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06f3b5-3b89-43f0-92df-2d3e778d2965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb1e6a4cdfac4210933fe91c1bf0cdec)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:14.138650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06f3b5-3b89-43f0-92df-2d3e778d2965 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:14.249548 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-6fde00ae-5672-49d5-80ba-cd279a68f125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9509b1c4477a444ba8ea47a6f5cc8807', 'request_id': 'req-6fde00ae-5672-49d5-80ba-cd279a68f125'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:14.267417 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-6fde00ae-5672-49d5-80ba-cd279a68f125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9509b1c4477a444ba8ea47a6f5cc8807', 'request_id': 'req-6fde00ae-5672-49d5-80ba-cd279a68f125'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:14.285477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-6fde00ae-5672-49d5-80ba-cd279a68f125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9509b1c4477a444ba8ea47a6f5cc8807', 'request_id': 'req-6fde00ae-5672-49d5-80ba-cd279a68f125'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:14.294454 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4b06f3b5-3b89-43f0-92df-2d3e778d2965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb1e6a4cdfac4210933fe91c1bf0cdec'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:14.295352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4b06f3b5-3b89-43f0-92df-2d3e778d2965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb1e6a4cdfac4210933fe91c1bf0cdec'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:14.313947 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-6fde00ae-5672-49d5-80ba-cd279a68f125 admin admin] The token cache is being invalidate because project 9509b1c4477a444ba8ea47a6f5cc8807 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:14.314471 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-6fde00ae-5672-49d5-80ba-cd279a68f125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:14.315656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-6fde00ae-5672-49d5-80ba-cd279a68f125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:14.322286 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 829/1667] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:13 2022] DELETE /identity/v3/projects/9509b1c4477a444ba8ea47a6f5cc8807 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:14.324332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4b06f3b5-3b89-43f0-92df-2d3e778d2965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb1e6a4cdfac4210933fe91c1bf0cdec'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:14.324932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4b06f3b5-3b89-43f0-92df-2d3e778d2965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb1e6a4cdfac4210933fe91c1bf0cdec'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:14.325275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde00ae-5672-49d5-80ba-cd279a68f125 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:14.328658 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6fde00ae-5672-49d5-80ba-cd279a68f125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:14.389938 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4b06f3b5-3b89-43f0-92df-2d3e778d2965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb1e6a4cdfac4210933fe91c1bf0cdec'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:14.422960 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 839/1668] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:14 2022] DELETE /identity/v3/users/eb1e6a4cdfac4210933fe91c1bf0cdec => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:14.439059 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bb6dc-2886-4790-a0a3-8dcb155682cc None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:14.440032 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bb6dc-2886-4790-a0a3-8dcb155682cc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:14.441653 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bb6dc-2886-4790-a0a3-8dcb155682cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:14.498607 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2a1bb6dc-2886-4790-a0a3-8dcb155682cc None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:14.501598 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2a1bb6dc-2886-4790-a0a3-8dcb155682cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:14.513542 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde00ae-5672-49d5-80ba-cd279a68f125 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:14.581069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:14.664594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:14.681442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 840/1669] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:14.681442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7b68c-bc13-43f9-97f0-02ab8b946399 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:14.681442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7b68c-bc13-43f9-97f0-02ab8b946399 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:14.681442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7b68c-bc13-43f9-97f0-02ab8b946399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:14.719420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a799c5d-0848-429c-b256-cbc3a390a60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:14.720131 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a799c5d-0848-429c-b256-cbc3a390a60a admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:14.720425 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a799c5d-0848-429c-b256-cbc3a390a60a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:14.720713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a799c5d-0848-429c-b256-cbc3a390a60a admin admin] PATH_INFO: `/v3/projects/9ba700e156c04a9293c967dfdc719951/users/109e057a5e8e48b3a464c7e4fac3943e/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:14.722497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-17f7b68c-bc13-43f9-97f0-02ab8b946399 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:14.725812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-17f7b68c-bc13-43f9-97f0-02ab8b946399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:14.772646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 841/1670] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:14.774394 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae241b20-f52d-4826-9cb8-adfb673b9bc5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:14.774868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae241b20-f52d-4826-9cb8-adfb673b9bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:14.775315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae241b20-f52d-4826-9cb8-adfb673b9bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:14.776417 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a799c5d-0848-429c-b256-cbc3a390a60a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba700e156c04a9293c967dfdc719951, user_id=109e057a5e8e48b3a464c7e4fac3943e, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:14.779559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a799c5d-0848-429c-b256-cbc3a390a60a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:14.807068 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ae241b20-f52d-4826-9cb8-adfb673b9bc5 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:14.809225 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ae241b20-f52d-4826-9cb8-adfb673b9bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:14.813320 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 830/1671] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:14 2022] PUT /identity/v3/projects/9ba700e156c04a9293c967dfdc719951/users/109e057a5e8e48b3a464c7e4fac3943e/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:14.821589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a799c5d-0848-429c-b256-cbc3a390a60a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:14.897590 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 842/1672] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:14.898592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae241b20-f52d-4826-9cb8-adfb673b9bc5 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:14.899940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ae241b20-f52d-4826-9cb8-adfb673b9bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:15.026821 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae241b20-f52d-4826-9cb8-adfb673b9bc5 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:15.036213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b97da-6534-4187-96cf-ed8e7cc8865b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:15.037722 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b97da-6534-4187-96cf-ed8e7cc8865b service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:15.038561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b97da-6534-4187-96cf-ed8e7cc8865b service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:15.039406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b97da-6534-4187-96cf-ed8e7cc8865b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:15.064297 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a799c5d-0848-429c-b256-cbc3a390a60a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:15.064447 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b97da-6534-4187-96cf-ed8e7cc8865b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:15.067529 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b97da-6534-4187-96cf-ed8e7cc8865b service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:15.087218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184b89a-8b24-4968-812a-aee3b185e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:15.088070 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184b89a-8b24-4968-812a-aee3b185e573 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:15.088606 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184b89a-8b24-4968-812a-aee3b185e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:15.090274 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184b89a-8b24-4968-812a-aee3b185e573 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:15.091199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184b89a-8b24-4968-812a-aee3b185e573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:15.093799 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184b89a-8b24-4968-812a-aee3b185e573 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:15.094185 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 843/1673] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:15.095560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b97da-6534-4187-96cf-ed8e7cc8865b service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:15.120923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b97da-6534-4187-96cf-ed8e7cc8865b service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:15.125326 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 831/1674] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:15.127061 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184b89a-8b24-4968-812a-aee3b185e573 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:15.133405 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e55f7-3506-47a2-9f93-3ceefd0a2586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:15.134058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e55f7-3506-47a2-9f93-3ceefd0a2586 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:15.135971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e55f7-3506-47a2-9f93-3ceefd0a2586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:15.136312 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e55f7-3506-47a2-9f93-3ceefd0a2586 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:15.137094 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e55f7-3506-47a2-9f93-3ceefd0a2586 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:15.137466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e55f7-3506-47a2-9f93-3ceefd0a2586 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:15.142595 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e55f7-3506-47a2-9f93-3ceefd0a2586 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:15.162876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184b89a-8b24-4968-812a-aee3b185e573 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:15.169721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d5567-b18a-4bdb-9553-f22a455be6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:15.173469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 844/1675] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:31:15.173571 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d5567-b18a-4bdb-9553-f22a455be6c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:15.173571 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d5567-b18a-4bdb-9553-f22a455be6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:15.173571 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d5567-b18a-4bdb-9553-f22a455be6c0 admin admin] PATH_INFO: `/v3/projects/9ba700e156c04a9293c967dfdc719951/users/109e057a5e8e48b3a464c7e4fac3943e/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:15.174282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d5567-b18a-4bdb-9553-f22a455be6c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba700e156c04a9293c967dfdc719951, user_id=109e057a5e8e48b3a464c7e4fac3943e, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:15.174701 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e55f7-3506-47a2-9f93-3ceefd0a2586 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:15.179119 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d5567-b18a-4bdb-9553-f22a455be6c0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:15.205615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 832/1676] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:15 2022] PUT /identity/v3/projects/9ba700e156c04a9293c967dfdc719951/users/109e057a5e8e48b3a464c7e4fac3943e/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:15.210605 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e55f7-3506-47a2-9f93-3ceefd0a2586 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:15.210797 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89360d-308c-480a-b7e1-cf08892b87b6 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:15.211221 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89360d-308c-480a-b7e1-cf08892b87b6 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:15.211644 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89360d-308c-480a-b7e1-cf08892b87b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:15.318168 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:15.329461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-cb89360d-308c-480a-b7e1-cf08892b87b6 None None] MFA Rules not processed for user `109e057a5e8e48b3a464c7e4fac3943e`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:15.330773 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cb89360d-308c-480a-b7e1-cf08892b87b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:15.339290 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f33c39-7957-4a65-89bc-18ddd502a95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:15.339920 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f33c39-7957-4a65-89bc-18ddd502a95f admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:15.340201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f33c39-7957-4a65-89bc-18ddd502a95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:15.340476 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f33c39-7957-4a65-89bc-18ddd502a95f admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:15.341303 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f33c39-7957-4a65-89bc-18ddd502a95f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:15.344353 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f33c39-7957-4a65-89bc-18ddd502a95f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:15.468998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 845/1677] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:15 2022] POST /identity/v3/projects => generated 405 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:31:15.474106 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f33c39-7957-4a65-89bc-18ddd502a95f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:15.627192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 833/1678] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:15 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:15.639269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89360d-308c-480a-b7e1-cf08892b87b6 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:15.640800 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cb89360d-308c-480a-b7e1-cf08892b87b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:15.695198 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f33c39-7957-4a65-89bc-18ddd502a95f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:15.700386 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0027e0-255b-42b4-8903-e69b53a768fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:15.701075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0027e0-255b-42b4-8903-e69b53a768fb admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:15.701360 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0027e0-255b-42b4-8903-e69b53a768fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:15.701664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0027e0-255b-42b4-8903-e69b53a768fb admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:15.702282 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0027e0-255b-42b4-8903-e69b53a768fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:15.707860 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0027e0-255b-42b4-8903-e69b53a768fb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:15.738640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 846/1679] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:15 2022] POST /identity/v3/users => generated 303 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:15.742309 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0027e0-255b-42b4-8903-e69b53a768fb admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:15.748702 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:15.762426 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0027e0-255b-42b4-8903-e69b53a768fb admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:15.772466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5670fc6-aba9-4e5e-a07d-9893131b60e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:15.773527 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5670fc6-aba9-4e5e-a07d-9893131b60e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:15.774774 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5670fc6-aba9-4e5e-a07d-9893131b60e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:15.775555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5670fc6-aba9-4e5e-a07d-9893131b60e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:15.776490 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5670fc6-aba9-4e5e-a07d-9893131b60e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:15.779116 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5670fc6-aba9-4e5e-a07d-9893131b60e7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:15.794274 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89360d-308c-480a-b7e1-cf08892b87b6 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:15.808641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 847/1680] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:15.809063 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5670fc6-aba9-4e5e-a07d-9893131b60e7 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:15.812822 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d5670fc6-aba9-4e5e-a07d-9893131b60e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:15.843885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5670fc6-aba9-4e5e-a07d-9893131b60e7 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:15.850715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247745d9-d1fa-49dc-8ddc-cdf419e3915b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:15.851077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247745d9-d1fa-49dc-8ddc-cdf419e3915b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:15.851330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247745d9-d1fa-49dc-8ddc-cdf419e3915b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:15.851596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247745d9-d1fa-49dc-8ddc-cdf419e3915b admin admin] PATH_INFO: `/v3/projects/15cc1a2b39a24bef8efc317a855e24df` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:15.852851 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247745d9-d1fa-49dc-8ddc-cdf419e3915b admin admin] RBAC: Authorizing `identity:delete_project(project_id=15cc1a2b39a24bef8efc317a855e24df)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:15.855159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247745d9-d1fa-49dc-8ddc-cdf419e3915b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:15.921319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fdacc-15ec-4f76-bd1f-b35f19eca7f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:15.925664 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fdacc-15ec-4f76-bd1f-b35f19eca7f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:15.926068 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fdacc-15ec-4f76-bd1f-b35f19eca7f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:15.926353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fdacc-15ec-4f76-bd1f-b35f19eca7f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:15.932401 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-247745d9-d1fa-49dc-8ddc-cdf419e3915b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15cc1a2b39a24bef8efc317a855e24df', 'request_id': 'req-247745d9-d1fa-49dc-8ddc-cdf419e3915b'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:15.958572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-247745d9-d1fa-49dc-8ddc-cdf419e3915b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15cc1a2b39a24bef8efc317a855e24df', 'request_id': 'req-247745d9-d1fa-49dc-8ddc-cdf419e3915b'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:15.977089 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-247745d9-d1fa-49dc-8ddc-cdf419e3915b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15cc1a2b39a24bef8efc317a855e24df', 'request_id': 'req-247745d9-d1fa-49dc-8ddc-cdf419e3915b'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:15.995549 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-247745d9-d1fa-49dc-8ddc-cdf419e3915b admin admin] The token cache is being invalidate because project 15cc1a2b39a24bef8efc317a855e24df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:15.995549 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-247745d9-d1fa-49dc-8ddc-cdf419e3915b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:15.995887 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-247745d9-d1fa-49dc-8ddc-cdf419e3915b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:15.999804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 848/1681] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:15 2022] DELETE /identity/v3/projects/15cc1a2b39a24bef8efc317a855e24df => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:16.001439 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247745d9-d1fa-49dc-8ddc-cdf419e3915b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:16.006640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-247745d9-d1fa-49dc-8ddc-cdf419e3915b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:16.120958 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fdacc-15ec-4f76-bd1f-b35f19eca7f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:16.122454 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fdacc-15ec-4f76-bd1f-b35f19eca7f4 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:16.146003 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:16.181450 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 834/1682] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:15 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:16.181450 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fdacc-15ec-4f76-bd1f-b35f19eca7f4 service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:16.220205 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fdacc-15ec-4f76-bd1f-b35f19eca7f4 service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:16.236365 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d99e9b-a8d8-424a-bc38-9b63fbe6ca03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:16.237096 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d99e9b-a8d8-424a-bc38-9b63fbe6ca03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:16.237445 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d99e9b-a8d8-424a-bc38-9b63fbe6ca03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:16.237786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d99e9b-a8d8-424a-bc38-9b63fbe6ca03 admin admin] PATH_INFO: `/v3/users/bad251995fb64a8bb7397ae30c2d4dec` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:16.245019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d99e9b-a8d8-424a-bc38-9b63fbe6ca03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bad251995fb64a8bb7397ae30c2d4dec)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:16.247784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d99e9b-a8d8-424a-bc38-9b63fbe6ca03 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:16.257692 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247745d9-d1fa-49dc-8ddc-cdf419e3915b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:16.272413 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb5f79-b40e-474c-bfab-1975659d0c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:16.273214 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb5f79-b40e-474c-bfab-1975659d0c41 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:16.274783 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb5f79-b40e-474c-bfab-1975659d0c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:16.275389 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb5f79-b40e-474c-bfab-1975659d0c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:16.278127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb5f79-b40e-474c-bfab-1975659d0c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:16.281597 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb5f79-b40e-474c-bfab-1975659d0c41 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:16.316309 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 849/1683] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:16.320267 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb5f79-b40e-474c-bfab-1975659d0c41 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:16.348218 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb5f79-b40e-474c-bfab-1975659d0c41 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:16.362322 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dc735-f0fb-476b-8942-2ab3004b32fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:16.363089 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dc735-f0fb-476b-8942-2ab3004b32fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:16.363738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dc735-f0fb-476b-8942-2ab3004b32fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:16.364018 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dc735-f0fb-476b-8942-2ab3004b32fb admin admin] PATH_INFO: `/v3/projects/b5152c65eb264ca199682f5f61dfb86a/users/9baac42d6b2b463eadd39269396f4993/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:16.367304 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a8d99e9b-a8d8-424a-bc38-9b63fbe6ca03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bad251995fb64a8bb7397ae30c2d4dec'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:16.369055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a8d99e9b-a8d8-424a-bc38-9b63fbe6ca03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bad251995fb64a8bb7397ae30c2d4dec'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:16.394496 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a8d99e9b-a8d8-424a-bc38-9b63fbe6ca03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bad251995fb64a8bb7397ae30c2d4dec'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:16.395679 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a8d99e9b-a8d8-424a-bc38-9b63fbe6ca03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bad251995fb64a8bb7397ae30c2d4dec'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:16.411525 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dc735-f0fb-476b-8942-2ab3004b32fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5152c65eb264ca199682f5f61dfb86a, user_id=9baac42d6b2b463eadd39269396f4993, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:16.417665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dc735-f0fb-476b-8942-2ab3004b32fb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:16.417799 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a8d99e9b-a8d8-424a-bc38-9b63fbe6ca03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bad251995fb64a8bb7397ae30c2d4dec'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:16.459060 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 835/1684] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:16 2022] DELETE /identity/v3/users/bad251995fb64a8bb7397ae30c2d4dec => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:16.461458 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d99e9b-a8d8-424a-bc38-9b63fbe6ca03 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:16.466334 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a8d99e9b-a8d8-424a-bc38-9b63fbe6ca03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:16.476752 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 850/1685] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:16 2022] PUT /identity/v3/projects/b5152c65eb264ca199682f5f61dfb86a/users/9baac42d6b2b463eadd39269396f4993/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:16.487071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b562961-f94b-4838-8c23-c93bf7663354 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:16.487893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b562961-f94b-4838-8c23-c93bf7663354 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:16.488199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b562961-f94b-4838-8c23-c93bf7663354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:16.514184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:16.582924 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2b562961-f94b-4838-8c23-c93bf7663354 None None] MFA Rules not processed for user `9baac42d6b2b463eadd39269396f4993`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:16.584200 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2b562961-f94b-4838-8c23-c93bf7663354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:16.629898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d99e9b-a8d8-424a-bc38-9b63fbe6ca03 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:16.805657 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 851/1686] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:16 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:31:16.817844 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b562961-f94b-4838-8c23-c93bf7663354 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:16.819324 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2b562961-f94b-4838-8c23-c93bf7663354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:16.850693 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95bea6-dcf5-4a01-9827-0c1611b093c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:16.852490 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95bea6-dcf5-4a01-9827-0c1611b093c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:16.854155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95bea6-dcf5-4a01-9827-0c1611b093c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:16.854155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95bea6-dcf5-4a01-9827-0c1611b093c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:16.859614 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5e95bea6-dcf5-4a01-9827-0c1611b093c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:17.051051 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95bea6-dcf5-4a01-9827-0c1611b093c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:17.054552 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95bea6-dcf5-4a01-9827-0c1611b093c9 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:17.059547 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b562961-f94b-4838-8c23-c93bf7663354 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:17.074505 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953dc02-0569-40a3-a161-1653118d6456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:17.077039 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953dc02-0569-40a3-a161-1653118d6456 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:17.077402 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953dc02-0569-40a3-a161-1653118d6456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:17.077752 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953dc02-0569-40a3-a161-1653118d6456 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:17.078837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953dc02-0569-40a3-a161-1653118d6456 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:17.086343 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953dc02-0569-40a3-a161-1653118d6456 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:17.101215 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 836/1687] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:16 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:17.191315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 852/1688] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:16 2022] POST /identity/v3/projects => generated 403 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:17.195880 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95bea6-dcf5-4a01-9827-0c1611b093c9 service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:17.218613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95bea6-dcf5-4a01-9827-0c1611b093c9 service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:17.235151 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953dc02-0569-40a3-a161-1653118d6456 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:17.237223 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f953dc02-0569-40a3-a161-1653118d6456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:17.347642 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:17.455275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae160585-9260-4110-97bd-8824a7760246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:17.456642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae160585-9260-4110-97bd-8824a7760246 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:17.456943 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae160585-9260-4110-97bd-8824a7760246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:17.460379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae160585-9260-4110-97bd-8824a7760246 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:17.462579 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae160585-9260-4110-97bd-8824a7760246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:17.466302 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953dc02-0569-40a3-a161-1653118d6456 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:17.469303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae160585-9260-4110-97bd-8824a7760246 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:17.499122 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6537c-e0d8-4253-9802-27eac327f336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:17.500032 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6537c-e0d8-4253-9802-27eac327f336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:17.500409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6537c-e0d8-4253-9802-27eac327f336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:17.500779 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6537c-e0d8-4253-9802-27eac327f336 admin admin] PATH_INFO: `/v3/projects/ff4d3b11017c450b98f0b886cb1df9a9` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:17.502775 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6537c-e0d8-4253-9802-27eac327f336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff4d3b11017c450b98f0b886cb1df9a9)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:17.505708 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6537c-e0d8-4253-9802-27eac327f336 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:17.531172 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 837/1689] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:17 2022] POST /identity/v3/users => generated 308 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:17.541869 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98f98d-cebf-4a8f-b4ae-0542a11cb561 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:17.542371 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98f98d-cebf-4a8f-b4ae-0542a11cb561 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:17.542838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98f98d-cebf-4a8f-b4ae-0542a11cb561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:17.591052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:17.595676 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-fe98f98d-cebf-4a8f-b4ae-0542a11cb561 None None] MFA Rules not processed for user `340f60f0efd54b1db12c6b08cb794a84`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:17.598906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-fe98f98d-cebf-4a8f-b4ae-0542a11cb561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:17.638390 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8fa6537c-e0d8-4253-9802-27eac327f336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff4d3b11017c450b98f0b886cb1df9a9', 'request_id': 'req-8fa6537c-e0d8-4253-9802-27eac327f336'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:17.655702 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8fa6537c-e0d8-4253-9802-27eac327f336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff4d3b11017c450b98f0b886cb1df9a9', 'request_id': 'req-8fa6537c-e0d8-4253-9802-27eac327f336'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:17.667763 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8fa6537c-e0d8-4253-9802-27eac327f336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff4d3b11017c450b98f0b886cb1df9a9', 'request_id': 'req-8fa6537c-e0d8-4253-9802-27eac327f336'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:17.686158 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8fa6537c-e0d8-4253-9802-27eac327f336 admin admin] The token cache is being invalidate because project ff4d3b11017c450b98f0b886cb1df9a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:17.686711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8fa6537c-e0d8-4253-9802-27eac327f336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:17.687499 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-8fa6537c-e0d8-4253-9802-27eac327f336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:17.692769 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 853/1690] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:17 2022] DELETE /identity/v3/projects/ff4d3b11017c450b98f0b886cb1df9a9 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:31:17.692769 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6537c-e0d8-4253-9802-27eac327f336 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:17.697752 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8fa6537c-e0d8-4253-9802-27eac327f336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:17.761191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 838/1691] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:31:17.762855 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98f98d-cebf-4a8f-b4ae-0542a11cb561 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:17.764653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-fe98f98d-cebf-4a8f-b4ae-0542a11cb561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:17.913977 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6537c-e0d8-4253-9802-27eac327f336 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:17.928348 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98f98d-cebf-4a8f-b4ae-0542a11cb561 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:17.936918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393d0ac-397d-44cb-94f9-c3ce936f6df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:17.937746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393d0ac-397d-44cb-94f9-c3ce936f6df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:17.938036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393d0ac-397d-44cb-94f9-c3ce936f6df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:17.938316 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393d0ac-397d-44cb-94f9-c3ce936f6df2 admin admin] PATH_INFO: `/v3/projects/4efb4b72a0264c1a9a9659fc84262319` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:17.938581 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d8a76-69a1-4145-828d-559608d37274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:17.940391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d8a76-69a1-4145-828d-559608d37274 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:17.941879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393d0ac-397d-44cb-94f9-c3ce936f6df2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4efb4b72a0264c1a9a9659fc84262319)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:17.947906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393d0ac-397d-44cb-94f9-c3ce936f6df2 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:17.948247 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d8a76-69a1-4145-828d-559608d37274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:17.948745 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d8a76-69a1-4145-828d-559608d37274 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:17.949561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d8a76-69a1-4145-828d-559608d37274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:17.951528 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d8a76-69a1-4145-828d-559608d37274 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:17.987873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 854/1692] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:17.987873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaab2b1-1913-4c3c-98d5-a32f0adea456 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:17.987873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaab2b1-1913-4c3c-98d5-a32f0adea456 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:17.987873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaab2b1-1913-4c3c-98d5-a32f0adea456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:18.033250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c393d0ac-397d-44cb-94f9-c3ce936f6df2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4efb4b72a0264c1a9a9659fc84262319', 'request_id': 'req-c393d0ac-397d-44cb-94f9-c3ce936f6df2'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:18.042947 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bfaab2b1-1913-4c3c-98d5-a32f0adea456 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:18.043373 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c393d0ac-397d-44cb-94f9-c3ce936f6df2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4efb4b72a0264c1a9a9659fc84262319', 'request_id': 'req-c393d0ac-397d-44cb-94f9-c3ce936f6df2'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:18.044222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bfaab2b1-1913-4c3c-98d5-a32f0adea456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:18.053430 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c393d0ac-397d-44cb-94f9-c3ce936f6df2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4efb4b72a0264c1a9a9659fc84262319', 'request_id': 'req-c393d0ac-397d-44cb-94f9-c3ce936f6df2'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:18.086007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c393d0ac-397d-44cb-94f9-c3ce936f6df2 admin admin] The token cache is being invalidate because project 4efb4b72a0264c1a9a9659fc84262319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:18.086370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c393d0ac-397d-44cb-94f9-c3ce936f6df2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:18.090304 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c393d0ac-397d-44cb-94f9-c3ce936f6df2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:18.093740 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 839/1693] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:17 2022] DELETE /identity/v3/projects/4efb4b72a0264c1a9a9659fc84262319 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:18.095436 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f380cc-a390-476f-8c2a-17e0bbf64bc6 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:18.095732 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f380cc-a390-476f-8c2a-17e0bbf64bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:18.096010 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f380cc-a390-476f-8c2a-17e0bbf64bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:18.149739 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d8f380cc-a390-476f-8c2a-17e0bbf64bc6 None None] MFA Rules not processed for user `340f60f0efd54b1db12c6b08cb794a84`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:18.158372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d8f380cc-a390-476f-8c2a-17e0bbf64bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:18.254624 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:18.265895 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:18.293763 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 855/1694] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:18.294719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaab2b1-1913-4c3c-98d5-a32f0adea456 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:18.301307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bfaab2b1-1913-4c3c-98d5-a32f0adea456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:18.351166 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaab2b1-1913-4c3c-98d5-a32f0adea456 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:18.369439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 840/1695] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:18.373709 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463824ea-6c74-4d68-b9a7-2bf5670b97a0 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:18.374006 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463824ea-6c74-4d68-b9a7-2bf5670b97a0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:18.374131 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78738c49-9749-47cc-9a9e-d85fb0d2cdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:18.374331 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463824ea-6c74-4d68-b9a7-2bf5670b97a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:18.374771 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78738c49-9749-47cc-9a9e-d85fb0d2cdaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:18.375068 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78738c49-9749-47cc-9a9e-d85fb0d2cdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:18.375356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78738c49-9749-47cc-9a9e-d85fb0d2cdaf admin admin] PATH_INFO: `/v3/projects/9709282f7d9744ef9a6d10bda8e830aa/users/7420ee6490dc4613add3c2ba6c91f7b9/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:18.421836 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-463824ea-6c74-4d68-b9a7-2bf5670b97a0 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:18.424638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78738c49-9749-47cc-9a9e-d85fb0d2cdaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9709282f7d9744ef9a6d10bda8e830aa, user_id=7420ee6490dc4613add3c2ba6c91f7b9, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:18.425101 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-463824ea-6c74-4d68-b9a7-2bf5670b97a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:18.428291 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78738c49-9749-47cc-9a9e-d85fb0d2cdaf admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:18.468169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 856/1696] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:18 2022] PUT /identity/v3/projects/9709282f7d9744ef9a6d10bda8e830aa/users/7420ee6490dc4613add3c2ba6c91f7b9/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:18.469986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3da901-87e9-44f8-92bc-7783777fa845 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:18.470792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3da901-87e9-44f8-92bc-7783777fa845 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:18.474032 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3da901-87e9-44f8-92bc-7783777fa845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:18.484746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 841/1697] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:18.498205 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463824ea-6c74-4d68-b9a7-2bf5670b97a0 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:18.508746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-463824ea-6c74-4d68-b9a7-2bf5670b97a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:18.550510 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bf3da901-87e9-44f8-92bc-7783777fa845 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:18.553843 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bf3da901-87e9-44f8-92bc-7783777fa845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:18.689334 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463824ea-6c74-4d68-b9a7-2bf5670b97a0 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:18.710134 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 857/1698] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:18.711006 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3da901-87e9-44f8-92bc-7783777fa845 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:18.733106 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3da901-87e9-44f8-92bc-7783777fa845 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:18.749749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf7aa4-2f67-457f-901f-f6614dbabe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:18.750438 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf7aa4-2f67-457f-901f-f6614dbabe5e admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:18.750699 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf7aa4-2f67-457f-901f-f6614dbabe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:18.750984 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf7aa4-2f67-457f-901f-f6614dbabe5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:18.751682 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf7aa4-2f67-457f-901f-f6614dbabe5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:18.757169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf7aa4-2f67-457f-901f-f6614dbabe5e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:18.783664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 858/1699] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:18.783664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc875c-0f27-4071-b4f0-6985d9e05c2b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:18.783664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc875c-0f27-4071-b4f0-6985d9e05c2b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:18.783664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc875c-0f27-4071-b4f0-6985d9e05c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:18.848342 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-45cc875c-0f27-4071-b4f0-6985d9e05c2b None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:18.849684 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-45cc875c-0f27-4071-b4f0-6985d9e05c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:18.850441 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bb02d-d202-45aa-b247-37a8822cc04d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:18.852449 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bb02d-d202-45aa-b247-37a8822cc04d service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:18.854761 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bb02d-d202-45aa-b247-37a8822cc04d service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:18.856783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bb02d-d202-45aa-b247-37a8822cc04d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:18.862211 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1f8bb02d-d202-45aa-b247-37a8822cc04d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:18.881088 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 859/1700] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:18.881989 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc875c-0f27-4071-b4f0-6985d9e05c2b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:18.888403 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-45cc875c-0f27-4071-b4f0-6985d9e05c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:18.921957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc875c-0f27-4071-b4f0-6985d9e05c2b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:18.934366 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880e8a0-afca-446e-b6f1-73cef258fa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:18.935039 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880e8a0-afca-446e-b6f1-73cef258fa05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:18.935325 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880e8a0-afca-446e-b6f1-73cef258fa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:18.935608 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880e8a0-afca-446e-b6f1-73cef258fa05 admin admin] PATH_INFO: `/v3/users/1b58a3839f564119a8403e3685cc4305` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:18.943242 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880e8a0-afca-446e-b6f1-73cef258fa05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b58a3839f564119a8403e3685cc4305)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:18.949279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880e8a0-afca-446e-b6f1-73cef258fa05 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:19.075028 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5880e8a0-afca-446e-b6f1-73cef258fa05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b58a3839f564119a8403e3685cc4305'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:19.075780 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5880e8a0-afca-446e-b6f1-73cef258fa05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b58a3839f564119a8403e3685cc4305'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:19.086737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8bb02d-d202-45aa-b247-37a8822cc04d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:19.088943 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8bb02d-d202-45aa-b247-37a8822cc04d service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:19.095670 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5880e8a0-afca-446e-b6f1-73cef258fa05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b58a3839f564119a8403e3685cc4305'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:19.096326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5880e8a0-afca-446e-b6f1-73cef258fa05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b58a3839f564119a8403e3685cc4305'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:19.119708 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 842/1701] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:19.121082 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bb02d-d202-45aa-b247-37a8822cc04d service nova] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:19.124178 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5880e8a0-afca-446e-b6f1-73cef258fa05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b58a3839f564119a8403e3685cc4305'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:19.155750 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bb02d-d202-45aa-b247-37a8822cc04d service nova] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:19.162117 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 860/1702] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:18 2022] DELETE /identity/v3/users/1b58a3839f564119a8403e3685cc4305 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:19.165426 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880e8a0-afca-446e-b6f1-73cef258fa05 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:19.175482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5880e8a0-afca-446e-b6f1-73cef258fa05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:19.176281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:19.261169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:19.300171 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2e95b-9b7c-4d67-8e13-8e1373695f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:19.300886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2e95b-9b7c-4d67-8e13-8e1373695f78 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:19.301118 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2e95b-9b7c-4d67-8e13-8e1373695f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:19.301407 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2e95b-9b7c-4d67-8e13-8e1373695f78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:19.302084 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2e95b-9b7c-4d67-8e13-8e1373695f78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:19.302395 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2e95b-9b7c-4d67-8e13-8e1373695f78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:19.304103 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2e95b-9b7c-4d67-8e13-8e1373695f78 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:19.338574 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 843/1703] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:31:19.339658 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2e95b-9b7c-4d67-8e13-8e1373695f78 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:19.340329 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880e8a0-afca-446e-b6f1-73cef258fa05 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:19.343215 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-67e2e95b-9b7c-4d67-8e13-8e1373695f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:19.352528 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98316612-6c71-4ad0-9fe0-49a86fb91c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:19.353389 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98316612-6c71-4ad0-9fe0-49a86fb91c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:19.353688 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98316612-6c71-4ad0-9fe0-49a86fb91c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:19.354056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98316612-6c71-4ad0-9fe0-49a86fb91c26 admin admin] PATH_INFO: `/v3/projects/9709282f7d9744ef9a6d10bda8e830aa/users/7420ee6490dc4613add3c2ba6c91f7b9/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:19.359377 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98316612-6c71-4ad0-9fe0-49a86fb91c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9709282f7d9744ef9a6d10bda8e830aa, user_id=7420ee6490dc4613add3c2ba6c91f7b9, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:19.362129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98316612-6c71-4ad0-9fe0-49a86fb91c26 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:19.370064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2e95b-9b7c-4d67-8e13-8e1373695f78 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:19.382075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ab8fd-c468-4284-bf00-ac37fce5c3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:19.382627 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ab8fd-c468-4284-bf00-ac37fce5c3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:19.382804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ab8fd-c468-4284-bf00-ac37fce5c3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:19.383092 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ab8fd-c468-4284-bf00-ac37fce5c3d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:19.383763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ab8fd-c468-4284-bf00-ac37fce5c3d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:19.384418 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ab8fd-c468-4284-bf00-ac37fce5c3d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:19.385738 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ab8fd-c468-4284-bf00-ac37fce5c3d7 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:19.391034 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 861/1704] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:19 2022] PUT /identity/v3/projects/9709282f7d9744ef9a6d10bda8e830aa/users/7420ee6490dc4613add3c2ba6c91f7b9/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:19.392363 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240224aa-1808-424c-af4b-1a14c7573d22 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:19.392654 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240224aa-1808-424c-af4b-1a14c7573d22 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:19.392966 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240224aa-1808-424c-af4b-1a14c7573d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:19.430643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 844/1705] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:31:19.430643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ab8fd-c468-4284-bf00-ac37fce5c3d7 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:19.435641 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d03ab8fd-c468-4284-bf00-ac37fce5c3d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:19.450659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-240224aa-1808-424c-af4b-1a14c7573d22 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:19.451959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-240224aa-1808-424c-af4b-1a14c7573d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:19.465137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ab8fd-c468-4284-bf00-ac37fce5c3d7 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:19.560777 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 862/1706] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:19.565871 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039e61b-8ba1-40b4-b987-9f87c3309dc5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:19.566168 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039e61b-8ba1-40b4-b987-9f87c3309dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:19.566446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039e61b-8ba1-40b4-b987-9f87c3309dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:19.617689 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cddb0a-0a64-4077-8802-03353b23f24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:19.618343 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cddb0a-0a64-4077-8802-03353b23f24d admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:19.618632 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cddb0a-0a64-4077-8802-03353b23f24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:19.618914 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cddb0a-0a64-4077-8802-03353b23f24d admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:19.623538 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cddb0a-0a64-4077-8802-03353b23f24d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:19.627870 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cddb0a-0a64-4077-8802-03353b23f24d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:19.636561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-7039e61b-8ba1-40b4-b987-9f87c3309dc5 None None] MFA Rules not processed for user `7420ee6490dc4613add3c2ba6c91f7b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:19.637879 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7039e61b-8ba1-40b4-b987-9f87c3309dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:19.700755 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 845/1707] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:19 2022] POST /identity/v3/projects => generated 363 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:19.700755 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cddb0a-0a64-4077-8802-03353b23f24d admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:19.867847 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 863/1708] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:19 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:19.867847 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039e61b-8ba1-40b4-b987-9f87c3309dc5 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:19.879470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039e61b-8ba1-40b4-b987-9f87c3309dc5 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:19.934507 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cddb0a-0a64-4077-8802-03353b23f24d admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:19.950746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e111a2-e7ca-4591-b14a-066349d41b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:19.951389 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e111a2-e7ca-4591-b14a-066349d41b5a admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:19.951677 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e111a2-e7ca-4591-b14a-066349d41b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:19.951959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e111a2-e7ca-4591-b14a-066349d41b5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:19.952610 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e111a2-e7ca-4591-b14a-066349d41b5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:19.954636 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e111a2-e7ca-4591-b14a-066349d41b5a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:19.967120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:19.996098 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bd249-60f0-4c27-af02-306e91b99f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:19.997202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bd249-60f0-4c27-af02-306e91b99f01 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:19.997775 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bd249-60f0-4c27-af02-306e91b99f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:19.998212 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bd249-60f0-4c27-af02-306e91b99f01 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:19.999018 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bd249-60f0-4c27-af02-306e91b99f01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:20.006613 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bd249-60f0-4c27-af02-306e91b99f01 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:20.038254 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:20.058192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 846/1709] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:19 2022] POST /identity/v3/projects => generated 367 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:20.060663 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e111a2-e7ca-4591-b14a-066349d41b5a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:20.064619 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b6e111a2-e7ca-4591-b14a-066349d41b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:20.080921 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 864/1710] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:19 2022] POST /identity/v3/users => generated 282 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:20.084537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bd249-60f0-4c27-af02-306e91b99f01 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:20.106435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-384bd249-60f0-4c27-af02-306e91b99f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:20.250840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e111a2-e7ca-4591-b14a-066349d41b5a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:20.255849 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504028b0-e634-461a-a4da-7372ee2d798e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:20.257567 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504028b0-e634-461a-a4da-7372ee2d798e service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:20.258137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504028b0-e634-461a-a4da-7372ee2d798e service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:20.258415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504028b0-e634-461a-a4da-7372ee2d798e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:20.273260 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bd249-60f0-4c27-af02-306e91b99f01 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:20.417088 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f988e7e-f117-4317-942c-dd3184f6d9cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:20.422261 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f988e7e-f117-4317-942c-dd3184f6d9cd service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:20.423583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f988e7e-f117-4317-942c-dd3184f6d9cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:20.424065 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f988e7e-f117-4317-942c-dd3184f6d9cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:20.432998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504028b0-e634-461a-a4da-7372ee2d798e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:20.440212 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504028b0-e634-461a-a4da-7372ee2d798e service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:20.496912 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 847/1711] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:20.505726 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504028b0-e634-461a-a4da-7372ee2d798e service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:20.556099 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504028b0-e634-461a-a4da-7372ee2d798e service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:20.568666 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78614870-b2d4-4a4b-9bc3-2a1316b71c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:20.569911 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78614870-b2d4-4a4b-9bc3-2a1316b71c83 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:20.571734 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78614870-b2d4-4a4b-9bc3-2a1316b71c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:20.572143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78614870-b2d4-4a4b-9bc3-2a1316b71c83 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:20.572872 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78614870-b2d4-4a4b-9bc3-2a1316b71c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:20.578318 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f988e7e-f117-4317-942c-dd3184f6d9cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:20.580564 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78614870-b2d4-4a4b-9bc3-2a1316b71c83 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:20.581864 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f988e7e-f117-4317-942c-dd3184f6d9cd service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:20.611449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 865/1712] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:20 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:20.613042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f988e7e-f117-4317-942c-dd3184f6d9cd service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:20.666644 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 848/1713] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:20 2022] POST /identity/v3/users => generated 284 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:20.669113 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f988e7e-f117-4317-942c-dd3184f6d9cd service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:20.669756 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78614870-b2d4-4a4b-9bc3-2a1316b71c83 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:20.704484 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d8562-5541-4022-b093-716d052d522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:20.705610 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78614870-b2d4-4a4b-9bc3-2a1316b71c83 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:20.706617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d8562-5541-4022-b093-716d052d522e admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:20.708002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d8562-5541-4022-b093-716d052d522e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:20.710667 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d8562-5541-4022-b093-716d052d522e admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:20.711401 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d8562-5541-4022-b093-716d052d522e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:20.718936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d8562-5541-4022-b093-716d052d522e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:20.726912 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61514952-3391-4933-9cbf-2722e971ace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:20.727629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61514952-3391-4933-9cbf-2722e971ace8 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:20.736086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61514952-3391-4933-9cbf-2722e971ace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:20.736477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61514952-3391-4933-9cbf-2722e971ace8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:20.739701 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61514952-3391-4933-9cbf-2722e971ace8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:20.748871 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61514952-3391-4933-9cbf-2722e971ace8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:20.765114 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 866/1714] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:20.767189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d8562-5541-4022-b093-716d052d522e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:20.783070 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 849/1715] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:20.787306 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61514952-3391-4933-9cbf-2722e971ace8 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:20.795423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d8562-5541-4022-b093-716d052d522e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:20.804927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf127028-586e-4fd3-ab74-142adf5ad745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:20.809088 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf127028-586e-4fd3-ab74-142adf5ad745 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:20.809386 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf127028-586e-4fd3-ab74-142adf5ad745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:20.809674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf127028-586e-4fd3-ab74-142adf5ad745 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:20.811567 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf127028-586e-4fd3-ab74-142adf5ad745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:20.812915 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61514952-3391-4933-9cbf-2722e971ace8 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:20.820160 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf127028-586e-4fd3-ab74-142adf5ad745 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:20.840386 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c555bc-d6dd-4d36-bd3c-0b48114322dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:20.841047 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c555bc-d6dd-4d36-bd3c-0b48114322dd admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:20.841333 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c555bc-d6dd-4d36-bd3c-0b48114322dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:20.841614 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c555bc-d6dd-4d36-bd3c-0b48114322dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:20.842280 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c555bc-d6dd-4d36-bd3c-0b48114322dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:20.851557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c555bc-d6dd-4d36-bd3c-0b48114322dd admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:20.861532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 867/1716] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:31:20.870309 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf127028-586e-4fd3-ab74-142adf5ad745 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:20.887338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 850/1717] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:20.896406 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c555bc-d6dd-4d36-bd3c-0b48114322dd admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:20.901729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf127028-586e-4fd3-ab74-142adf5ad745 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:20.918584 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41957795-1f83-4275-a8bd-38196e513af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:20.919380 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41957795-1f83-4275-a8bd-38196e513af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:20.919767 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41957795-1f83-4275-a8bd-38196e513af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:20.920140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41957795-1f83-4275-a8bd-38196e513af2 admin admin] PATH_INFO: `/v3/projects/01e76adb89804c1ebaaa485dc4b7de8b/users/0cceb0f1ade74df8982c3af624e1bfaa/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:20.935769 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c555bc-d6dd-4d36-bd3c-0b48114322dd admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:20.960832 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41957795-1f83-4275-a8bd-38196e513af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e76adb89804c1ebaaa485dc4b7de8b, user_id=0cceb0f1ade74df8982c3af624e1bfaa, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:20.964473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec92ae-0289-4ec9-8412-9e4223a30095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:20.965200 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec92ae-0289-4ec9-8412-9e4223a30095 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:20.965488 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec92ae-0289-4ec9-8412-9e4223a30095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:20.965769 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec92ae-0289-4ec9-8412-9e4223a30095 admin admin] PATH_INFO: `/v3/projects/e982f1e858e7450ea5cf640fb4742bd3/users/ebd73d97c0334d959c833d5508f9073b/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:20.976947 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41957795-1f83-4275-a8bd-38196e513af2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:20.993474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:21.036030 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec92ae-0289-4ec9-8412-9e4223a30095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e982f1e858e7450ea5cf640fb4742bd3, user_id=ebd73d97c0334d959c833d5508f9073b, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:21.037023 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 868/1718] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:20 2022] PUT /identity/v3/projects/01e76adb89804c1ebaaa485dc4b7de8b/users/0cceb0f1ade74df8982c3af624e1bfaa/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:31:21.038430 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41957795-1f83-4275-a8bd-38196e513af2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:21.047330 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec92ae-0289-4ec9-8412-9e4223a30095 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:21.095037 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 851/1719] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:20 2022] PUT /identity/v3/projects/e982f1e858e7450ea5cf640fb4742bd3/users/ebd73d97c0334d959c833d5508f9073b/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:21.099017 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223e6b6-e65b-4f21-8145-3063f24f0469 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:21.099332 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223e6b6-e65b-4f21-8145-3063f24f0469 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:21.099623 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223e6b6-e65b-4f21-8145-3063f24f0469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:21.190114 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6223e6b6-e65b-4f21-8145-3063f24f0469 None None] MFA Rules not processed for user `0cceb0f1ade74df8982c3af624e1bfaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:21.203178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6223e6b6-e65b-4f21-8145-3063f24f0469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:21.239752 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41957795-1f83-4275-a8bd-38196e513af2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:21.297749 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:21.406235 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77995d1a-f682-4971-8550-74f11925021b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:21.406909 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77995d1a-f682-4971-8550-74f11925021b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:21.407198 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77995d1a-f682-4971-8550-74f11925021b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:21.407520 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77995d1a-f682-4971-8550-74f11925021b admin admin] PATH_INFO: `/v3/users/9baac42d6b2b463eadd39269396f4993` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:21.410319 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77995d1a-f682-4971-8550-74f11925021b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9baac42d6b2b463eadd39269396f4993)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:21.413418 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77995d1a-f682-4971-8550-74f11925021b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:21.426929 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 852/1720] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:21.429324 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36234f-fe42-41ae-92ff-8acdc4fd3bd9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:21.430186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36234f-fe42-41ae-92ff-8acdc4fd3bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:21.431315 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36234f-fe42-41ae-92ff-8acdc4fd3bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:21.515220 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ec36234f-fe42-41ae-92ff-8acdc4fd3bd9 None None] MFA Rules not processed for user `ebd73d97c0334d959c833d5508f9073b`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:21.517694 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ec36234f-fe42-41ae-92ff-8acdc4fd3bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:21.551877 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-77995d1a-f682-4971-8550-74f11925021b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9baac42d6b2b463eadd39269396f4993'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:21.552850 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-77995d1a-f682-4971-8550-74f11925021b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9baac42d6b2b463eadd39269396f4993'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:21.572792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-77995d1a-f682-4971-8550-74f11925021b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9baac42d6b2b463eadd39269396f4993'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:21.573994 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-77995d1a-f682-4971-8550-74f11925021b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9baac42d6b2b463eadd39269396f4993'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:21.597519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-77995d1a-f682-4971-8550-74f11925021b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9baac42d6b2b463eadd39269396f4993'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:21.618328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 869/1721] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:21 2022] DELETE /identity/v3/users/9baac42d6b2b463eadd39269396f4993 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:21.620084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7c2e3-641b-4c82-b19b-aeff07bd947a None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:21.620409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7c2e3-641b-4c82-b19b-aeff07bd947a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:21.620649 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7c2e3-641b-4c82-b19b-aeff07bd947a None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:21.622550 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 870/1722] 10.222.0.96 () {54 vars in 912 bytes} [Wed Aug 24 04:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:31:21.623488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7c2e3-641b-4c82-b19b-aeff07bd947a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:21.628436 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-86b7c2e3-641b-4c82-b19b-aeff07bd947a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:21.720134 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 853/1723] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:21.725002 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c9394-cd8d-451f-80a4-8e656cf42c75 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:21.725603 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c9394-cd8d-451f-80a4-8e656cf42c75 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:21.726072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c9394-cd8d-451f-80a4-8e656cf42c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:21.727846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:21.795400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-b82c9394-cd8d-451f-80a4-8e656cf42c75 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:21.798191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b82c9394-cd8d-451f-80a4-8e656cf42c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:21.875498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7c2e3-641b-4c82-b19b-aeff07bd947a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:21.894807 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccea22-66c5-4821-9b11-859f92f9f14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:21.895482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccea22-66c5-4821-9b11-859f92f9f14e admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:21.895767 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccea22-66c5-4821-9b11-859f92f9f14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:21.896045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccea22-66c5-4821-9b11-859f92f9f14e admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:21.901488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dccea22-66c5-4821-9b11-859f92f9f14e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:21.903843 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dccea22-66c5-4821-9b11-859f92f9f14e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:21.993592 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 854/1724] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:21.994957 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2349a57-9deb-4518-8966-46e934aeafda None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:21.995266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2349a57-9deb-4518-8966-46e934aeafda None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:21.995524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2349a57-9deb-4518-8966-46e934aeafda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:22.031812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 871/1725] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:21 2022] POST /identity/v3/projects => generated 365 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:22.033016 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccea22-66c5-4821-9b11-859f92f9f14e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:22.035523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0dccea22-66c5-4821-9b11-859f92f9f14e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:22.123269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f2349a57-9deb-4518-8966-46e934aeafda None None] MFA Rules not processed for user `50358dbf699a41188dae93496161709d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:22.128837 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f2349a57-9deb-4518-8966-46e934aeafda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:22.148300 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccea22-66c5-4821-9b11-859f92f9f14e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:22.163733 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c5505-1c9b-40df-af12-07cd0e07702a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:22.164287 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c5505-1c9b-40df-af12-07cd0e07702a admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:22.164907 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c5505-1c9b-40df-af12-07cd0e07702a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:22.165331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c5505-1c9b-40df-af12-07cd0e07702a admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:22.166292 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c5505-1c9b-40df-af12-07cd0e07702a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:22.180875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c5505-1c9b-40df-af12-07cd0e07702a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:22.274024 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 872/1726] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:22 2022] POST /identity/v3/projects => generated 367 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:22.274024 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c5505-1c9b-40df-af12-07cd0e07702a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:22.281318 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e31c5505-1c9b-40df-af12-07cd0e07702a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:22.327394 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:22.343743 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 855/1727] 10.222.0.96 () {58 vars in 1009 bytes} [Wed Aug 24 04:31:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:22.344831 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2349a57-9deb-4518-8966-46e934aeafda None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:22.371803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2349a57-9deb-4518-8966-46e934aeafda None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:22.480236 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c5505-1c9b-40df-af12-07cd0e07702a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:22.490971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316bf92-e6ad-48a0-8c9d-77cd64cdee5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:22.491295 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316bf92-e6ad-48a0-8c9d-77cd64cdee5f service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:22.491583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316bf92-e6ad-48a0-8c9d-77cd64cdee5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:22.492010 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316bf92-e6ad-48a0-8c9d-77cd64cdee5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:22.556780 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b048dd-0c3a-4d74-875d-9514e0f2d5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:22.557382 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b048dd-0c3a-4d74-875d-9514e0f2d5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:22.557666 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b048dd-0c3a-4d74-875d-9514e0f2d5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:22.557943 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b048dd-0c3a-4d74-875d-9514e0f2d5a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:22.558601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b048dd-0c3a-4d74-875d-9514e0f2d5a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:22.560582 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b048dd-0c3a-4d74-875d-9514e0f2d5a9 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:22.623509 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 856/1728] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:22 2022] POST /identity/v3/users => generated 289 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:22.623509 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b048dd-0c3a-4d74-875d-9514e0f2d5a9 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:22.640906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:22.698736 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b048dd-0c3a-4d74-875d-9514e0f2d5a9 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:22.712719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316bf92-e6ad-48a0-8c9d-77cd64cdee5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:22.716770 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d1223-0bba-4681-8c76-02a543a73349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:22.716937 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316bf92-e6ad-48a0-8c9d-77cd64cdee5f service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:22.718310 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d1223-0bba-4681-8c76-02a543a73349 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:22.719847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d1223-0bba-4681-8c76-02a543a73349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:22.719847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d1223-0bba-4681-8c76-02a543a73349 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:22.721067 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d1223-0bba-4681-8c76-02a543a73349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:22.724353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d1223-0bba-4681-8c76-02a543a73349 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:22.746717 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 873/1729] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:22.747615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316bf92-e6ad-48a0-8c9d-77cd64cdee5f service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:22.754275 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3316bf92-e6ad-48a0-8c9d-77cd64cdee5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:22.769728 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 857/1730] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:22 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:22.773211 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebd88b-1702-4480-b39d-1fdc25d58f5b None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:22.773680 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebd88b-1702-4480-b39d-1fdc25d58f5b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:22.775573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebd88b-1702-4480-b39d-1fdc25d58f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:22.781063 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316bf92-e6ad-48a0-8c9d-77cd64cdee5f service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:22.793591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6537b6-b392-4a08-bcd5-a7d5b2c4bd47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:22.794242 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6537b6-b392-4a08-bcd5-a7d5b2c4bd47 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:22.794530 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6537b6-b392-4a08-bcd5-a7d5b2c4bd47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:22.795527 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6537b6-b392-4a08-bcd5-a7d5b2c4bd47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:22.808914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6537b6-b392-4a08-bcd5-a7d5b2c4bd47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:22.810391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6537b6-b392-4a08-bcd5-a7d5b2c4bd47 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:22.839300 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-c1ebd88b-1702-4480-b39d-1fdc25d58f5b None None] MFA Rules not processed for user `c0a2c80ee21c45af9028106a50db4791`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:22.840701 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c1ebd88b-1702-4480-b39d-1fdc25d58f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:22.841773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 874/1731] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:22.843158 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a43fae-e727-424a-b6c1-84ad20dbd012 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:22.843455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a43fae-e727-424a-b6c1-84ad20dbd012 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:22.843739 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a43fae-e727-424a-b6c1-84ad20dbd012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:22.915271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-73a43fae-e727-424a-b6c1-84ad20dbd012 None None] MFA Rules not processed for user `eb97bbb6260a45f3bfeb404b8c9fa815`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:22.916536 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-73a43fae-e727-424a-b6c1-84ad20dbd012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:23.005892 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 858/1732] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:23.007577 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebd88b-1702-4480-b39d-1fdc25d58f5b None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:23.023174 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebd88b-1702-4480-b39d-1fdc25d58f5b None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:23.030774 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a11b4-d9b4-43ee-803c-7c2a5c5c5336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:23.031586 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a11b4-d9b4-43ee-803c-7c2a5c5c5336 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:23.032282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a11b4-d9b4-43ee-803c-7c2a5c5c5336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:23.032758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a11b4-d9b4-43ee-803c-7c2a5c5c5336 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:23.033583 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a11b4-d9b4-43ee-803c-7c2a5c5c5336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:23.037365 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a11b4-d9b4-43ee-803c-7c2a5c5c5336 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:23.067503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 859/1733] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:23.067503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a11b4-d9b4-43ee-803c-7c2a5c5c5336 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:23.070069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-027a11b4-d9b4-43ee-803c-7c2a5c5c5336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:23.109845 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a11b4-d9b4-43ee-803c-7c2a5c5c5336 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:23.129833 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4d064-4388-47da-b12b-ddc198a6d80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:23.130647 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4d064-4388-47da-b12b-ddc198a6d80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:23.131054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4d064-4388-47da-b12b-ddc198a6d80b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:23.131584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4d064-4388-47da-b12b-ddc198a6d80b admin admin] PATH_INFO: `/v3/projects/6aa6fb2787a94156b22265026f980067` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:23.135637 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4d064-4388-47da-b12b-ddc198a6d80b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa6fb2787a94156b22265026f980067)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:23.137949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4d064-4388-47da-b12b-ddc198a6d80b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:23.145064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 875/1734] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:23.149741 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a43fae-e727-424a-b6c1-84ad20dbd012 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:23.200330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a43fae-e727-424a-b6c1-84ad20dbd012 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:23.216605 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b06c3c-0236-4057-a28a-3b31bdc12710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:23.217290 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b06c3c-0236-4057-a28a-3b31bdc12710 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:23.217575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b06c3c-0236-4057-a28a-3b31bdc12710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:23.217856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b06c3c-0236-4057-a28a-3b31bdc12710 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:23.218574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b06c3c-0236-4057-a28a-3b31bdc12710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:23.220191 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b06c3c-0236-4057-a28a-3b31bdc12710 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:23.248392 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 876/1735] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:23.253238 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb0c61-7742-4baf-a9f7-c5b01d04dd63 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:23.253522 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb0c61-7742-4baf-a9f7-c5b01d04dd63 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:23.253900 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb0c61-7742-4baf-a9f7-c5b01d04dd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:23.289977 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:23.295455 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5ce4d064-4388-47da-b12b-ddc198a6d80b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa6fb2787a94156b22265026f980067', 'request_id': 'req-5ce4d064-4388-47da-b12b-ddc198a6d80b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:23.304801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2dfb0c61-7742-4baf-a9f7-c5b01d04dd63 None None] MFA Rules not processed for user `c0a2c80ee21c45af9028106a50db4791`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:23.306143 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2dfb0c61-7742-4baf-a9f7-c5b01d04dd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:23.314605 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5ce4d064-4388-47da-b12b-ddc198a6d80b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa6fb2787a94156b22265026f980067', 'request_id': 'req-5ce4d064-4388-47da-b12b-ddc198a6d80b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:23.340880 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5ce4d064-4388-47da-b12b-ddc198a6d80b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa6fb2787a94156b22265026f980067', 'request_id': 'req-5ce4d064-4388-47da-b12b-ddc198a6d80b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:23.372631 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5ce4d064-4388-47da-b12b-ddc198a6d80b admin admin] The token cache is being invalidate because project 6aa6fb2787a94156b22265026f980067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:23.373112 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5ce4d064-4388-47da-b12b-ddc198a6d80b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:23.374612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5ce4d064-4388-47da-b12b-ddc198a6d80b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:23.381359 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 860/1736] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:23 2022] DELETE /identity/v3/projects/6aa6fb2787a94156b22265026f980067 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:23.383331 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4d064-4388-47da-b12b-ddc198a6d80b admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:23.385904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5ce4d064-4388-47da-b12b-ddc198a6d80b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:23.479939 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 877/1737] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:23.479939 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb0c61-7742-4baf-a9f7-c5b01d04dd63 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:23.480990 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2dfb0c61-7742-4baf-a9f7-c5b01d04dd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:23.507365 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4d064-4388-47da-b12b-ddc198a6d80b admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:23.514455 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a76d9-5994-44c0-8495-5eff7ede83df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:23.516894 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a76d9-5994-44c0-8495-5eff7ede83df admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:23.518877 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a76d9-5994-44c0-8495-5eff7ede83df admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:23.518877 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a76d9-5994-44c0-8495-5eff7ede83df admin admin] PATH_INFO: `/v3/projects/d5c60d15d76d4d719f5a12e1d5fd9487/users/458403304f924dec8689463dd9e5688a/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:23.556749 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a76d9-5994-44c0-8495-5eff7ede83df admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c60d15d76d4d719f5a12e1d5fd9487, user_id=458403304f924dec8689463dd9e5688a, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:23.596438 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a76d9-5994-44c0-8495-5eff7ede83df admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:23.639274 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 861/1738] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:23 2022] PUT /identity/v3/projects/d5c60d15d76d4d719f5a12e1d5fd9487/users/458403304f924dec8689463dd9e5688a/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:23.640636 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a76d9-5994-44c0-8495-5eff7ede83df admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:23.642906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-886a76d9-5994-44c0-8495-5eff7ede83df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:23.652808 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:23.722335 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb0c61-7742-4baf-a9f7-c5b01d04dd63 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:23.841283 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a76d9-5994-44c0-8495-5eff7ede83df admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:23.857098 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf60a1f-f60d-4a20-a5e8-873d79b73a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:23.857812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf60a1f-f60d-4a20-a5e8-873d79b73a38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:23.858100 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf60a1f-f60d-4a20-a5e8-873d79b73a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:23.858379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf60a1f-f60d-4a20-a5e8-873d79b73a38 admin admin] PATH_INFO: `/v3/projects/75ab5a95cc74498d812d45cbea3b94e4/users/f37d967e8d1d477b88a51584a6709973/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:23.879420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf60a1f-f60d-4a20-a5e8-873d79b73a38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75ab5a95cc74498d812d45cbea3b94e4, user_id=f37d967e8d1d477b88a51584a6709973, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:23.882228 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf60a1f-f60d-4a20-a5e8-873d79b73a38 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:23.904254 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 862/1739] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:23 2022] PUT /identity/v3/projects/75ab5a95cc74498d812d45cbea3b94e4/users/f37d967e8d1d477b88a51584a6709973/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:23.905139 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf60a1f-f60d-4a20-a5e8-873d79b73a38 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:23.909562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0bf60a1f-f60d-4a20-a5e8-873d79b73a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:23.916771 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfeed7-d8e5-44ae-9ad3-c241c082c062 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:23.916990 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfeed7-d8e5-44ae-9ad3-c241c082c062 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:23.917114 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfeed7-d8e5-44ae-9ad3-c241c082c062 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:23.917941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfeed7-d8e5-44ae-9ad3-c241c082c062 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:23.921639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-eadfeed7-d8e5-44ae-9ad3-c241c082c062 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:23.981560 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:24.031341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf60a1f-f60d-4a20-a5e8-873d79b73a38 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:24.034768 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadfeed7-d8e5-44ae-9ad3-c241c082c062 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:24.036463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadfeed7-d8e5-44ae-9ad3-c241c082c062 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:24.042073 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1df63-e37e-4d02-b730-62eff66f271d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:24.042767 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1df63-e37e-4d02-b730-62eff66f271d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:24.043051 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1df63-e37e-4d02-b730-62eff66f271d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:24.043331 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1df63-e37e-4d02-b730-62eff66f271d admin admin] PATH_INFO: `/v3/users/50367ed819364c28918b6deb25d180f0` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:24.046217 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1df63-e37e-4d02-b730-62eff66f271d admin admin] RBAC: Authorizing `identity:delete_user(user_id=50367ed819364c28918b6deb25d180f0)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:24.048589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1df63-e37e-4d02-b730-62eff66f271d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:24.051828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 878/1740] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:23 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:24.053072 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfeed7-d8e5-44ae-9ad3-c241c082c062 service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:24.054211 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-eadfeed7-d8e5-44ae-9ad3-c241c082c062 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:24.076017 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfeed7-d8e5-44ae-9ad3-c241c082c062 service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:24.085807 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfdc5a-ffba-44ad-8c5d-0401185c6ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:24.086544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfdc5a-ffba-44ad-8c5d-0401185c6ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:24.086806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfdc5a-ffba-44ad-8c5d-0401185c6ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:24.087184 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfdc5a-ffba-44ad-8c5d-0401185c6ec4 admin admin] PATH_INFO: `/v3/projects/b5152c65eb264ca199682f5f61dfb86a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:24.088641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfdc5a-ffba-44ad-8c5d-0401185c6ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5152c65eb264ca199682f5f61dfb86a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:24.090911 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfdc5a-ffba-44ad-8c5d-0401185c6ec4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:24.126379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e7e1df63-e37e-4d02-b730-62eff66f271d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50367ed819364c28918b6deb25d180f0'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:24.128186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e7e1df63-e37e-4d02-b730-62eff66f271d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50367ed819364c28918b6deb25d180f0'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:24.144224 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e7e1df63-e37e-4d02-b730-62eff66f271d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50367ed819364c28918b6deb25d180f0'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:24.145259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e7e1df63-e37e-4d02-b730-62eff66f271d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50367ed819364c28918b6deb25d180f0'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:24.165209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e7e1df63-e37e-4d02-b730-62eff66f271d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50367ed819364c28918b6deb25d180f0'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:24.168212 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c7bfdc5a-ffba-44ad-8c5d-0401185c6ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5152c65eb264ca199682f5f61dfb86a', 'request_id': 'req-c7bfdc5a-ffba-44ad-8c5d-0401185c6ec4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:24.183488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c7bfdc5a-ffba-44ad-8c5d-0401185c6ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5152c65eb264ca199682f5f61dfb86a', 'request_id': 'req-c7bfdc5a-ffba-44ad-8c5d-0401185c6ec4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:24.202583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c7bfdc5a-ffba-44ad-8c5d-0401185c6ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5152c65eb264ca199682f5f61dfb86a', 'request_id': 'req-c7bfdc5a-ffba-44ad-8c5d-0401185c6ec4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:24.220565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 863/1741] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:23 2022] DELETE /identity/v3/users/50367ed819364c28918b6deb25d180f0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:24.223735 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1df63-e37e-4d02-b730-62eff66f271d admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:24.225552 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e7e1df63-e37e-4d02-b730-62eff66f271d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:24.228641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c7bfdc5a-ffba-44ad-8c5d-0401185c6ec4 admin admin] The token cache is being invalidate because project b5152c65eb264ca199682f5f61dfb86a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:24.229545 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c7bfdc5a-ffba-44ad-8c5d-0401185c6ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:24.231680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c7bfdc5a-ffba-44ad-8c5d-0401185c6ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:24.235242 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 879/1742] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:24 2022] DELETE /identity/v3/projects/b5152c65eb264ca199682f5f61dfb86a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:24.241279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfdc5a-ffba-44ad-8c5d-0401185c6ec4 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:24.243090 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c7bfdc5a-ffba-44ad-8c5d-0401185c6ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:24.279662 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:24.447168 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1df63-e37e-4d02-b730-62eff66f271d admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:24.475046 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1f557-2f15-4f7e-a6a7-eefcef02efcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:24.475889 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1f557-2f15-4f7e-a6a7-eefcef02efcf admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:24.476452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1f557-2f15-4f7e-a6a7-eefcef02efcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:24.476873 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1f557-2f15-4f7e-a6a7-eefcef02efcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:24.477817 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1f557-2f15-4f7e-a6a7-eefcef02efcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:24.485032 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1f557-2f15-4f7e-a6a7-eefcef02efcf admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:24.497281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfdc5a-ffba-44ad-8c5d-0401185c6ec4 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:24.521414 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 864/1743] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:24.523253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b9849-27ee-4703-b3d1-58235eea7ae4 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:24.523868 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b9849-27ee-4703-b3d1-58235eea7ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:24.526323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b9849-27ee-4703-b3d1-58235eea7ae4 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:24.530348 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 865/1744] 10.222.0.96 () {54 vars in 961 bytes} [Wed Aug 24 04:31:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:31:24.533369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b9849-27ee-4703-b3d1-58235eea7ae4 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:24.542948 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-266b9849-27ee-4703-b3d1-58235eea7ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:24.592391 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b9849-27ee-4703-b3d1-58235eea7ae4 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:24.604426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4bb16-c9d0-4b43-a920-0ddb8626dd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:24.605568 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4bb16-c9d0-4b43-a920-0ddb8626dd03 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:24.611422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4bb16-c9d0-4b43-a920-0ddb8626dd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:24.611422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4bb16-c9d0-4b43-a920-0ddb8626dd03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:24.611422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4bb16-c9d0-4b43-a920-0ddb8626dd03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:24.611422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4bb16-c9d0-4b43-a920-0ddb8626dd03 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:24.645536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 866/1745] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:24.648102 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4bb16-c9d0-4b43-a920-0ddb8626dd03 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:24.650192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-dee4bb16-c9d0-4b43-a920-0ddb8626dd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:24.672936 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4bb16-c9d0-4b43-a920-0ddb8626dd03 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:24.685833 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245435d6-fe71-4d28-ad12-85960d3a94f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:24.687127 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245435d6-fe71-4d28-ad12-85960d3a94f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:24.688043 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245435d6-fe71-4d28-ad12-85960d3a94f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:24.689026 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245435d6-fe71-4d28-ad12-85960d3a94f6 admin admin] PATH_INFO: `/v3/users/7420ee6490dc4613add3c2ba6c91f7b9` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:24.697319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245435d6-fe71-4d28-ad12-85960d3a94f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7420ee6490dc4613add3c2ba6c91f7b9)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:24.699876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245435d6-fe71-4d28-ad12-85960d3a94f6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:24.715000 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba4dc2-eebe-45cf-b76a-aad8a32503a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:24.716228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba4dc2-eebe-45cf-b76a-aad8a32503a4 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:24.717169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba4dc2-eebe-45cf-b76a-aad8a32503a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:24.717621 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba4dc2-eebe-45cf-b76a-aad8a32503a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:24.723435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-69ba4dc2-eebe-45cf-b76a-aad8a32503a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:24.840469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:24.864063 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-245435d6-fe71-4d28-ad12-85960d3a94f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7420ee6490dc4613add3c2ba6c91f7b9'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:24.865863 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-245435d6-fe71-4d28-ad12-85960d3a94f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7420ee6490dc4613add3c2ba6c91f7b9'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:24.906978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-245435d6-fe71-4d28-ad12-85960d3a94f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7420ee6490dc4613add3c2ba6c91f7b9'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:24.908072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-245435d6-fe71-4d28-ad12-85960d3a94f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7420ee6490dc4613add3c2ba6c91f7b9'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:24.928209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-245435d6-fe71-4d28-ad12-85960d3a94f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7420ee6490dc4613add3c2ba6c91f7b9'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:24.941595 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba4dc2-eebe-45cf-b76a-aad8a32503a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:24.953089 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba4dc2-eebe-45cf-b76a-aad8a32503a4 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:24.969506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 867/1746] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:24 2022] DELETE /identity/v3/users/7420ee6490dc4613add3c2ba6c91f7b9 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:24.970909 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245435d6-fe71-4d28-ad12-85960d3a94f6 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:24.973648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-245435d6-fe71-4d28-ad12-85960d3a94f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:24.986222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 880/1747] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 750 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:24.988086 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482b867-d909-493a-81de-ea4e60e0ead7 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:24.988421 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482b867-d909-493a-81de-ea4e60e0ead7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:24.996548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482b867-d909-493a-81de-ea4e60e0ead7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:25.074693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d482b867-d909-493a-81de-ea4e60e0ead7 None None] MFA Rules not processed for user `d1f7fe9af30947dbae1f2334b18f630d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:25.080747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d482b867-d909-493a-81de-ea4e60e0ead7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:25.210383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245435d6-fe71-4d28-ad12-85960d3a94f6 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:25.222927 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e09d0-1fa5-48fa-9caa-68873be7b80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:25.223640 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e09d0-1fa5-48fa-9caa-68873be7b80f admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:25.223925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e09d0-1fa5-48fa-9caa-68873be7b80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:25.224204 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e09d0-1fa5-48fa-9caa-68873be7b80f admin admin] PATH_INFO: `/v3/projects/d5c60d15d76d4d719f5a12e1d5fd9487/users/458403304f924dec8689463dd9e5688a/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:25.226518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:25.226825 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e09d0-1fa5-48fa-9caa-68873be7b80f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c60d15d76d4d719f5a12e1d5fd9487, user_id=458403304f924dec8689463dd9e5688a, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:25.230954 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e09d0-1fa5-48fa-9caa-68873be7b80f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:25.263523 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 868/1748] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:24 2022] PUT /identity/v3/projects/d5c60d15d76d4d719f5a12e1d5fd9487/users/458403304f924dec8689463dd9e5688a/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:25.266468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e09d0-1fa5-48fa-9caa-68873be7b80f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:25.288041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 881/1749] 10.222.0.96 () {58 vars in 1058 bytes} [Wed Aug 24 04:31:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:25.289251 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482b867-d909-493a-81de-ea4e60e0ead7 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:25.290723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d482b867-d909-493a-81de-ea4e60e0ead7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:25.295656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-aa4e09d0-1fa5-48fa-9caa-68873be7b80f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:25.321156 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482b867-d909-493a-81de-ea4e60e0ead7 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:25.453972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e09d0-1fa5-48fa-9caa-68873be7b80f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:25.467478 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7f2e9-4ef6-4c43-aa21-a2ce2db1e92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:25.467968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294859a-494f-4658-8db1-3f0032fb97f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:25.469679 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7f2e9-4ef6-4c43-aa21-a2ce2db1e92b admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:25.469974 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7f2e9-4ef6-4c43-aa21-a2ce2db1e92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:25.470577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294859a-494f-4658-8db1-3f0032fb97f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:25.471107 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294859a-494f-4658-8db1-3f0032fb97f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:25.471391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294859a-494f-4658-8db1-3f0032fb97f5 admin admin] PATH_INFO: `/v3/projects/c090c5dd17104ad2ac72d21b2976e116` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:25.472219 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7f2e9-4ef6-4c43-aa21-a2ce2db1e92b admin admin] PATH_INFO: `/v3/projects/75ab5a95cc74498d812d45cbea3b94e4/users/f37d967e8d1d477b88a51584a6709973/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:25.476193 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294859a-494f-4658-8db1-3f0032fb97f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c090c5dd17104ad2ac72d21b2976e116)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:25.477131 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7f2e9-4ef6-4c43-aa21-a2ce2db1e92b admin admin] RBAC: Authorizing `identity:create_grant(project_id=75ab5a95cc74498d812d45cbea3b94e4, user_id=f37d967e8d1d477b88a51584a6709973, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:25.480669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294859a-494f-4658-8db1-3f0032fb97f5 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:25.483431 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7f2e9-4ef6-4c43-aa21-a2ce2db1e92b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:25.523179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 869/1750] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:25 2022] PUT /identity/v3/projects/75ab5a95cc74498d812d45cbea3b94e4/users/f37d967e8d1d477b88a51584a6709973/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:25.523179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d073f42-ec47-443c-ab5d-c4ee17fecc10 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:25.523179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d073f42-ec47-443c-ab5d-c4ee17fecc10 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:25.523179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d073f42-ec47-443c-ab5d-c4ee17fecc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:25.627741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-2d073f42-ec47-443c-ab5d-c4ee17fecc10 None None] MFA Rules not processed for user `458403304f924dec8689463dd9e5688a`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:25.636435 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2d073f42-ec47-443c-ab5d-c4ee17fecc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:25.643161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a294859a-494f-4658-8db1-3f0032fb97f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c090c5dd17104ad2ac72d21b2976e116', 'request_id': 'req-a294859a-494f-4658-8db1-3f0032fb97f5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:25.672159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a294859a-494f-4658-8db1-3f0032fb97f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c090c5dd17104ad2ac72d21b2976e116', 'request_id': 'req-a294859a-494f-4658-8db1-3f0032fb97f5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:25.682124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a294859a-494f-4658-8db1-3f0032fb97f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c090c5dd17104ad2ac72d21b2976e116', 'request_id': 'req-a294859a-494f-4658-8db1-3f0032fb97f5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:25.720072 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a294859a-494f-4658-8db1-3f0032fb97f5 admin admin] The token cache is being invalidate because project c090c5dd17104ad2ac72d21b2976e116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:25.720610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a294859a-494f-4658-8db1-3f0032fb97f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:25.721478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a294859a-494f-4658-8db1-3f0032fb97f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:25.725317 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 882/1751] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:25 2022] DELETE /identity/v3/projects/c090c5dd17104ad2ac72d21b2976e116 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:25.726805 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294859a-494f-4658-8db1-3f0032fb97f5 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:25.728859 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a294859a-494f-4658-8db1-3f0032fb97f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:25.742576 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:25.843559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 870/1752] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:25.843559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdd14b-d42f-407e-87ce-278c9cb65d72 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:25.843559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdd14b-d42f-407e-87ce-278c9cb65d72 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:25.843559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdd14b-d42f-407e-87ce-278c9cb65d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:25.903605 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4fbdd14b-d42f-407e-87ce-278c9cb65d72 None None] MFA Rules not processed for user `f37d967e8d1d477b88a51584a6709973`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:25.904937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4fbdd14b-d42f-407e-87ce-278c9cb65d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:25.923908 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294859a-494f-4658-8db1-3f0032fb97f5 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:25.937332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c766bf-ac6a-4e8e-b525-f2abb5b838cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f7fe9af30947dbae1f2334b18f630d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:25.938347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c766bf-ac6a-4e8e-b525-f2abb5b838cc service placement] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:25.938907 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c766bf-ac6a-4e8e-b525-f2abb5b838cc service placement] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:25.939391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c766bf-ac6a-4e8e-b525-f2abb5b838cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:25.942433 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f0c766bf-ac6a-4e8e-b525-f2abb5b838cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:25.955488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c766bf-ac6a-4e8e-b525-f2abb5b838cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:25.958006 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c766bf-ac6a-4e8e-b525-f2abb5b838cc service placement] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:25.972037 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 883/1753] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:25.978212 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227b304-007e-4e86-86d9-9b9309046897 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:25.978727 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227b304-007e-4e86-86d9-9b9309046897 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:25.979111 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227b304-007e-4e86-86d9-9b9309046897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:26.013838 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:26.049194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5227b304-007e-4e86-86d9-9b9309046897 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:26.052829 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5227b304-007e-4e86-86d9-9b9309046897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:26.184633 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 871/1754] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:26.184633 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdd14b-d42f-407e-87ce-278c9cb65d72 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:26.184633 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4fbdd14b-d42f-407e-87ce-278c9cb65d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:26.244397 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 884/1755] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:26.250859 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37832f-973a-41ec-bf4a-fb2054af7347 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:26.251290 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37832f-973a-41ec-bf4a-fb2054af7347 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:26.251680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37832f-973a-41ec-bf4a-fb2054af7347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:26.307141 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bf37832f-973a-41ec-bf4a-fb2054af7347 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:26.308797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bf37832f-973a-41ec-bf4a-fb2054af7347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:26.339872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 885/1756] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:31:26.344020 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37832f-973a-41ec-bf4a-fb2054af7347 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:26.360402 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdd14b-d42f-407e-87ce-278c9cb65d72 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:26.363622 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37832f-973a-41ec-bf4a-fb2054af7347 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:26.368001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379ad38-1a74-423c-bed4-e2808ab56fac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:26.369641 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379ad38-1a74-423c-bed4-e2808ab56fac service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:26.369940 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379ad38-1a74-423c-bed4-e2808ab56fac service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:26.370286 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379ad38-1a74-423c-bed4-e2808ab56fac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:26.376252 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ccfc7-eb42-4ffd-a1df-ceb531daa773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:26.377404 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ccfc7-eb42-4ffd-a1df-ceb531daa773 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:26.378009 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ccfc7-eb42-4ffd-a1df-ceb531daa773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:26.378593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ccfc7-eb42-4ffd-a1df-ceb531daa773 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:26.381306 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ccfc7-eb42-4ffd-a1df-ceb531daa773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:26.381980 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ccfc7-eb42-4ffd-a1df-ceb531daa773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:26.384584 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ccfc7-eb42-4ffd-a1df-ceb531daa773 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:26.395868 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379ad38-1a74-423c-bed4-e2808ab56fac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:26.401553 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379ad38-1a74-423c-bed4-e2808ab56fac service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:26.418128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 886/1757] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:31:26.422655 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ccfc7-eb42-4ffd-a1df-ceb531daa773 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:26.427683 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ab4ccfc7-eb42-4ffd-a1df-ceb531daa773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:26.451379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 872/1758] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:26.459445 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379ad38-1a74-423c-bed4-e2808ab56fac service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:26.469354 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ccfc7-eb42-4ffd-a1df-ceb531daa773 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:26.476292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379ad38-1a74-423c-bed4-e2808ab56fac service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:26.485152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0d820-fcb5-418d-80dd-07c0e8345ecf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:26.486044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0d820-fcb5-418d-80dd-07c0e8345ecf service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:26.491252 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0d820-fcb5-418d-80dd-07c0e8345ecf service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:26.492005 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0d820-fcb5-418d-80dd-07c0e8345ecf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:26.493624 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67b5b5-6cc6-48dc-8b27-0133038c300d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:26.496163 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67b5b5-6cc6-48dc-8b27-0133038c300d admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:26.497264 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67b5b5-6cc6-48dc-8b27-0133038c300d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:26.498376 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67b5b5-6cc6-48dc-8b27-0133038c300d admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:26.502127 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67b5b5-6cc6-48dc-8b27-0133038c300d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:26.510801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67b5b5-6cc6-48dc-8b27-0133038c300d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:26.526454 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0d820-fcb5-418d-80dd-07c0e8345ecf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:26.531448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0d820-fcb5-418d-80dd-07c0e8345ecf service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:26.566290 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 887/1759] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:26.579634 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0d820-fcb5-418d-80dd-07c0e8345ecf service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:26.591119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6ab0d820-fcb5-418d-80dd-07c0e8345ecf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:26.626508 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 873/1760] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:26 2022] POST /identity/v3/projects => generated 365 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:26.630932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67b5b5-6cc6-48dc-8b27-0133038c300d admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:26.672092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0d820-fcb5-418d-80dd-07c0e8345ecf service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:26.839971 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:26.892796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5c967-b2ac-4ea7-b135-ed54f75321c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:26.895765 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5c967-b2ac-4ea7-b135-ed54f75321c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:26.896076 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5c967-b2ac-4ea7-b135-ed54f75321c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:26.900627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5c967-b2ac-4ea7-b135-ed54f75321c9 admin admin] PATH_INFO: `/v3/projects/9709282f7d9744ef9a6d10bda8e830aa` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:26.902745 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67b5b5-6cc6-48dc-8b27-0133038c300d admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:26.903289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5c967-b2ac-4ea7-b135-ed54f75321c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9709282f7d9744ef9a6d10bda8e830aa)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:26.908000 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5c967-b2ac-4ea7-b135-ed54f75321c9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:26.915546 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e689040-1599-4f8b-b190-8546df7f8b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:26.916183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e689040-1599-4f8b-b190-8546df7f8b3f admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:26.916471 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e689040-1599-4f8b-b190-8546df7f8b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:26.916774 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e689040-1599-4f8b-b190-8546df7f8b3f admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:26.917422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e689040-1599-4f8b-b190-8546df7f8b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:26.927401 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e689040-1599-4f8b-b190-8546df7f8b3f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:27.002525 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 874/1761] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:26 2022] POST /identity/v3/users => generated 283 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:27.006451 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e689040-1599-4f8b-b190-8546df7f8b3f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:27.095690 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e689040-1599-4f8b-b190-8546df7f8b3f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:27.098883 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-38f5c967-b2ac-4ea7-b135-ed54f75321c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9709282f7d9744ef9a6d10bda8e830aa', 'request_id': 'req-38f5c967-b2ac-4ea7-b135-ed54f75321c9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:27.132361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-38f5c967-b2ac-4ea7-b135-ed54f75321c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9709282f7d9744ef9a6d10bda8e830aa', 'request_id': 'req-38f5c967-b2ac-4ea7-b135-ed54f75321c9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:27.153562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-38f5c967-b2ac-4ea7-b135-ed54f75321c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9709282f7d9744ef9a6d10bda8e830aa', 'request_id': 'req-38f5c967-b2ac-4ea7-b135-ed54f75321c9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:27.185883 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:27.189213 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a4801-3a48-4372-9259-19b7d815d979 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:27.190966 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a4801-3a48-4372-9259-19b7d815d979 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:27.191534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a4801-3a48-4372-9259-19b7d815d979 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:27.192013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a4801-3a48-4372-9259-19b7d815d979 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:27.194179 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-38f5c967-b2ac-4ea7-b135-ed54f75321c9 admin admin] The token cache is being invalidate because project 9709282f7d9744ef9a6d10bda8e830aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:27.194485 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-38f5c967-b2ac-4ea7-b135-ed54f75321c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:27.195487 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0c9a4801-3a48-4372-9259-19b7d815d979 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:27.204343 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-38f5c967-b2ac-4ea7-b135-ed54f75321c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:27.207032 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 888/1762] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:26 2022] DELETE /identity/v3/projects/9709282f7d9744ef9a6d10bda8e830aa => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:27.208125 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5c967-b2ac-4ea7-b135-ed54f75321c9 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:27.212556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-38f5c967-b2ac-4ea7-b135-ed54f75321c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:27.243906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5c967-b2ac-4ea7-b135-ed54f75321c9 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:27.251896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071c83b-ce5a-4b72-8626-3e359b331d2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:27.254133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071c83b-ce5a-4b72-8626-3e359b331d2c service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:27.254133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071c83b-ce5a-4b72-8626-3e359b331d2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:27.254401 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071c83b-ce5a-4b72-8626-3e359b331d2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:27.260702 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8071c83b-ce5a-4b72-8626-3e359b331d2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:27.402215 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a4801-3a48-4372-9259-19b7d815d979 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:27.406092 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a4801-3a48-4372-9259-19b7d815d979 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:27.438413 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071c83b-ce5a-4b72-8626-3e359b331d2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:27.440046 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 875/1763] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:27.440850 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071c83b-ce5a-4b72-8626-3e359b331d2c service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:27.441099 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a4801-3a48-4372-9259-19b7d815d979 service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:27.493756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 889/1764] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:27.498093 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:27.507478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bac668-a7d5-49a3-865e-35e8558e8f2c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:27.507770 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bac668-a7d5-49a3-865e-35e8558e8f2c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:27.508054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bac668-a7d5-49a3-865e-35e8558e8f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:27.590846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c0bac668-a7d5-49a3-865e-35e8558e8f2c None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:27.592106 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c0bac668-a7d5-49a3-865e-35e8558e8f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:27.608442 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a4801-3a48-4372-9259-19b7d815d979 service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:27.624561 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05246994-6d47-49bf-9556-bf4a767dece1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:27.625572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05246994-6d47-49bf-9556-bf4a767dece1 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:27.627063 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05246994-6d47-49bf-9556-bf4a767dece1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:27.627504 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05246994-6d47-49bf-9556-bf4a767dece1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:27.630739 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05246994-6d47-49bf-9556-bf4a767dece1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:27.632111 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 890/1765] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:27.638550 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05246994-6d47-49bf-9556-bf4a767dece1 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:27.639868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3784e-7508-4b2e-9983-d6f196685c64 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:27.640164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3784e-7508-4b2e-9983-d6f196685c64 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:27.640727 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3784e-7508-4b2e-9983-d6f196685c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:27.679830 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 876/1766] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:27.684304 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05246994-6d47-49bf-9556-bf4a767dece1 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:27.692145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-05246994-6d47-49bf-9556-bf4a767dece1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:27.706963 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-7bd3784e-7508-4b2e-9983-d6f196685c64 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:27.708775 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7bd3784e-7508-4b2e-9983-d6f196685c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:27.727377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05246994-6d47-49bf-9556-bf4a767dece1 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:27.746410 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992c69c-1f45-41e5-b9b1-1b0a39271766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:27.747116 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992c69c-1f45-41e5-b9b1-1b0a39271766 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:27.747435 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992c69c-1f45-41e5-b9b1-1b0a39271766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:27.747716 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992c69c-1f45-41e5-b9b1-1b0a39271766 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:27.750976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 891/1767] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:31:27.756064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c3cf9-e0cb-4219-bcb2-42610481f152 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:27.756245 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992c69c-1f45-41e5-b9b1-1b0a39271766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:27.756350 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c3cf9-e0cb-4219-bcb2-42610481f152 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:27.756613 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c3cf9-e0cb-4219-bcb2-42610481f152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:27.757829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992c69c-1f45-41e5-b9b1-1b0a39271766 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:27.809122 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 877/1768] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:27.811356 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992c69c-1f45-41e5-b9b1-1b0a39271766 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:27.849981 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-7a0c3cf9-e0cb-4219-bcb2-42610481f152 None None] MFA Rules not processed for user `c0a2c80ee21c45af9028106a50db4791`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:27.852099 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992c69c-1f45-41e5-b9b1-1b0a39271766 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:27.853755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7a0c3cf9-e0cb-4219-bcb2-42610481f152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:27.865971 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8578656-ac7b-4d0b-817c-85a49fe3f223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:27.877499 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8578656-ac7b-4d0b-817c-85a49fe3f223 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:27.878879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8578656-ac7b-4d0b-817c-85a49fe3f223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:27.879273 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8578656-ac7b-4d0b-817c-85a49fe3f223 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:27.879995 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8578656-ac7b-4d0b-817c-85a49fe3f223 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:27.880315 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8578656-ac7b-4d0b-817c-85a49fe3f223 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:27.890338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8578656-ac7b-4d0b-817c-85a49fe3f223 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:27.970985 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 878/1769] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:31:27.972580 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8578656-ac7b-4d0b-817c-85a49fe3f223 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:28.009493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8578656-ac7b-4d0b-817c-85a49fe3f223 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:28.028250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95e8da-2ade-410e-94a7-30095c2706e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:28.029379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95e8da-2ade-410e-94a7-30095c2706e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:28.029919 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95e8da-2ade-410e-94a7-30095c2706e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:28.030299 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95e8da-2ade-410e-94a7-30095c2706e3 admin admin] PATH_INFO: `/v3/projects/e856b388396b48cc832f6abe67d1f797/users/83496807d0f54bf98123867cef0f1edc/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:28.055304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 892/1770] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:28.073614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c3cf9-e0cb-4219-bcb2-42610481f152 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:28.081012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95e8da-2ade-410e-94a7-30095c2706e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e856b388396b48cc832f6abe67d1f797, user_id=83496807d0f54bf98123867cef0f1edc, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:28.084352 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95e8da-2ade-410e-94a7-30095c2706e3 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:28.110156 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c3cf9-e0cb-4219-bcb2-42610481f152 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:28.129185 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddaa16c-8fb4-4f66-91e3-f371c4303c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:28.129841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaa16c-8fb4-4f66-91e3-f371c4303c5f admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:28.130129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaa16c-8fb4-4f66-91e3-f371c4303c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:28.134610 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 879/1771] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:27 2022] PUT /identity/v3/projects/e856b388396b48cc832f6abe67d1f797/users/83496807d0f54bf98123867cef0f1edc/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:28.135381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaa16c-8fb4-4f66-91e3-f371c4303c5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:28.140548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddaa16c-8fb4-4f66-91e3-f371c4303c5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:28.145793 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddaa16c-8fb4-4f66-91e3-f371c4303c5f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:28.146472 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d626c0-7d69-4f27-b884-abb75c3eaf62 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:28.146983 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d626c0-7d69-4f27-b884-abb75c3eaf62 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:28.147936 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d626c0-7d69-4f27-b884-abb75c3eaf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:28.217486 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-45d626c0-7d69-4f27-b884-abb75c3eaf62 None None] MFA Rules not processed for user `83496807d0f54bf98123867cef0f1edc`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:28.218894 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-45d626c0-7d69-4f27-b884-abb75c3eaf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:28.277979 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 893/1772] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:28 2022] POST /identity/v3/projects => generated 391 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:28.279430 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddaa16c-8fb4-4f66-91e3-f371c4303c5f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:28.410277 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 880/1773] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:31:28.411369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d626c0-7d69-4f27-b884-abb75c3eaf62 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:28.545152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddaa16c-8fb4-4f66-91e3-f371c4303c5f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:28.568619 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be382574-1b43-4ed7-9154-2a06e6f48d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:28.569296 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be382574-1b43-4ed7-9154-2a06e6f48d13 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:28.569586 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be382574-1b43-4ed7-9154-2a06e6f48d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:28.569872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be382574-1b43-4ed7-9154-2a06e6f48d13 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:28.570583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be382574-1b43-4ed7-9154-2a06e6f48d13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:28.574935 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be382574-1b43-4ed7-9154-2a06e6f48d13 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:28.615038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d626c0-7d69-4f27-b884-abb75c3eaf62 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:28.630951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:28.651109 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 894/1774] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:28 2022] POST /identity/v3/users => generated 296 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:28.651590 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704f1b3-0d46-4863-9af3-d3ce142b6a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:28.652147 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be382574-1b43-4ed7-9154-2a06e6f48d13 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:28.652984 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704f1b3-0d46-4863-9af3-d3ce142b6a07 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:28.677335 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704f1b3-0d46-4863-9af3-d3ce142b6a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:28.677941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704f1b3-0d46-4863-9af3-d3ce142b6a07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:28.689598 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704f1b3-0d46-4863-9af3-d3ce142b6a07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:28.695769 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704f1b3-0d46-4863-9af3-d3ce142b6a07 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:28.697595 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be382574-1b43-4ed7-9154-2a06e6f48d13 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:28.732017 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589fc35-5e62-42be-af67-c8262f029a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:28.732570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589fc35-5e62-42be-af67-c8262f029a46 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:28.732884 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589fc35-5e62-42be-af67-c8262f029a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:28.733162 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589fc35-5e62-42be-af67-c8262f029a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:28.733852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589fc35-5e62-42be-af67-c8262f029a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:28.735486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589fc35-5e62-42be-af67-c8262f029a46 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:28.782596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 895/1775] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:28.791035 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589fc35-5e62-42be-af67-c8262f029a46 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:28.805547 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:28.822035 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 881/1776] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:28 2022] POST /identity/v3/projects => generated 363 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:28.826049 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704f1b3-0d46-4863-9af3-d3ce142b6a07 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:28.844571 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589fc35-5e62-42be-af67-c8262f029a46 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:29.061514 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704f1b3-0d46-4863-9af3-d3ce142b6a07 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:29.063441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b67d10-be4f-4c27-925e-fe49065a2496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:29.064269 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b67d10-be4f-4c27-925e-fe49065a2496 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:29.064559 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b67d10-be4f-4c27-925e-fe49065a2496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:29.064885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b67d10-be4f-4c27-925e-fe49065a2496 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:29.065663 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b67d10-be4f-4c27-925e-fe49065a2496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:29.067385 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b67d10-be4f-4c27-925e-fe49065a2496 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:29.079138 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfdc10-ad6e-423a-9acb-6faa253745b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:29.079813 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfdc10-ad6e-423a-9acb-6faa253745b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:29.080095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfdc10-ad6e-423a-9acb-6faa253745b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:29.080344 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfdc10-ad6e-423a-9acb-6faa253745b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:29.081091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dfdc10-ad6e-423a-9acb-6faa253745b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:29.083237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dfdc10-ad6e-423a-9acb-6faa253745b3 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:29.125183 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 896/1777] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:29.141110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b67d10-be4f-4c27-925e-fe49065a2496 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:29.163242 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 882/1778] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:28 2022] POST /identity/v3/users => generated 288 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:29.163786 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b67d10-be4f-4c27-925e-fe49065a2496 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:29.191702 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfdc10-ad6e-423a-9acb-6faa253745b3 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:29.194015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad04cfc-758c-4a6e-81f4-5855c73238a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:29.196442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad04cfc-758c-4a6e-81f4-5855c73238a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:29.202897 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad04cfc-758c-4a6e-81f4-5855c73238a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:29.205413 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad04cfc-758c-4a6e-81f4-5855c73238a0 admin admin] PATH_INFO: `/v3/projects/2da72f099210403facf895798c295e4e/users/ad26f803813640aca00c0812d2a2c99b/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:29.215478 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfdc10-ad6e-423a-9acb-6faa253745b3 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:29.223655 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7ccf3-1d66-4a56-ba97-094d6b63aaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:29.224447 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7ccf3-1d66-4a56-ba97-094d6b63aaa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:29.224928 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7ccf3-1d66-4a56-ba97-094d6b63aaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:29.225310 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7ccf3-1d66-4a56-ba97-094d6b63aaa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:29.227946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7ccf3-1d66-4a56-ba97-094d6b63aaa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:29.239595 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7ccf3-1d66-4a56-ba97-094d6b63aaa9 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:29.269928 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad04cfc-758c-4a6e-81f4-5855c73238a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da72f099210403facf895798c295e4e, user_id=ad26f803813640aca00c0812d2a2c99b, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:29.275772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad04cfc-758c-4a6e-81f4-5855c73238a0 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:29.280909 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 883/1779] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:29.282514 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7ccf3-1d66-4a56-ba97-094d6b63aaa9 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:29.314722 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 897/1780] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:29 2022] PUT /identity/v3/projects/2da72f099210403facf895798c295e4e/users/ad26f803813640aca00c0812d2a2c99b/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:29.326581 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d984b-7e8e-417e-b88d-17e6a54ee1d9 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:29.327315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d984b-7e8e-417e-b88d-17e6a54ee1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:29.327839 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d984b-7e8e-417e-b88d-17e6a54ee1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:29.354155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7ccf3-1d66-4a56-ba97-094d6b63aaa9 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:29.406756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5f6d984b-7e8e-417e-b88d-17e6a54ee1d9 None None] MFA Rules not processed for user `ad26f803813640aca00c0812d2a2c99b`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:29.409154 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5f6d984b-7e8e-417e-b88d-17e6a54ee1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:29.560597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2dbfc-9b1f-46cf-ad9e-361ba6c51ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:29.568775 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2dbfc-9b1f-46cf-ad9e-361ba6c51ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:29.570444 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2dbfc-9b1f-46cf-ad9e-361ba6c51ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:29.571273 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2dbfc-9b1f-46cf-ad9e-361ba6c51ab3 admin admin] PATH_INFO: `/v3/projects/9dd8eed3376943159e967d8766154831/users/ea0f05d5a0da459e9f3eea53bc53c528/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:29.624877 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2dbfc-9b1f-46cf-ad9e-361ba6c51ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd8eed3376943159e967d8766154831, user_id=ea0f05d5a0da459e9f3eea53bc53c528, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:29.634286 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2dbfc-9b1f-46cf-ad9e-361ba6c51ab3 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:29.669214 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 898/1781] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:31:29.675488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d984b-7e8e-417e-b88d-17e6a54ee1d9 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:29.681594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 884/1782] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:29 2022] PUT /identity/v3/projects/9dd8eed3376943159e967d8766154831/users/ea0f05d5a0da459e9f3eea53bc53c528/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:29.688042 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2dbfc-9b1f-46cf-ad9e-361ba6c51ab3 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:29.724868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d984b-7e8e-417e-b88d-17e6a54ee1d9 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:29.910595 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2dbfc-9b1f-46cf-ad9e-361ba6c51ab3 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:29.925490 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94966cd-d548-4b28-9a0e-2614321d749b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:29.926843 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94966cd-d548-4b28-9a0e-2614321d749b admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:29.930803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94966cd-d548-4b28-9a0e-2614321d749b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:29.931300 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94966cd-d548-4b28-9a0e-2614321d749b admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:29.932413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94966cd-d548-4b28-9a0e-2614321d749b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:29.934351 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94966cd-d548-4b28-9a0e-2614321d749b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:29.942446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:29.946824 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:29.967552 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 885/1783] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:29.969045 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b077169-2924-4f10-bcf5-216441668c2a None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:29.969335 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b077169-2924-4f10-bcf5-216441668c2a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:29.969614 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b077169-2924-4f10-bcf5-216441668c2a None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:29.974764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 886/1784] 10.222.0.96 () {54 vars in 912 bytes} [Wed Aug 24 04:31:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:31:29.975520 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b077169-2924-4f10-bcf5-216441668c2a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:30.009064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b077169-2924-4f10-bcf5-216441668c2a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:30.009350 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76181f52-a074-4ca5-a7bd-e65a20c4c0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:30.010176 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76181f52-a074-4ca5-a7bd-e65a20c4c0d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:30.011348 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76181f52-a074-4ca5-a7bd-e65a20c4c0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:30.011889 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76181f52-a074-4ca5-a7bd-e65a20c4c0d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:30.013424 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76181f52-a074-4ca5-a7bd-e65a20c4c0d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:30.018263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97866733-a960-4037-b866-2b70d00c8441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:30.019865 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97866733-a960-4037-b866-2b70d00c8441 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:30.020234 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97866733-a960-4037-b866-2b70d00c8441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:30.020514 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97866733-a960-4037-b866-2b70d00c8441 admin admin] PATH_INFO: `/v3/projects/9dd8eed3376943159e967d8766154831/users/ea0f05d5a0da459e9f3eea53bc53c528/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:30.021531 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76181f52-a074-4ca5-a7bd-e65a20c4c0d9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:30.025029 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97866733-a960-4037-b866-2b70d00c8441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd8eed3376943159e967d8766154831, user_id=ea0f05d5a0da459e9f3eea53bc53c528, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:30.028490 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97866733-a960-4037-b866-2b70d00c8441 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:30.067681 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 887/1785] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:29 2022] PUT /identity/v3/projects/9dd8eed3376943159e967d8766154831/users/ea0f05d5a0da459e9f3eea53bc53c528/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:30.071727 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb52771-63e5-4cbf-b877-86a2bf1df373 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:30.072072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb52771-63e5-4cbf-b877-86a2bf1df373 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:30.073703 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb52771-63e5-4cbf-b877-86a2bf1df373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:30.119538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 899/1786] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:29 2022] POST /identity/v3/projects => generated 391 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:30.123018 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4719ed-7e69-470e-bedd-431d69c287d8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:30.123516 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4719ed-7e69-470e-bedd-431d69c287d8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:30.124918 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4719ed-7e69-470e-bedd-431d69c287d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:30.145996 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-dbb52771-63e5-4cbf-b877-86a2bf1df373 None None] MFA Rules not processed for user `50358dbf699a41188dae93496161709d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:30.147271 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-dbb52771-63e5-4cbf-b877-86a2bf1df373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:30.238954 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ae4719ed-7e69-470e-bedd-431d69c287d8 None None] MFA Rules not processed for user `ea0f05d5a0da459e9f3eea53bc53c528`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:30.244499 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ae4719ed-7e69-470e-bedd-431d69c287d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:30.349229 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 888/1787] 10.222.0.96 () {58 vars in 1009 bytes} [Wed Aug 24 04:31:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:30.349959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb52771-63e5-4cbf-b877-86a2bf1df373 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:30.465819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 900/1788] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:30.466702 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4719ed-7e69-470e-bedd-431d69c287d8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:30.468625 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ae4719ed-7e69-470e-bedd-431d69c287d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:30.509869 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4719ed-7e69-470e-bedd-431d69c287d8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:30.515252 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece4d2d-4cb7-4b8f-896b-493129deecc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:30.516196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece4d2d-4cb7-4b8f-896b-493129deecc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:30.516708 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece4d2d-4cb7-4b8f-896b-493129deecc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:30.519120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece4d2d-4cb7-4b8f-896b-493129deecc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:30.543002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece4d2d-4cb7-4b8f-896b-493129deecc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:30.545497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece4d2d-4cb7-4b8f-896b-493129deecc6 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:30.554455 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb52771-63e5-4cbf-b877-86a2bf1df373 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:30.566066 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 901/1789] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:30.567792 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c171e5-3fe8-4c9f-8a41-15441484c408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:30.568446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c171e5-3fe8-4c9f-8a41-15441484c408 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:30.568813 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c171e5-3fe8-4c9f-8a41-15441484c408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:30.569097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c171e5-3fe8-4c9f-8a41-15441484c408 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:30.569311 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece4d2d-4cb7-4b8f-896b-493129deecc6 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:30.569734 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c171e5-3fe8-4c9f-8a41-15441484c408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:30.572003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c171e5-3fe8-4c9f-8a41-15441484c408 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:30.575406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7ece4d2d-4cb7-4b8f-896b-493129deecc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:30.608191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 889/1790] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:30 2022] POST /identity/v3/users => generated 302 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:30.609761 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c171e5-3fe8-4c9f-8a41-15441484c408 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:30.625610 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c171e5-3fe8-4c9f-8a41-15441484c408 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:30.632118 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b35e8-7949-45e6-8c60-8a2052f3c8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:30.633168 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b35e8-7949-45e6-8c60-8a2052f3c8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:30.634050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b35e8-7949-45e6-8c60-8a2052f3c8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:30.634168 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b35e8-7949-45e6-8c60-8a2052f3c8f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:30.634905 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b35e8-7949-45e6-8c60-8a2052f3c8f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:30.636925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b35e8-7949-45e6-8c60-8a2052f3c8f8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:30.657129 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 890/1791] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:30.658107 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b35e8-7949-45e6-8c60-8a2052f3c8f8 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:30.683581 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b35e8-7949-45e6-8c60-8a2052f3c8f8 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:30.694113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cf859-4355-4930-85f1-d6d913a4acb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:30.695077 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cf859-4355-4930-85f1-d6d913a4acb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:30.695373 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cf859-4355-4930-85f1-d6d913a4acb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:30.695761 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cf859-4355-4930-85f1-d6d913a4acb7 admin admin] PATH_INFO: `/v3/projects/804be84b005d47028879a5a0cd88a78d/users/6780b8b897864d639933a6a3a4394ef4/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:30.736587 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece4d2d-4cb7-4b8f-896b-493129deecc6 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:30.747815 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63cf859-4355-4930-85f1-d6d913a4acb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=804be84b005d47028879a5a0cd88a78d, user_id=6780b8b897864d639933a6a3a4394ef4, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:30.748660 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fc7ff-0579-4f3e-a7de-594ecf741f3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:30.749430 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fc7ff-0579-4f3e-a7de-594ecf741f3f service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:30.749819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fc7ff-0579-4f3e-a7de-594ecf741f3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:30.750194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fc7ff-0579-4f3e-a7de-594ecf741f3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:30.764563 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63cf859-4355-4930-85f1-d6d913a4acb7 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:30.772438 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fc7ff-0579-4f3e-a7de-594ecf741f3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:30.776577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fc7ff-0579-4f3e-a7de-594ecf741f3f service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:30.799171 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 891/1792] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:30 2022] PUT /identity/v3/projects/804be84b005d47028879a5a0cd88a78d/users/6780b8b897864d639933a6a3a4394ef4/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:30.803570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 902/1793] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:30.806672 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf60c98-24ab-4354-871e-3d3f9097d16d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:30.807120 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf60c98-24ab-4354-871e-3d3f9097d16d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:30.807240 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc6d3e-1ad3-4747-b614-a8b4595b2e32 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:30.807613 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc6d3e-1ad3-4747-b614-a8b4595b2e32 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:30.808604 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf60c98-24ab-4354-871e-3d3f9097d16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:30.809181 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc6d3e-1ad3-4747-b614-a8b4595b2e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:30.865858 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-bbf60c98-24ab-4354-871e-3d3f9097d16d None None] MFA Rules not processed for user `eb97bbb6260a45f3bfeb404b8c9fa815`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:30.869326 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-bbf60c98-24ab-4354-871e-3d3f9097d16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:30.947977 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-97bc6d3e-1ad3-4747-b614-a8b4595b2e32 None None] MFA Rules not processed for user `e9ffc48d1f6d49f49d00d1c2e762b987`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:30.961339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-97bc6d3e-1ad3-4747-b614-a8b4595b2e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:31.000881 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:31.035230 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:31.041418 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 892/1794] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:31.042450 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf60c98-24ab-4354-871e-3d3f9097d16d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:31.168102 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf60c98-24ab-4354-871e-3d3f9097d16d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:31.182158 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46df40-52e0-490e-9695-6ef06b01ccb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:31.182798 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46df40-52e0-490e-9695-6ef06b01ccb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:31.183079 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46df40-52e0-490e-9695-6ef06b01ccb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:31.183351 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46df40-52e0-490e-9695-6ef06b01ccb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:31.187767 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46df40-52e0-490e-9695-6ef06b01ccb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:31.191615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46df40-52e0-490e-9695-6ef06b01ccb0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:31.203595 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 903/1795] 10.222.0.96 () {58 vars in 1009 bytes} [Wed Aug 24 04:31:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:31.205799 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc6d3e-1ad3-4747-b614-a8b4595b2e32 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:31.213915 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 893/1796] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:31.221995 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46df40-52e0-490e-9695-6ef06b01ccb0 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:31.256524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46df40-52e0-490e-9695-6ef06b01ccb0 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:31.262754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e4b03-bd7f-44f1-bc51-71d18d6e5a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:31.263620 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e4b03-bd7f-44f1-bc51-71d18d6e5a27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:31.266724 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e4b03-bd7f-44f1-bc51-71d18d6e5a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:31.267169 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e4b03-bd7f-44f1-bc51-71d18d6e5a27 admin admin] PATH_INFO: `/v3/projects/804be84b005d47028879a5a0cd88a78d/users/6780b8b897864d639933a6a3a4394ef4/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:31.273617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e4b03-bd7f-44f1-bc51-71d18d6e5a27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=804be84b005d47028879a5a0cd88a78d, user_id=6780b8b897864d639933a6a3a4394ef4, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:31.276569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e4b03-bd7f-44f1-bc51-71d18d6e5a27 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:31.304976 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 894/1797] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:31 2022] PUT /identity/v3/projects/804be84b005d47028879a5a0cd88a78d/users/6780b8b897864d639933a6a3a4394ef4/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:31.315908 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff313f1c-d328-4077-82ad-bb29c5cbc7ba None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:31.316249 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff313f1c-d328-4077-82ad-bb29c5cbc7ba None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:31.316579 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff313f1c-d328-4077-82ad-bb29c5cbc7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:31.341638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc6d3e-1ad3-4747-b614-a8b4595b2e32 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:31.377370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ff313f1c-d328-4077-82ad-bb29c5cbc7ba None None] MFA Rules not processed for user `6780b8b897864d639933a6a3a4394ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:31.379199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ff313f1c-d328-4077-82ad-bb29c5cbc7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:31.475800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3621c4-bbf9-46ec-8d4f-10efd2613512 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:31.479093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3621c4-bbf9-46ec-8d4f-10efd2613512 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:31.479093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3621c4-bbf9-46ec-8d4f-10efd2613512 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:31.479093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3621c4-bbf9-46ec-8d4f-10efd2613512 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:31.577934 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 895/1798] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:31 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:31:31.582123 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff313f1c-d328-4077-82ad-bb29c5cbc7ba None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:31.590814 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ff313f1c-d328-4077-82ad-bb29c5cbc7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:31.746099 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:31.801442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3621c4-bbf9-46ec-8d4f-10efd2613512 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:31.802923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3621c4-bbf9-46ec-8d4f-10efd2613512 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:31.820606 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff313f1c-d328-4077-82ad-bb29c5cbc7ba None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:31.837421 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef572893-ce2d-4a52-b394-fb4473411026 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953d2dbd5e7d435f9148fd043b4ce7a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:31.848715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef572893-ce2d-4a52-b394-fb4473411026 service swift] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:31.848715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef572893-ce2d-4a52-b394-fb4473411026 service swift] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:31.848715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef572893-ce2d-4a52-b394-fb4473411026 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:31.854644 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 904/1799] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:31.868791 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3621c4-bbf9-46ec-8d4f-10efd2613512 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:31.903602 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3621c4-bbf9-46ec-8d4f-10efd2613512 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:31.923000 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b024a-5337-409d-83c4-f727db63fb59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:31.923850 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b024a-5337-409d-83c4-f727db63fb59 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:31.926551 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b024a-5337-409d-83c4-f727db63fb59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:31.928858 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b024a-5337-409d-83c4-f727db63fb59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:31.971385 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b024a-5337-409d-83c4-f727db63fb59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:31.980445 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b024a-5337-409d-83c4-f727db63fb59 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:32.011529 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 905/1800] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:31 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:32.039245 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef572893-ce2d-4a52-b394-fb4473411026 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:32.040839 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef572893-ce2d-4a52-b394-fb4473411026 service swift] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:32.061852 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 896/1801] 10.222.0.96 () {60 vars in 1384 bytes} [Wed Aug 24 04:31:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:31:32.707173 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b024a-5337-409d-83c4-f727db63fb59 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:32.726321 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b024a-5337-409d-83c4-f727db63fb59 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:32.738817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034c646-cbdc-42f5-adca-3cefd72abc15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:32.741506 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034c646-cbdc-42f5-adca-3cefd72abc15 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:32.742064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034c646-cbdc-42f5-adca-3cefd72abc15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:32.742866 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034c646-cbdc-42f5-adca-3cefd72abc15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:32.777172 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:33.018031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034c646-cbdc-42f5-adca-3cefd72abc15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:33.023248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034c646-cbdc-42f5-adca-3cefd72abc15 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:33.054277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 906/1802] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:35.429482 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3a5fd-7b4f-4842-886f-c91d250ef44e None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:35.429482 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3a5fd-7b4f-4842-886f-c91d250ef44e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:35.429482 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3a5fd-7b4f-4842-886f-c91d250ef44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:35.492962 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-47c3a5fd-7b4f-4842-886f-c91d250ef44e None None] MFA Rules not processed for user `50358dbf699a41188dae93496161709d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:35.494232 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-47c3a5fd-7b4f-4842-886f-c91d250ef44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:35.646358 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 897/1803] 10.222.0.100 () {58 vars in 1016 bytes} [Wed Aug 24 04:31:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:35.704492 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034c646-cbdc-42f5-adca-3cefd72abc15 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:35.707362 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3a5fd-7b4f-4842-886f-c91d250ef44e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:35.709671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8034c646-cbdc-42f5-adca-3cefd72abc15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:35.710474 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-47c3a5fd-7b4f-4842-886f-c91d250ef44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:35.743038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034c646-cbdc-42f5-adca-3cefd72abc15 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:35.746561 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3a5fd-7b4f-4842-886f-c91d250ef44e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:35.754898 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d820c1-1bd0-466e-9a5f-9ac4035ed98b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:35.757336 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d820c1-1bd0-466e-9a5f-9ac4035ed98b service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:35.758246 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d820c1-1bd0-466e-9a5f-9ac4035ed98b service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:35.759293 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b32de-4274-408f-ac2d-8eb038c16189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:35.760628 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d820c1-1bd0-466e-9a5f-9ac4035ed98b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:35.762630 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b32de-4274-408f-ac2d-8eb038c16189 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:35.763129 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b32de-4274-408f-ac2d-8eb038c16189 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:35.764647 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b32de-4274-408f-ac2d-8eb038c16189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:35.795549 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d820c1-1bd0-466e-9a5f-9ac4035ed98b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:35.796846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b32de-4274-408f-ac2d-8eb038c16189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:35.799685 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d820c1-1bd0-466e-9a5f-9ac4035ed98b service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:35.801456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b32de-4274-408f-ac2d-8eb038c16189 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:35.826438 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 898/1804] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:35.834332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 907/1805] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:31:37.136098 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b32de-4274-408f-ac2d-8eb038c16189 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:37.139161 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-be4b32de-4274-408f-ac2d-8eb038c16189 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:37.338055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b32de-4274-408f-ac2d-8eb038c16189 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:37.343244 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964ff49-d1ef-45be-854d-739b06a3b39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:37.343957 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964ff49-d1ef-45be-854d-739b06a3b39e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:37.344244 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964ff49-d1ef-45be-854d-739b06a3b39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:37.344519 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964ff49-d1ef-45be-854d-739b06a3b39e admin admin] PATH_INFO: `/v3/users/ebd73d97c0334d959c833d5508f9073b` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:37.350017 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964ff49-d1ef-45be-854d-739b06a3b39e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebd73d97c0334d959c833d5508f9073b)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:37.352022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964ff49-d1ef-45be-854d-739b06a3b39e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:37.411965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:37.500885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f964ff49-d1ef-45be-854d-739b06a3b39e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebd73d97c0334d959c833d5508f9073b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:37.502476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f964ff49-d1ef-45be-854d-739b06a3b39e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebd73d97c0334d959c833d5508f9073b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:37.531830 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f964ff49-d1ef-45be-854d-739b06a3b39e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebd73d97c0334d959c833d5508f9073b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:37.532621 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f964ff49-d1ef-45be-854d-739b06a3b39e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebd73d97c0334d959c833d5508f9073b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:37.551510 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-f964ff49-d1ef-45be-854d-739b06a3b39e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebd73d97c0334d959c833d5508f9073b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:37.611765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 899/1806] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:37 2022] DELETE /identity/v3/users/ebd73d97c0334d959c833d5508f9073b => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:37.618193 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7465c4-6c09-496b-a386-c265f2831190 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:37.619118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7465c4-6c09-496b-a386-c265f2831190 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:37.619611 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7465c4-6c09-496b-a386-c265f2831190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:37.669307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5b7465c4-6c09-496b-a386-c265f2831190 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:37.676048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5b7465c4-6c09-496b-a386-c265f2831190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:37.856892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 908/1807] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:37.955573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964ff49-d1ef-45be-854d-739b06a3b39e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:37.957619 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f964ff49-d1ef-45be-854d-739b06a3b39e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:38.213092 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964ff49-d1ef-45be-854d-739b06a3b39e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:38.222696 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63794e5f-f674-41f7-998c-8ecdc11713fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:38.223471 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63794e5f-f674-41f7-998c-8ecdc11713fc service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:38.224089 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63794e5f-f674-41f7-998c-8ecdc11713fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:38.224434 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63794e5f-f674-41f7-998c-8ecdc11713fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:38.242987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63794e5f-f674-41f7-998c-8ecdc11713fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:38.246379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63794e5f-f674-41f7-998c-8ecdc11713fc service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:38.275279 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 900/1808] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:38.814296 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f50ce5-9124-4dc3-b3de-903b0e3e745a None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:38.815470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f50ce5-9124-4dc3-b3de-903b0e3e745a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:38.816619 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f50ce5-9124-4dc3-b3de-903b0e3e745a None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:38.818559 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 909/1809] 10.222.0.96 () {54 vars in 921 bytes} [Wed Aug 24 04:31:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:31:38.923679 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63794e5f-f674-41f7-998c-8ecdc11713fc service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:38.926012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-63794e5f-f674-41f7-998c-8ecdc11713fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:38.958000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63794e5f-f674-41f7-998c-8ecdc11713fc service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:38.965340 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69631b-cf63-4927-86c8-92b77d9c7045 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:38.965707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69631b-cf63-4927-86c8-92b77d9c7045 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:38.965810 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79158ff3-c9f7-45aa-a61e-fcdf3b7038b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:38.966083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69631b-cf63-4927-86c8-92b77d9c7045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:38.967531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79158ff3-c9f7-45aa-a61e-fcdf3b7038b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:38.968941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79158ff3-c9f7-45aa-a61e-fcdf3b7038b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:38.969601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79158ff3-c9f7-45aa-a61e-fcdf3b7038b7 admin admin] PATH_INFO: `/v3/users/83496807d0f54bf98123867cef0f1edc` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:38.972632 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79158ff3-c9f7-45aa-a61e-fcdf3b7038b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83496807d0f54bf98123867cef0f1edc)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:38.975602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79158ff3-c9f7-45aa-a61e-fcdf3b7038b7 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:39.013056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0c69631b-cf63-4927-86c8-92b77d9c7045 None None] MFA Rules not processed for user `3539784b4e91472eb20addc6707dc30d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:39.014407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0c69631b-cf63-4927-86c8-92b77d9c7045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:39.155905 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 910/1810] 10.222.0.96 () {58 vars in 1018 bytes} [Wed Aug 24 04:31:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:31:39.172475 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-79158ff3-c9f7-45aa-a61e-fcdf3b7038b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83496807d0f54bf98123867cef0f1edc'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:39.173673 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-79158ff3-c9f7-45aa-a61e-fcdf3b7038b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83496807d0f54bf98123867cef0f1edc'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:39.232463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-79158ff3-c9f7-45aa-a61e-fcdf3b7038b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83496807d0f54bf98123867cef0f1edc'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:39.233302 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-79158ff3-c9f7-45aa-a61e-fcdf3b7038b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83496807d0f54bf98123867cef0f1edc'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:39.249530 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-79158ff3-c9f7-45aa-a61e-fcdf3b7038b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83496807d0f54bf98123867cef0f1edc'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:39.309963 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 901/1811] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:38 2022] DELETE /identity/v3/users/83496807d0f54bf98123867cef0f1edc => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:39.311242 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994730e-a9eb-402e-bcc6-ff5c7b9c53a2 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:39.311744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994730e-a9eb-402e-bcc6-ff5c7b9c53a2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:39.312214 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994730e-a9eb-402e-bcc6-ff5c7b9c53a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:39.352397 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c994730e-a9eb-402e-bcc6-ff5c7b9c53a2 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:39.354146 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c994730e-a9eb-402e-bcc6-ff5c7b9c53a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:39.457672 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:39.620342 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 911/1812] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:31:39.735740 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79158ff3-c9f7-45aa-a61e-fcdf3b7038b7 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:39.740572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-79158ff3-c9f7-45aa-a61e-fcdf3b7038b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:39.769965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:39.982990 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994730e-a9eb-402e-bcc6-ff5c7b9c53a2 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:39.986803 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c994730e-a9eb-402e-bcc6-ff5c7b9c53a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:40.047317 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79158ff3-c9f7-45aa-a61e-fcdf3b7038b7 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:40.089109 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce458b1-77aa-4905-b524-102d1ca06e08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:40.092746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce458b1-77aa-4905-b524-102d1ca06e08 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:40.095923 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce458b1-77aa-4905-b524-102d1ca06e08 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:40.099250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce458b1-77aa-4905-b524-102d1ca06e08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:40.109776 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7ce458b1-77aa-4905-b524-102d1ca06e08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:40.176074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce458b1-77aa-4905-b524-102d1ca06e08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:40.182795 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce458b1-77aa-4905-b524-102d1ca06e08 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:40.241344 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 902/1813] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:40.246234 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce458b1-77aa-4905-b524-102d1ca06e08 service nova] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:40.250157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7ce458b1-77aa-4905-b524-102d1ca06e08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:40.296564 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994730e-a9eb-402e-bcc6-ff5c7b9c53a2 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:40.320714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9889a-d99d-4437-aea4-04429c6f19bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:40.321624 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9889a-d99d-4437-aea4-04429c6f19bf service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:40.321929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9889a-d99d-4437-aea4-04429c6f19bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:40.322166 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9889a-d99d-4437-aea4-04429c6f19bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:40.323080 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce458b1-77aa-4905-b524-102d1ca06e08 service nova] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:40.346381 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde2514-2427-42d4-a63c-7bfd3cfc2fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:40.352254 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde2514-2427-42d4-a63c-7bfd3cfc2fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:40.352602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde2514-2427-42d4-a63c-7bfd3cfc2fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:40.352864 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde2514-2427-42d4-a63c-7bfd3cfc2fcb admin admin] PATH_INFO: `/v3/users/0cceb0f1ade74df8982c3af624e1bfaa` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:40.357662 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde2514-2427-42d4-a63c-7bfd3cfc2fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cceb0f1ade74df8982c3af624e1bfaa)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:40.364006 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde2514-2427-42d4-a63c-7bfd3cfc2fcb admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:40.377311 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9889a-d99d-4437-aea4-04429c6f19bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:40.383571 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9889a-d99d-4437-aea4-04429c6f19bf service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:40.425039 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 912/1814] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:31:40.497690 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0dde2514-2427-42d4-a63c-7bfd3cfc2fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cceb0f1ade74df8982c3af624e1bfaa'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:40.499541 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0dde2514-2427-42d4-a63c-7bfd3cfc2fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cceb0f1ade74df8982c3af624e1bfaa'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:40.510930 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0dde2514-2427-42d4-a63c-7bfd3cfc2fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cceb0f1ade74df8982c3af624e1bfaa'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:40.511874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0dde2514-2427-42d4-a63c-7bfd3cfc2fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cceb0f1ade74df8982c3af624e1bfaa'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:40.532575 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0dde2514-2427-42d4-a63c-7bfd3cfc2fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cceb0f1ade74df8982c3af624e1bfaa'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:40.597163 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 903/1815] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:40 2022] DELETE /identity/v3/users/0cceb0f1ade74df8982c3af624e1bfaa => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:40.603183 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f7f19-0b8c-4e42-8d38-591ffb11dc8b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:40.603481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f7f19-0b8c-4e42-8d38-591ffb11dc8b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:40.604004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f7f19-0b8c-4e42-8d38-591ffb11dc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:40.626140 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde2514-2427-42d4-a63c-7bfd3cfc2fcb admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:40.627770 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0dde2514-2427-42d4-a63c-7bfd3cfc2fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:40.670079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-121f7f19-0b8c-4e42-8d38-591ffb11dc8b None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:40.671031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-121f7f19-0b8c-4e42-8d38-591ffb11dc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:40.873188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 913/1816] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:40.917688 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f7f19-0b8c-4e42-8d38-591ffb11dc8b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:40.918273 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde2514-2427-42d4-a63c-7bfd3cfc2fcb admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:40.919213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-121f7f19-0b8c-4e42-8d38-591ffb11dc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:40.925993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59d55c-bc0a-47dd-a581-bf0c3be44086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:40.927559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59d55c-bc0a-47dd-a581-bf0c3be44086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:40.928320 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59d55c-bc0a-47dd-a581-bf0c3be44086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:40.929165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59d55c-bc0a-47dd-a581-bf0c3be44086 admin admin] PATH_INFO: `/v3/users/ad26f803813640aca00c0812d2a2c99b` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:40.932555 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59d55c-bc0a-47dd-a581-bf0c3be44086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad26f803813640aca00c0812d2a2c99b)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:40.937524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59d55c-bc0a-47dd-a581-bf0c3be44086 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:40.955669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:41.035048 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bc59d55c-bc0a-47dd-a581-bf0c3be44086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad26f803813640aca00c0812d2a2c99b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:41.036364 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bc59d55c-bc0a-47dd-a581-bf0c3be44086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad26f803813640aca00c0812d2a2c99b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:41.051416 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bc59d55c-bc0a-47dd-a581-bf0c3be44086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad26f803813640aca00c0812d2a2c99b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:41.052374 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bc59d55c-bc0a-47dd-a581-bf0c3be44086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad26f803813640aca00c0812d2a2c99b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:41.072357 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bc59d55c-bc0a-47dd-a581-bf0c3be44086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad26f803813640aca00c0812d2a2c99b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:41.105937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 904/1817] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:40 2022] DELETE /identity/v3/users/ad26f803813640aca00c0812d2a2c99b => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:31:41.121052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59d55c-bc0a-47dd-a581-bf0c3be44086 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:41.121345 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f7f19-0b8c-4e42-8d38-591ffb11dc8b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:41.126864 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-bc59d55c-bc0a-47dd-a581-bf0c3be44086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:41.199369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:41.246397 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d57e9-9fa8-49da-9681-425afecebc45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:41.247077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d57e9-9fa8-49da-9681-425afecebc45 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:41.247366 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d57e9-9fa8-49da-9681-425afecebc45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:41.247640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d57e9-9fa8-49da-9681-425afecebc45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:41.265241 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-db3d57e9-9fa8-49da-9681-425afecebc45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:41.432770 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59d55c-bc0a-47dd-a581-bf0c3be44086 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:41.455681 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15b95c-2ad4-490d-b202-f7d26a7ec629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:41.457503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15b95c-2ad4-490d-b202-f7d26a7ec629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:41.458019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15b95c-2ad4-490d-b202-f7d26a7ec629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:41.458530 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15b95c-2ad4-490d-b202-f7d26a7ec629 admin admin] PATH_INFO: `/v3/users/5509c506f50348ecbbdb683f735b4424` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:41.475798 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15b95c-2ad4-490d-b202-f7d26a7ec629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5509c506f50348ecbbdb683f735b4424)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:41.481169 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15b95c-2ad4-490d-b202-f7d26a7ec629 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:41.546620 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d57e9-9fa8-49da-9681-425afecebc45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:41.548406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d57e9-9fa8-49da-9681-425afecebc45 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:41.575694 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 914/1818] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:31:41.576864 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e219988-d5de-4ef9-b840-7d28d9d63fa1 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:41.577159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e219988-d5de-4ef9-b840-7d28d9d63fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:41.577436 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e219988-d5de-4ef9-b840-7d28d9d63fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:41.639034 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-6c15b95c-2ad4-490d-b202-f7d26a7ec629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5509c506f50348ecbbdb683f735b4424'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:41.640585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-6c15b95c-2ad4-490d-b202-f7d26a7ec629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5509c506f50348ecbbdb683f735b4424'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:41.644565 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4e219988-d5de-4ef9-b840-7d28d9d63fa1 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:41.646088 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4e219988-d5de-4ef9-b840-7d28d9d63fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:41.663625 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-6c15b95c-2ad4-490d-b202-f7d26a7ec629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5509c506f50348ecbbdb683f735b4424'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:41.664655 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-6c15b95c-2ad4-490d-b202-f7d26a7ec629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5509c506f50348ecbbdb683f735b4424'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:41.669376 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 915/1819] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:41.670319 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e219988-d5de-4ef9-b840-7d28d9d63fa1 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:41.673371 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4e219988-d5de-4ef9-b840-7d28d9d63fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:41.680093 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-6c15b95c-2ad4-490d-b202-f7d26a7ec629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5509c506f50348ecbbdb683f735b4424'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:41.710292 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e219988-d5de-4ef9-b840-7d28d9d63fa1 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:41.715251 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230f061-6bf0-44e9-98fc-8c39ff3b21f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:41.716011 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230f061-6bf0-44e9-98fc-8c39ff3b21f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:41.716243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230f061-6bf0-44e9-98fc-8c39ff3b21f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:41.716455 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 905/1820] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:41 2022] DELETE /identity/v3/users/5509c506f50348ecbbdb683f735b4424 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:41.716671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230f061-6bf0-44e9-98fc-8c39ff3b21f3 admin admin] PATH_INFO: `/v3/projects/e982f1e858e7450ea5cf640fb4742bd3` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:41.717956 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230f061-6bf0-44e9-98fc-8c39ff3b21f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e982f1e858e7450ea5cf640fb4742bd3)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:41.719929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230f061-6bf0-44e9-98fc-8c39ff3b21f3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:41.720789 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec0e2d-f256-4574-8da4-ad3982ad9c54 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:41.722772 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec0e2d-f256-4574-8da4-ad3982ad9c54 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:41.723454 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec0e2d-f256-4574-8da4-ad3982ad9c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:41.774772 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:41.785354 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-47ec0e2d-f256-4574-8da4-ad3982ad9c54 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:41.787825 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-47ec0e2d-f256-4574-8da4-ad3982ad9c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:41.808066 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c230f061-6bf0-44e9-98fc-8c39ff3b21f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e982f1e858e7450ea5cf640fb4742bd3', 'request_id': 'req-c230f061-6bf0-44e9-98fc-8c39ff3b21f3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:41.820897 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c230f061-6bf0-44e9-98fc-8c39ff3b21f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e982f1e858e7450ea5cf640fb4742bd3', 'request_id': 'req-c230f061-6bf0-44e9-98fc-8c39ff3b21f3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:41.852137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c230f061-6bf0-44e9-98fc-8c39ff3b21f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e982f1e858e7450ea5cf640fb4742bd3', 'request_id': 'req-c230f061-6bf0-44e9-98fc-8c39ff3b21f3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:41.868478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c230f061-6bf0-44e9-98fc-8c39ff3b21f3 admin admin] The token cache is being invalidate because project e982f1e858e7450ea5cf640fb4742bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:41.870121 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c230f061-6bf0-44e9-98fc-8c39ff3b21f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:41.871071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c230f061-6bf0-44e9-98fc-8c39ff3b21f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:41.876434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 916/1821] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:41 2022] DELETE /identity/v3/projects/e982f1e858e7450ea5cf640fb4742bd3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:41.879777 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230f061-6bf0-44e9-98fc-8c39ff3b21f3 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:41.881685 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c230f061-6bf0-44e9-98fc-8c39ff3b21f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:41.905108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 906/1822] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:41.973780 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230f061-6bf0-44e9-98fc-8c39ff3b21f3 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:41.979206 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9488e-4446-4297-b408-4e98045a5bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:41.980461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9488e-4446-4297-b408-4e98045a5bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:41.980461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9488e-4446-4297-b408-4e98045a5bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:41.980864 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9488e-4446-4297-b408-4e98045a5bda admin admin] PATH_INFO: `/v3/users/f37d967e8d1d477b88a51584a6709973` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:41.982519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9488e-4446-4297-b408-4e98045a5bda admin admin] RBAC: Authorizing `identity:delete_user(user_id=f37d967e8d1d477b88a51584a6709973)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:41.984589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9488e-4446-4297-b408-4e98045a5bda admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:41.988997 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:42.030468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec0e2d-f256-4574-8da4-ad3982ad9c54 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:42.032263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-47ec0e2d-f256-4574-8da4-ad3982ad9c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:42.060527 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5bb9488e-4446-4297-b408-4e98045a5bda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f37d967e8d1d477b88a51584a6709973'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:42.061511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5bb9488e-4446-4297-b408-4e98045a5bda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f37d967e8d1d477b88a51584a6709973'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:42.089069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5bb9488e-4446-4297-b408-4e98045a5bda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f37d967e8d1d477b88a51584a6709973'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:42.090645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5bb9488e-4446-4297-b408-4e98045a5bda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f37d967e8d1d477b88a51584a6709973'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:42.110466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5bb9488e-4446-4297-b408-4e98045a5bda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f37d967e8d1d477b88a51584a6709973'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:42.133867 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 917/1823] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:41 2022] DELETE /identity/v3/users/f37d967e8d1d477b88a51584a6709973 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:42.135775 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9488e-4446-4297-b408-4e98045a5bda admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:42.137607 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5bb9488e-4446-4297-b408-4e98045a5bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:42.208716 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec0e2d-f256-4574-8da4-ad3982ad9c54 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:42.256160 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9488e-4446-4297-b408-4e98045a5bda admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:42.261105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ac5de-eff6-4a0a-89d4-79c5fc888346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:42.262110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac5de-eff6-4a0a-89d4-79c5fc888346 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:42.262449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac5de-eff6-4a0a-89d4-79c5fc888346 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:42.262727 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac5de-eff6-4a0a-89d4-79c5fc888346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:42.264958 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-303ac5de-eff6-4a0a-89d4-79c5fc888346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:42.338704 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e3931-923b-4085-89a6-ff647bc176b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:42.341335 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e3931-923b-4085-89a6-ff647bc176b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:42.341607 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e3931-923b-4085-89a6-ff647bc176b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:42.341887 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e3931-923b-4085-89a6-ff647bc176b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:42.350020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-915e3931-923b-4085-89a6-ff647bc176b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:42.410636 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ac5de-eff6-4a0a-89d4-79c5fc888346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:42.417027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ac5de-eff6-4a0a-89d4-79c5fc888346 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:42.447879 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 918/1824] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:42.530045 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e3931-923b-4085-89a6-ff647bc176b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:42.531573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e3931-923b-4085-89a6-ff647bc176b6 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:42.567252 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 907/1825] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:31:43.045396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a78b3-9ef6-412c-a715-28067d0986e3 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:43.045907 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a78b3-9ef6-412c-a715-28067d0986e3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:43.046550 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a78b3-9ef6-412c-a715-28067d0986e3 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:43.049983 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 919/1826] 10.222.0.96 () {54 vars in 921 bytes} [Wed Aug 24 04:31:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:31:43.149036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8f239-3be2-425a-960d-2b4bb50bce13 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:43.149338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8f239-3be2-425a-960d-2b4bb50bce13 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:43.149694 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8f239-3be2-425a-960d-2b4bb50bce13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:43.184950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-2da8f239-3be2-425a-960d-2b4bb50bce13 None None] MFA Rules not processed for user `3539784b4e91472eb20addc6707dc30d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:43.186596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2da8f239-3be2-425a-960d-2b4bb50bce13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:43.217547 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:43.254643 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a78b3-9ef6-412c-a715-28067d0986e3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:43.257072 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b32a78b3-9ef6-412c-a715-28067d0986e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:43.311642 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a78b3-9ef6-412c-a715-28067d0986e3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:43.328658 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5d5a4-d4d7-41fa-9434-511b91ba1ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:43.329350 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5d5a4-d4d7-41fa-9434-511b91ba1ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:43.329635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5d5a4-d4d7-41fa-9434-511b91ba1ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:43.329912 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f5d5a4-d4d7-41fa-9434-511b91ba1ba9 admin admin] PATH_INFO: `/v3/projects/e856b388396b48cc832f6abe67d1f797` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:43.338352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5d5a4-d4d7-41fa-9434-511b91ba1ba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e856b388396b48cc832f6abe67d1f797)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:43.340319 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f5d5a4-d4d7-41fa-9434-511b91ba1ba9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:43.438154 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:43.446134 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 908/1827] 10.222.0.96 () {58 vars in 1018 bytes} [Wed Aug 24 04:31:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:43.491762 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-62f5d5a4-d4d7-41fa-9434-511b91ba1ba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e856b388396b48cc832f6abe67d1f797', 'request_id': 'req-62f5d5a4-d4d7-41fa-9434-511b91ba1ba9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:43.512220 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-62f5d5a4-d4d7-41fa-9434-511b91ba1ba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e856b388396b48cc832f6abe67d1f797', 'request_id': 'req-62f5d5a4-d4d7-41fa-9434-511b91ba1ba9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:43.514780 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8f239-3be2-425a-960d-2b4bb50bce13 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:43.516917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2da8f239-3be2-425a-960d-2b4bb50bce13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:43.520358 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-62f5d5a4-d4d7-41fa-9434-511b91ba1ba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e856b388396b48cc832f6abe67d1f797', 'request_id': 'req-62f5d5a4-d4d7-41fa-9434-511b91ba1ba9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:43.535656 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-62f5d5a4-d4d7-41fa-9434-511b91ba1ba9 admin admin] The token cache is being invalidate because project e856b388396b48cc832f6abe67d1f797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:43.535871 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-62f5d5a4-d4d7-41fa-9434-511b91ba1ba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:43.536497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-62f5d5a4-d4d7-41fa-9434-511b91ba1ba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:43.541238 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 920/1828] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:43 2022] DELETE /identity/v3/projects/e856b388396b48cc832f6abe67d1f797 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:43.543909 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8f239-3be2-425a-960d-2b4bb50bce13 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:43.544831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5d5a4-d4d7-41fa-9434-511b91ba1ba9 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:43.546869 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-62f5d5a4-d4d7-41fa-9434-511b91ba1ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:43.660518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f5d5a4-d4d7-41fa-9434-511b91ba1ba9 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:43.668990 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12156460-df3d-4479-be24-e77c51d9db0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:43.670346 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12156460-df3d-4479-be24-e77c51d9db0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:43.671006 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12156460-df3d-4479-be24-e77c51d9db0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:43.671806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12156460-df3d-4479-be24-e77c51d9db0f admin admin] PATH_INFO: `/v3/users/ea0f05d5a0da459e9f3eea53bc53c528` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:43.673847 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12156460-df3d-4479-be24-e77c51d9db0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea0f05d5a0da459e9f3eea53bc53c528)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:43.677700 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12156460-df3d-4479-be24-e77c51d9db0f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:43.763520 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b1f1a-0c73-446d-b977-ba334097014d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:43.764503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b1f1a-0c73-446d-b977-ba334097014d service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:43.765010 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b1f1a-0c73-446d-b977-ba334097014d service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:43.765384 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b1f1a-0c73-446d-b977-ba334097014d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:43.771575 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-196b1f1a-0c73-446d-b977-ba334097014d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:43.820394 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b1f1a-0c73-446d-b977-ba334097014d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:43.823076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b1f1a-0c73-446d-b977-ba334097014d service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:43.831562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-12156460-df3d-4479-be24-e77c51d9db0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea0f05d5a0da459e9f3eea53bc53c528'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:43.834698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-12156460-df3d-4479-be24-e77c51d9db0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea0f05d5a0da459e9f3eea53bc53c528'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:43.859757 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 909/1829] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:31:43.867607 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-12156460-df3d-4479-be24-e77c51d9db0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea0f05d5a0da459e9f3eea53bc53c528'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:43.868826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-12156460-df3d-4479-be24-e77c51d9db0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea0f05d5a0da459e9f3eea53bc53c528'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:43.903742 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-12156460-df3d-4479-be24-e77c51d9db0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea0f05d5a0da459e9f3eea53bc53c528'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:43.942615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 921/1830] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:43 2022] DELETE /identity/v3/users/ea0f05d5a0da459e9f3eea53bc53c528 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:44.196204 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b1f1a-0c73-446d-b977-ba334097014d service nova] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:44.199400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-196b1f1a-0c73-446d-b977-ba334097014d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:44.246943 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b1f1a-0c73-446d-b977-ba334097014d service nova] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:44.425582 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46800451-2711-4f50-808a-a462daadd46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:44.426939 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46800451-2711-4f50-808a-a462daadd46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:44.427450 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46800451-2711-4f50-808a-a462daadd46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:44.428102 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46800451-2711-4f50-808a-a462daadd46f admin admin] PATH_INFO: `/v3/projects/7cb3f768b8ba4841a6a7841d78b5f747` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:44.430094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46800451-2711-4f50-808a-a462daadd46f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cb3f768b8ba4841a6a7841d78b5f747)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:44.432247 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46800451-2711-4f50-808a-a462daadd46f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:44.499611 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:44.538054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-46800451-2711-4f50-808a-a462daadd46f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cb3f768b8ba4841a6a7841d78b5f747', 'request_id': 'req-46800451-2711-4f50-808a-a462daadd46f'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:44.548466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-46800451-2711-4f50-808a-a462daadd46f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cb3f768b8ba4841a6a7841d78b5f747', 'request_id': 'req-46800451-2711-4f50-808a-a462daadd46f'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:44.558390 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-46800451-2711-4f50-808a-a462daadd46f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cb3f768b8ba4841a6a7841d78b5f747', 'request_id': 'req-46800451-2711-4f50-808a-a462daadd46f'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:44.588435 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-46800451-2711-4f50-808a-a462daadd46f admin admin] The token cache is being invalidate because project 7cb3f768b8ba4841a6a7841d78b5f747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:44.588977 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-46800451-2711-4f50-808a-a462daadd46f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:44.590089 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-46800451-2711-4f50-808a-a462daadd46f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:44.593140 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 910/1831] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:44 2022] DELETE /identity/v3/projects/7cb3f768b8ba4841a6a7841d78b5f747 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:44.598435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12156460-df3d-4479-be24-e77c51d9db0f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:44.600225 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-12156460-df3d-4479-be24-e77c51d9db0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:44.639279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12156460-df3d-4479-be24-e77c51d9db0f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:44.720452 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:44.821064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f4490-3112-4989-b309-08e6e2c2b34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:44.825911 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f4490-3112-4989-b309-08e6e2c2b34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:44.828023 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f4490-3112-4989-b309-08e6e2c2b34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:44.830330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f4490-3112-4989-b309-08e6e2c2b34c admin admin] PATH_INFO: `/v3/users/109e057a5e8e48b3a464c7e4fac3943e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:44.844517 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f4490-3112-4989-b309-08e6e2c2b34c admin admin] RBAC: Authorizing `identity:delete_user(user_id=109e057a5e8e48b3a464c7e4fac3943e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:44.853497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f4490-3112-4989-b309-08e6e2c2b34c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:44.859686 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46800451-2711-4f50-808a-a462daadd46f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:44.861461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-46800451-2711-4f50-808a-a462daadd46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:44.882166 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46800451-2711-4f50-808a-a462daadd46f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:44.887208 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70869bc0-6145-40ab-934e-a82ebe18f449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:44.888140 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70869bc0-6145-40ab-934e-a82ebe18f449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:44.888348 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70869bc0-6145-40ab-934e-a82ebe18f449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:44.888869 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70869bc0-6145-40ab-934e-a82ebe18f449 admin admin] PATH_INFO: `/v3/projects/9dd8eed3376943159e967d8766154831` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:44.889900 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70869bc0-6145-40ab-934e-a82ebe18f449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd8eed3376943159e967d8766154831)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:44.891821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70869bc0-6145-40ab-934e-a82ebe18f449 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:45.002181 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-264f4490-3112-4989-b309-08e6e2c2b34c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '109e057a5e8e48b3a464c7e4fac3943e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.005053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-264f4490-3112-4989-b309-08e6e2c2b34c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '109e057a5e8e48b3a464c7e4fac3943e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.015963 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-70869bc0-6145-40ab-934e-a82ebe18f449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd8eed3376943159e967d8766154831', 'request_id': 'req-70869bc0-6145-40ab-934e-a82ebe18f449'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.019022 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-264f4490-3112-4989-b309-08e6e2c2b34c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '109e057a5e8e48b3a464c7e4fac3943e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.019829 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-264f4490-3112-4989-b309-08e6e2c2b34c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '109e057a5e8e48b3a464c7e4fac3943e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.024952 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-70869bc0-6145-40ab-934e-a82ebe18f449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd8eed3376943159e967d8766154831', 'request_id': 'req-70869bc0-6145-40ab-934e-a82ebe18f449'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.033297 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-70869bc0-6145-40ab-934e-a82ebe18f449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd8eed3376943159e967d8766154831', 'request_id': 'req-70869bc0-6145-40ab-934e-a82ebe18f449'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.036439 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-264f4490-3112-4989-b309-08e6e2c2b34c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '109e057a5e8e48b3a464c7e4fac3943e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.057798 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-70869bc0-6145-40ab-934e-a82ebe18f449 admin admin] The token cache is being invalidate because project 9dd8eed3376943159e967d8766154831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:45.057798 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-70869bc0-6145-40ab-934e-a82ebe18f449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.058648 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 922/1832] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:44 2022] DELETE /identity/v3/users/109e057a5e8e48b3a464c7e4fac3943e => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:31:45.058981 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-70869bc0-6145-40ab-934e-a82ebe18f449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.067042 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 911/1833] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:44 2022] DELETE /identity/v3/projects/9dd8eed3376943159e967d8766154831 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:45.067606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32c6a4-8b82-4af3-aa51-125ccd6a401a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:45.067956 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32c6a4-8b82-4af3-aa51-125ccd6a401a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:45.068984 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32c6a4-8b82-4af3-aa51-125ccd6a401a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:45.091476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70869bc0-6145-40ab-934e-a82ebe18f449 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:45.093069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-70869bc0-6145-40ab-934e-a82ebe18f449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:45.106313 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bc32c6a4-8b82-4af3-aa51-125ccd6a401a None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:45.122992 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bc32c6a4-8b82-4af3-aa51-125ccd6a401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:45.234932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 923/1834] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:45.236088 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32c6a4-8b82-4af3-aa51-125ccd6a401a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:45.239118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bc32c6a4-8b82-4af3-aa51-125ccd6a401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:45.244395 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70869bc0-6145-40ab-934e-a82ebe18f449 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:45.254802 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32c6a4-8b82-4af3-aa51-125ccd6a401a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:45.264131 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97629def-c8cb-4d2e-9fc8-ce427b732fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:45.265496 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1ff14-6549-410e-b9ba-20184dd23ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:45.266238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1ff14-6549-410e-b9ba-20184dd23ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:45.266483 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1ff14-6549-410e-b9ba-20184dd23ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:45.266807 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97629def-c8cb-4d2e-9fc8-ce427b732fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:45.267113 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97629def-c8cb-4d2e-9fc8-ce427b732fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:45.267392 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97629def-c8cb-4d2e-9fc8-ce427b732fde admin admin] PATH_INFO: `/v3/projects/01e76adb89804c1ebaaa485dc4b7de8b` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:45.268369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1ff14-6549-410e-b9ba-20184dd23ffd admin admin] PATH_INFO: `/v3/projects/75ab5a95cc74498d812d45cbea3b94e4` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:45.270188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97629def-c8cb-4d2e-9fc8-ce427b732fde admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e76adb89804c1ebaaa485dc4b7de8b)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:45.272165 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97629def-c8cb-4d2e-9fc8-ce427b732fde admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:45.274899 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1ff14-6549-410e-b9ba-20184dd23ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=75ab5a95cc74498d812d45cbea3b94e4)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:45.278220 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1ff14-6549-410e-b9ba-20184dd23ffd admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:45.365251 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:45.367737 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-97629def-c8cb-4d2e-9fc8-ce427b732fde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e76adb89804c1ebaaa485dc4b7de8b', 'request_id': 'req-97629def-c8cb-4d2e-9fc8-ce427b732fde'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.383136 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-97629def-c8cb-4d2e-9fc8-ce427b732fde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e76adb89804c1ebaaa485dc4b7de8b', 'request_id': 'req-97629def-c8cb-4d2e-9fc8-ce427b732fde'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.391142 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:45.398942 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-09d1ff14-6549-410e-b9ba-20184dd23ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75ab5a95cc74498d812d45cbea3b94e4', 'request_id': 'req-09d1ff14-6549-410e-b9ba-20184dd23ffd'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.401031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-97629def-c8cb-4d2e-9fc8-ce427b732fde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e76adb89804c1ebaaa485dc4b7de8b', 'request_id': 'req-97629def-c8cb-4d2e-9fc8-ce427b732fde'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.412328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-09d1ff14-6549-410e-b9ba-20184dd23ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75ab5a95cc74498d812d45cbea3b94e4', 'request_id': 'req-09d1ff14-6549-410e-b9ba-20184dd23ffd'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.419666 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-97629def-c8cb-4d2e-9fc8-ce427b732fde admin admin] The token cache is being invalidate because project 01e76adb89804c1ebaaa485dc4b7de8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:45.419989 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-97629def-c8cb-4d2e-9fc8-ce427b732fde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.420675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-97629def-c8cb-4d2e-9fc8-ce427b732fde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.422662 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 924/1835] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:45 2022] DELETE /identity/v3/projects/01e76adb89804c1ebaaa485dc4b7de8b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:45.423555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97629def-c8cb-4d2e-9fc8-ce427b732fde admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:45.427445 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-97629def-c8cb-4d2e-9fc8-ce427b732fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:45.429427 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-09d1ff14-6549-410e-b9ba-20184dd23ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75ab5a95cc74498d812d45cbea3b94e4', 'request_id': 'req-09d1ff14-6549-410e-b9ba-20184dd23ffd'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.453838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-09d1ff14-6549-410e-b9ba-20184dd23ffd admin admin] The token cache is being invalidate because project 75ab5a95cc74498d812d45cbea3b94e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:45.454380 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-09d1ff14-6549-410e-b9ba-20184dd23ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.455477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-09d1ff14-6549-410e-b9ba-20184dd23ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.464475 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 912/1836] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:45 2022] DELETE /identity/v3/projects/75ab5a95cc74498d812d45cbea3b94e4 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:45.467443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46591459-d434-4d48-ba59-70a78300a72a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:45.469061 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46591459-d434-4d48-ba59-70a78300a72a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:45.469712 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46591459-d434-4d48-ba59-70a78300a72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:45.507341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-46591459-d434-4d48-ba59-70a78300a72a None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:45.510613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-46591459-d434-4d48-ba59-70a78300a72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:45.534168 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97629def-c8cb-4d2e-9fc8-ce427b732fde admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:45.615005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 913/1837] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:45.615005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46591459-d434-4d48-ba59-70a78300a72a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:45.615005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-46591459-d434-4d48-ba59-70a78300a72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:45.634911 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46591459-d434-4d48-ba59-70a78300a72a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:45.640030 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675daba1-56c9-4b39-b842-443507886adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:45.640717 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675daba1-56c9-4b39-b842-443507886adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:45.641016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675daba1-56c9-4b39-b842-443507886adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:45.641298 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675daba1-56c9-4b39-b842-443507886adb admin admin] PATH_INFO: `/v3/users/458403304f924dec8689463dd9e5688a` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:45.642500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675daba1-56c9-4b39-b842-443507886adb admin admin] RBAC: Authorizing `identity:delete_user(user_id=458403304f924dec8689463dd9e5688a)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:45.644845 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675daba1-56c9-4b39-b842-443507886adb admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:45.646617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e0065-3d9e-46ce-a97a-d0e0bccd586c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:45.647360 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e0065-3d9e-46ce-a97a-d0e0bccd586c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:45.647718 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e0065-3d9e-46ce-a97a-d0e0bccd586c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:45.648239 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e0065-3d9e-46ce-a97a-d0e0bccd586c admin admin] PATH_INFO: `/v3/projects/2da72f099210403facf895798c295e4e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:45.649878 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e0065-3d9e-46ce-a97a-d0e0bccd586c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da72f099210403facf895798c295e4e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:45.651984 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e0065-3d9e-46ce-a97a-d0e0bccd586c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:45.708720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-675daba1-56c9-4b39-b842-443507886adb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '458403304f924dec8689463dd9e5688a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.709825 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-675daba1-56c9-4b39-b842-443507886adb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '458403304f924dec8689463dd9e5688a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.713431 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b38e0065-3d9e-46ce-a97a-d0e0bccd586c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da72f099210403facf895798c295e4e', 'request_id': 'req-b38e0065-3d9e-46ce-a97a-d0e0bccd586c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.718517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-675daba1-56c9-4b39-b842-443507886adb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '458403304f924dec8689463dd9e5688a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.719484 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-675daba1-56c9-4b39-b842-443507886adb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '458403304f924dec8689463dd9e5688a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.725539 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b38e0065-3d9e-46ce-a97a-d0e0bccd586c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da72f099210403facf895798c295e4e', 'request_id': 'req-b38e0065-3d9e-46ce-a97a-d0e0bccd586c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.732902 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-675daba1-56c9-4b39-b842-443507886adb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '458403304f924dec8689463dd9e5688a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.734579 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b38e0065-3d9e-46ce-a97a-d0e0bccd586c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da72f099210403facf895798c295e4e', 'request_id': 'req-b38e0065-3d9e-46ce-a97a-d0e0bccd586c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.749420 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b38e0065-3d9e-46ce-a97a-d0e0bccd586c admin admin] The token cache is being invalidate because project 2da72f099210403facf895798c295e4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:45.749813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b38e0065-3d9e-46ce-a97a-d0e0bccd586c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.750568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b38e0065-3d9e-46ce-a97a-d0e0bccd586c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:45.753489 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 925/1838] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:45 2022] DELETE /identity/v3/projects/2da72f099210403facf895798c295e4e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:45.754967 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276feeb-3f05-41b4-a676-eb619a85e941 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:45.755314 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276feeb-3f05-41b4-a676-eb619a85e941 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:45.755649 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276feeb-3f05-41b4-a676-eb619a85e941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:45.767216 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 914/1839] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:45 2022] DELETE /identity/v3/users/458403304f924dec8689463dd9e5688a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:45.767216 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675daba1-56c9-4b39-b842-443507886adb admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:45.767216 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-675daba1-56c9-4b39-b842-443507886adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:45.779358 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1276feeb-3f05-41b4-a676-eb619a85e941 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:45.780877 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1276feeb-3f05-41b4-a676-eb619a85e941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:45.796745 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:45.850884 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:45.876452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675daba1-56c9-4b39-b842-443507886adb admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:45.889039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7702459-eb40-4555-a8a1-c5218bae4115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:45.889695 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7702459-eb40-4555-a8a1-c5218bae4115 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:45.890155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7702459-eb40-4555-a8a1-c5218bae4115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:45.891516 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7702459-eb40-4555-a8a1-c5218bae4115 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:45.892659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7702459-eb40-4555-a8a1-c5218bae4115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:45.893047 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7702459-eb40-4555-a8a1-c5218bae4115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:45.896885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7702459-eb40-4555-a8a1-c5218bae4115 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:45.912556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 926/1840] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:45.913916 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276feeb-3f05-41b4-a676-eb619a85e941 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:45.916075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1276feeb-3f05-41b4-a676-eb619a85e941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:45.927080 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 915/1841] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:31:45.928328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18317d78-891d-4492-9969-887c58168d5f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:45.928665 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18317d78-891d-4492-9969-887c58168d5f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:45.928973 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18317d78-891d-4492-9969-887c58168d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:45.933044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276feeb-3f05-41b4-a676-eb619a85e941 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:45.942992 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bbfd4-51fd-4fb8-82f1-99d113ad618a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:45.944286 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bbfd4-51fd-4fb8-82f1-99d113ad618a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:45.944812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bbfd4-51fd-4fb8-82f1-99d113ad618a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:45.945990 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bbfd4-51fd-4fb8-82f1-99d113ad618a admin admin] PATH_INFO: `/v3/users/6780b8b897864d639933a6a3a4394ef4` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:45.950634 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bbfd4-51fd-4fb8-82f1-99d113ad618a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6780b8b897864d639933a6a3a4394ef4)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:45.956855 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bbfd4-51fd-4fb8-82f1-99d113ad618a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:45.977673 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-18317d78-891d-4492-9969-887c58168d5f None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:45.979193 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-18317d78-891d-4492-9969-887c58168d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:45.991436 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 916/1842] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:45.992040 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18317d78-891d-4492-9969-887c58168d5f None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:45.993823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-18317d78-891d-4492-9969-887c58168d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:46.028401 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18317d78-891d-4492-9969-887c58168d5f None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:46.036071 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880875a-8d66-43cb-ab13-1a646a6b6540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:46.036736 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880875a-8d66-43cb-ab13-1a646a6b6540 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:46.037025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880875a-8d66-43cb-ab13-1a646a6b6540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:46.037302 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880875a-8d66-43cb-ab13-1a646a6b6540 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:46.038090 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880875a-8d66-43cb-ab13-1a646a6b6540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:46.042313 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880875a-8d66-43cb-ab13-1a646a6b6540 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:46.051176 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-919bbfd4-51fd-4fb8-82f1-99d113ad618a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6780b8b897864d639933a6a3a4394ef4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:46.051786 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-919bbfd4-51fd-4fb8-82f1-99d113ad618a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6780b8b897864d639933a6a3a4394ef4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:46.066417 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-919bbfd4-51fd-4fb8-82f1-99d113ad618a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6780b8b897864d639933a6a3a4394ef4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:46.067480 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-919bbfd4-51fd-4fb8-82f1-99d113ad618a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6780b8b897864d639933a6a3a4394ef4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:46.082067 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 917/1843] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:45 2022] POST /identity/v3/projects => generated 379 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:46.083240 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880875a-8d66-43cb-ab13-1a646a6b6540 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:46.085392 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7880875a-8d66-43cb-ab13-1a646a6b6540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:46.091948 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-919bbfd4-51fd-4fb8-82f1-99d113ad618a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6780b8b897864d639933a6a3a4394ef4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:46.112983 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 927/1844] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:45 2022] DELETE /identity/v3/users/6780b8b897864d639933a6a3a4394ef4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:46.113969 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bbfd4-51fd-4fb8-82f1-99d113ad618a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:46.115397 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-919bbfd4-51fd-4fb8-82f1-99d113ad618a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:46.188908 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880875a-8d66-43cb-ab13-1a646a6b6540 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:46.244592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bbfd4-51fd-4fb8-82f1-99d113ad618a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:46.250483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa91544-40df-4581-82ef-438224beab4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:46.251627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa91544-40df-4581-82ef-438224beab4c admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:46.252000 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa91544-40df-4581-82ef-438224beab4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:46.252633 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa91544-40df-4581-82ef-438224beab4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:46.265929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa91544-40df-4581-82ef-438224beab4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:46.266557 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa91544-40df-4581-82ef-438224beab4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:46.269538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa91544-40df-4581-82ef-438224beab4c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:46.285882 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 928/1845] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:31:46.287127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa91544-40df-4581-82ef-438224beab4c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:46.289065 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9aa91544-40df-4581-82ef-438224beab4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:46.304787 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa91544-40df-4581-82ef-438224beab4c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:46.307979 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f2e73-c9a0-4eea-ac91-6f294087cc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:46.307979 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f2e73-c9a0-4eea-ac91-6f294087cc40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:46.308241 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f2e73-c9a0-4eea-ac91-6f294087cc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:46.308508 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f2e73-c9a0-4eea-ac91-6f294087cc40 admin admin] PATH_INFO: `/v3/projects/9ba700e156c04a9293c967dfdc719951` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:46.309713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f2e73-c9a0-4eea-ac91-6f294087cc40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ba700e156c04a9293c967dfdc719951)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:46.310719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c8904-715c-47e0-a9bb-b5ba54e12d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:46.311869 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c8904-715c-47e0-a9bb-b5ba54e12d5f admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:46.311869 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c8904-715c-47e0-a9bb-b5ba54e12d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:46.312189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c8904-715c-47e0-a9bb-b5ba54e12d5f admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:46.312280 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f2e73-c9a0-4eea-ac91-6f294087cc40 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:46.313081 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c8904-715c-47e0-a9bb-b5ba54e12d5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:46.315171 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c8904-715c-47e0-a9bb-b5ba54e12d5f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:46.343413 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 929/1846] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:46 2022] POST /identity/v3/users => generated 290 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:46.347805 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c8904-715c-47e0-a9bb-b5ba54e12d5f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:46.350383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-793c8904-715c-47e0-a9bb-b5ba54e12d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:46.359438 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:46.378173 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c8904-715c-47e0-a9bb-b5ba54e12d5f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:46.396368 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-cc1f2e73-c9a0-4eea-ac91-6f294087cc40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ba700e156c04a9293c967dfdc719951', 'request_id': 'req-cc1f2e73-c9a0-4eea-ac91-6f294087cc40'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:46.421817 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-cc1f2e73-c9a0-4eea-ac91-6f294087cc40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ba700e156c04a9293c967dfdc719951', 'request_id': 'req-cc1f2e73-c9a0-4eea-ac91-6f294087cc40'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:46.426199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:46.438929 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-cc1f2e73-c9a0-4eea-ac91-6f294087cc40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ba700e156c04a9293c967dfdc719951', 'request_id': 'req-cc1f2e73-c9a0-4eea-ac91-6f294087cc40'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:46.463110 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-cc1f2e73-c9a0-4eea-ac91-6f294087cc40 admin admin] The token cache is being invalidate because project 9ba700e156c04a9293c967dfdc719951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:46.463621 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-cc1f2e73-c9a0-4eea-ac91-6f294087cc40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:46.464305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-cc1f2e73-c9a0-4eea-ac91-6f294087cc40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:46.467248 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 918/1847] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:46 2022] DELETE /identity/v3/projects/9ba700e156c04a9293c967dfdc719951 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:46.468980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f2e73-c9a0-4eea-ac91-6f294087cc40 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:46.470582 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cc1f2e73-c9a0-4eea-ac91-6f294087cc40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:46.479876 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ede3b-2d00-4f43-80bf-7697aaf35dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:46.480809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ede3b-2d00-4f43-80bf-7697aaf35dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:46.481219 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ede3b-2d00-4f43-80bf-7697aaf35dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:46.482634 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ede3b-2d00-4f43-80bf-7697aaf35dfe admin admin] PATH_INFO: `/v3/projects/d5c60d15d76d4d719f5a12e1d5fd9487` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:46.484183 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ede3b-2d00-4f43-80bf-7697aaf35dfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5c60d15d76d4d719f5a12e1d5fd9487)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:46.486320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ede3b-2d00-4f43-80bf-7697aaf35dfe admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:46.554141 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-490ede3b-2d00-4f43-80bf-7697aaf35dfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5c60d15d76d4d719f5a12e1d5fd9487', 'request_id': 'req-490ede3b-2d00-4f43-80bf-7697aaf35dfe'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:46.567786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f2e73-c9a0-4eea-ac91-6f294087cc40 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:46.568255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-490ede3b-2d00-4f43-80bf-7697aaf35dfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5c60d15d76d4d719f5a12e1d5fd9487', 'request_id': 'req-490ede3b-2d00-4f43-80bf-7697aaf35dfe'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:46.574356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-490ede3b-2d00-4f43-80bf-7697aaf35dfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5c60d15d76d4d719f5a12e1d5fd9487', 'request_id': 'req-490ede3b-2d00-4f43-80bf-7697aaf35dfe'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:46.587113 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-490ede3b-2d00-4f43-80bf-7697aaf35dfe admin admin] The token cache is being invalidate because project d5c60d15d76d4d719f5a12e1d5fd9487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:46.587507 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-490ede3b-2d00-4f43-80bf-7697aaf35dfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:46.588254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-490ede3b-2d00-4f43-80bf-7697aaf35dfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:46.590239 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 930/1848] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:46 2022] DELETE /identity/v3/projects/d5c60d15d76d4d719f5a12e1d5fd9487 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:46.593853 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ede3b-2d00-4f43-80bf-7697aaf35dfe admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:46.598219 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-490ede3b-2d00-4f43-80bf-7697aaf35dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:46.637646 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d1236-60e0-4af3-aa42-b63b56306dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:46.638435 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d1236-60e0-4af3-aa42-b63b56306dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:46.638779 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d1236-60e0-4af3-aa42-b63b56306dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:46.639128 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d1236-60e0-4af3-aa42-b63b56306dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:46.639841 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d1236-60e0-4af3-aa42-b63b56306dc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:46.642792 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d1236-60e0-4af3-aa42-b63b56306dc8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:46.677880 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 919/1849] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:46 2022] POST /identity/v3/projects => generated 387 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:46.679395 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e068b-ed2e-4033-842f-46e3e67ccc15 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:46.679753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e068b-ed2e-4033-842f-46e3e67ccc15 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:46.680311 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e068b-ed2e-4033-842f-46e3e67ccc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:46.682591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ede3b-2d00-4f43-80bf-7697aaf35dfe admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:46.705371 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-263e068b-ed2e-4033-842f-46e3e67ccc15 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:46.707260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-263e068b-ed2e-4033-842f-46e3e67ccc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:46.729176 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:46.753539 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8c987-da4b-46a8-b436-38f8e8610bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:46.754166 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8c987-da4b-46a8-b436-38f8e8610bfd admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:46.754454 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8c987-da4b-46a8-b436-38f8e8610bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:46.754736 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8c987-da4b-46a8-b436-38f8e8610bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:46.755557 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8c987-da4b-46a8-b436-38f8e8610bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:46.757241 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed8c987-da4b-46a8-b436-38f8e8610bfd admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:46.770029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 931/1850] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:46.771258 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8c987-da4b-46a8-b436-38f8e8610bfd admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:46.773028 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9ed8c987-da4b-46a8-b436-38f8e8610bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:46.784743 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 920/1851] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:46.785649 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8c987-da4b-46a8-b436-38f8e8610bfd admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:46.785836 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340ea59-3d47-4309-8b83-50dd2a721d98 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:46.786126 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340ea59-3d47-4309-8b83-50dd2a721d98 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:46.786404 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340ea59-3d47-4309-8b83-50dd2a721d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:46.790651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd427dc-5487-4c71-9beb-8a82dece3096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:46.791285 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd427dc-5487-4c71-9beb-8a82dece3096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:46.791566 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd427dc-5487-4c71-9beb-8a82dece3096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:46.791842 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd427dc-5487-4c71-9beb-8a82dece3096 admin admin] PATH_INFO: `/v3/projects/804be84b005d47028879a5a0cd88a78d` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:46.792986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd427dc-5487-4c71-9beb-8a82dece3096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=804be84b005d47028879a5a0cd88a78d)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:46.794879 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd427dc-5487-4c71-9beb-8a82dece3096 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:46.807509 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-b340ea59-3d47-4309-8b83-50dd2a721d98 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:46.808773 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b340ea59-3d47-4309-8b83-50dd2a721d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:46.817688 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 921/1852] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:46.818555 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340ea59-3d47-4309-8b83-50dd2a721d98 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:46.819826 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b340ea59-3d47-4309-8b83-50dd2a721d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:46.837060 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340ea59-3d47-4309-8b83-50dd2a721d98 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:46.848523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9bd427dc-5487-4c71-9beb-8a82dece3096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '804be84b005d47028879a5a0cd88a78d', 'request_id': 'req-9bd427dc-5487-4c71-9beb-8a82dece3096'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:46.849738 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:46.856472 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9bd427dc-5487-4c71-9beb-8a82dece3096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '804be84b005d47028879a5a0cd88a78d', 'request_id': 'req-9bd427dc-5487-4c71-9beb-8a82dece3096'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:46.863312 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9bd427dc-5487-4c71-9beb-8a82dece3096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '804be84b005d47028879a5a0cd88a78d', 'request_id': 'req-9bd427dc-5487-4c71-9beb-8a82dece3096'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:46.875190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9bd427dc-5487-4c71-9beb-8a82dece3096 admin admin] The token cache is being invalidate because project 804be84b005d47028879a5a0cd88a78d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:46.875494 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9bd427dc-5487-4c71-9beb-8a82dece3096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:46.876161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9bd427dc-5487-4c71-9beb-8a82dece3096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:46.878259 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 932/1853] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:46 2022] DELETE /identity/v3/projects/804be84b005d47028879a5a0cd88a78d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:46.879109 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd427dc-5487-4c71-9beb-8a82dece3096 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:46.880425 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9bd427dc-5487-4c71-9beb-8a82dece3096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:46.901923 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b2f55-3bb3-41ce-a997-0a791a701378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:46.902554 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b2f55-3bb3-41ce-a997-0a791a701378 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:46.902894 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b2f55-3bb3-41ce-a997-0a791a701378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:46.903180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b2f55-3bb3-41ce-a997-0a791a701378 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:46.903812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b2f55-3bb3-41ce-a997-0a791a701378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:46.905891 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b2f55-3bb3-41ce-a997-0a791a701378 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:46.932974 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 922/1854] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:46 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:46.934172 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81119c-f5f1-4211-9704-b12263e4e63b None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:46.934648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81119c-f5f1-4211-9704-b12263e4e63b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:46.934776 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81119c-f5f1-4211-9704-b12263e4e63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:46.947309 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd427dc-5487-4c71-9beb-8a82dece3096 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:46.951850 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f242057-5a75-4fb0-869b-0afc36542133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:46.952458 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f242057-5a75-4fb0-869b-0afc36542133 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:46.952910 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f242057-5a75-4fb0-869b-0afc36542133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:46.953196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f242057-5a75-4fb0-869b-0afc36542133 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:46.953845 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f242057-5a75-4fb0-869b-0afc36542133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:46.955021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6a81119c-f5f1-4211-9704-b12263e4e63b None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:46.955438 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f242057-5a75-4fb0-869b-0afc36542133 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:46.956919 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6a81119c-f5f1-4211-9704-b12263e4e63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:46.965473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 923/1855] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:46.966972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107a50c-93e2-4ee6-a055-98887f929a46 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:46.970473 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 933/1856] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:46.970629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107a50c-93e2-4ee6-a055-98887f929a46 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:46.970629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107a50c-93e2-4ee6-a055-98887f929a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:46.970836 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7b118-0c74-4df0-b606-dc085f225dce None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:46.970836 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7b118-0c74-4df0-b606-dc085f225dce None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:46.970836 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7b118-0c74-4df0-b606-dc085f225dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:46.989069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-07e7b118-0c74-4df0-b606-dc085f225dce None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:46.990289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-07e7b118-0c74-4df0-b606-dc085f225dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:46.991746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9107a50c-93e2-4ee6-a055-98887f929a46 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:46.993232 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9107a50c-93e2-4ee6-a055-98887f929a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:46.999081 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 934/1857] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:46.999953 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7b118-0c74-4df0-b606-dc085f225dce None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:47.001283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-07e7b118-0c74-4df0-b606-dc085f225dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:47.008555 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 924/1858] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:47.009379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107a50c-93e2-4ee6-a055-98887f929a46 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:47.016505 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7b118-0c74-4df0-b606-dc085f225dce None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:47.020206 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107a50c-93e2-4ee6-a055-98887f929a46 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:47.022136 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68ea15-fbb2-481a-87e9-ec1f1ad1ffca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:47.022854 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68ea15-fbb2-481a-87e9-ec1f1ad1ffca admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.023208 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68ea15-fbb2-481a-87e9-ec1f1ad1ffca admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.023587 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68ea15-fbb2-481a-87e9-ec1f1ad1ffca admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.024265 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68ea15-fbb2-481a-87e9-ec1f1ad1ffca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:47.025920 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68ea15-fbb2-481a-87e9-ec1f1ad1ffca admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:47.026044 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e235690-d0b5-4618-bdaf-90352a12416f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:47.026597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e235690-d0b5-4618-bdaf-90352a12416f admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.026883 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e235690-d0b5-4618-bdaf-90352a12416f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.027162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e235690-d0b5-4618-bdaf-90352a12416f admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.027814 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e235690-d0b5-4618-bdaf-90352a12416f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:47.028736 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e235690-d0b5-4618-bdaf-90352a12416f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:47.030364 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e235690-d0b5-4618-bdaf-90352a12416f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:47.037308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 935/1859] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:47.041190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68ea15-fbb2-481a-87e9-ec1f1ad1ffca admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:47.043755 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 925/1860] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:31:47.045119 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746f191-b63b-4a92-a855-d15756e4c070 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.045482 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746f191-b63b-4a92-a855-d15756e4c070 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.045833 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746f191-b63b-4a92-a855-d15756e4c070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.052452 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68ea15-fbb2-481a-87e9-ec1f1ad1ffca admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:47.057125 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a28cc2-667b-4c28-a8de-5c635bbafc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:47.057865 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a28cc2-667b-4c28-a8de-5c635bbafc8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.058225 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a28cc2-667b-4c28-a8de-5c635bbafc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.058600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a28cc2-667b-4c28-a8de-5c635bbafc8d admin admin] PATH_INFO: `/v3/projects/8867b3d276fc431e80324af3d1ede257/users/566e35f5860a4968975bd622470fea4b/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.073938 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d746f191-b63b-4a92-a855-d15756e4c070 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:47.074501 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a28cc2-667b-4c28-a8de-5c635bbafc8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8867b3d276fc431e80324af3d1ede257, user_id=566e35f5860a4968975bd622470fea4b, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:47.075353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d746f191-b63b-4a92-a855-d15756e4c070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:47.077442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a28cc2-667b-4c28-a8de-5c635bbafc8d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:47.090745 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 926/1861] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:47.090745 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746f191-b63b-4a92-a855-d15756e4c070 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:47.097243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 936/1862] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:47 2022] PUT /identity/v3/projects/8867b3d276fc431e80324af3d1ede257/users/566e35f5860a4968975bd622470fea4b/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:47.097967 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a28cc2-667b-4c28-a8de-5c635bbafc8d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:47.100730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746f191-b63b-4a92-a855-d15756e4c070 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:47.117171 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:47.179487 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226edd7d-e1f4-4c94-8db2-7b0f64060e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:47.180120 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226edd7d-e1f4-4c94-8db2-7b0f64060e4a admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.180408 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226edd7d-e1f4-4c94-8db2-7b0f64060e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.180710 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226edd7d-e1f4-4c94-8db2-7b0f64060e4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.181389 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226edd7d-e1f4-4c94-8db2-7b0f64060e4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:47.181700 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226edd7d-e1f4-4c94-8db2-7b0f64060e4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:47.183505 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226edd7d-e1f4-4c94-8db2-7b0f64060e4a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:47.186413 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a28cc2-667b-4c28-a8de-5c635bbafc8d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:47.193543 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654a1e2-f732-4580-b9d2-a5a1dabc7390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:47.194170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654a1e2-f732-4580-b9d2-a5a1dabc7390 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.194453 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654a1e2-f732-4580-b9d2-a5a1dabc7390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.194731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654a1e2-f732-4580-b9d2-a5a1dabc7390 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.195383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654a1e2-f732-4580-b9d2-a5a1dabc7390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:47.199704 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 927/1863] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:31:47.199850 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654a1e2-f732-4580-b9d2-a5a1dabc7390 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:47.199941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226edd7d-e1f4-4c94-8db2-7b0f64060e4a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:47.207682 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226edd7d-e1f4-4c94-8db2-7b0f64060e4a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:47.212732 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 937/1864] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:47.212732 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654a1e2-f732-4580-b9d2-a5a1dabc7390 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:47.215134 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d0225-9784-490c-9a0c-d5577054914f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:47.215756 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d0225-9784-490c-9a0c-d5577054914f admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.216043 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d0225-9784-490c-9a0c-d5577054914f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.216333 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d0225-9784-490c-9a0c-d5577054914f admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.217007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d0225-9784-490c-9a0c-d5577054914f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:47.218953 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d0225-9784-490c-9a0c-d5577054914f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:47.222371 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654a1e2-f732-4580-b9d2-a5a1dabc7390 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:47.228030 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbc4b8-d022-4338-adf3-72e1900af839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:47.229207 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbc4b8-d022-4338-adf3-72e1900af839 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.229662 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbc4b8-d022-4338-adf3-72e1900af839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.230113 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbc4b8-d022-4338-adf3-72e1900af839 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.231132 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbc4b8-d022-4338-adf3-72e1900af839 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:47.231448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbc4b8-d022-4338-adf3-72e1900af839 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:47.233112 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbc4b8-d022-4338-adf3-72e1900af839 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:47.246516 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 938/1865] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:31:47.246516 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc7b10-dfdd-4c85-9373-94f62c80c65c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.246516 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc7b10-dfdd-4c85-9373-94f62c80c65c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.246516 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc7b10-dfdd-4c85-9373-94f62c80c65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.250511 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 928/1866] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:47 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:47.250511 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d0225-9784-490c-9a0c-d5577054914f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:47.278168 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0fbc7b10-dfdd-4c85-9373-94f62c80c65c None None] MFA Rules not processed for user `566e35f5860a4968975bd622470fea4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:47.279418 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0fbc7b10-dfdd-4c85-9373-94f62c80c65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:47.301058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:47.318732 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d0225-9784-490c-9a0c-d5577054914f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:47.323412 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a437b-ab84-4f9f-b70d-8c9dfa24605e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:47.324021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a437b-ab84-4f9f-b70d-8c9dfa24605e admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.324553 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a437b-ab84-4f9f-b70d-8c9dfa24605e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.324553 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a437b-ab84-4f9f-b70d-8c9dfa24605e admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.325223 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a437b-ab84-4f9f-b70d-8c9dfa24605e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:47.327155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a437b-ab84-4f9f-b70d-8c9dfa24605e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:47.349556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 939/1867] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:47.350479 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc7b10-dfdd-4c85-9373-94f62c80c65c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:47.356914 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 929/1868] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:47 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:47.357926 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a437b-ab84-4f9f-b70d-8c9dfa24605e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:47.364613 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc7b10-dfdd-4c85-9373-94f62c80c65c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:47.428339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df68869-532b-486f-8291-30bf552b1eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:47.429333 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df68869-532b-486f-8291-30bf552b1eab admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.429781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df68869-532b-486f-8291-30bf552b1eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.430366 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df68869-532b-486f-8291-30bf552b1eab admin admin] PATH_INFO: `/v3/projects/cee45a466d4b49a6ac8b960900d83311/users/6b7f2d104b3349ac8c15cad5c4f0b882/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.437248 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a437b-ab84-4f9f-b70d-8c9dfa24605e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:47.442879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181af27-65de-4e53-9c14-b553f057859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:47.443563 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181af27-65de-4e53-9c14-b553f057859a admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.443907 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181af27-65de-4e53-9c14-b553f057859a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.444164 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181af27-65de-4e53-9c14-b553f057859a admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.444846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181af27-65de-4e53-9c14-b553f057859a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:47.446786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181af27-65de-4e53-9c14-b553f057859a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:47.448474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df68869-532b-486f-8291-30bf552b1eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee45a466d4b49a6ac8b960900d83311, user_id=6b7f2d104b3349ac8c15cad5c4f0b882, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:47.451190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df68869-532b-486f-8291-30bf552b1eab admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:47.465915 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 940/1869] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:47 2022] PUT /identity/v3/projects/cee45a466d4b49a6ac8b960900d83311/users/6b7f2d104b3349ac8c15cad5c4f0b882/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:47.466924 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df68869-532b-486f-8291-30bf552b1eab admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:47.479207 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:47.489103 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 930/1870] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:47 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:47.490261 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181af27-65de-4e53-9c14-b553f057859a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:47.544622 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df68869-532b-486f-8291-30bf552b1eab admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:47.565432 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181af27-65de-4e53-9c14-b553f057859a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:47.572985 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc00d8a-9b76-41de-8a3c-129997bdd3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:47.573619 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc00d8a-9b76-41de-8a3c-129997bdd3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.574919 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc00d8a-9b76-41de-8a3c-129997bdd3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.574919 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc00d8a-9b76-41de-8a3c-129997bdd3d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.575270 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc00d8a-9b76-41de-8a3c-129997bdd3d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:47.577758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc00d8a-9b76-41de-8a3c-129997bdd3d8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:47.613329 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 931/1871] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:47 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:47.616494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc00d8a-9b76-41de-8a3c-129997bdd3d8 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:47.620856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8911a-00ec-4d15-9d65-427572d742b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:47.621595 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8911a-00ec-4d15-9d65-427572d742b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.621879 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8911a-00ec-4d15-9d65-427572d742b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.622155 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8911a-00ec-4d15-9d65-427572d742b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.623106 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8911a-00ec-4d15-9d65-427572d742b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:47.624766 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8911a-00ec-4d15-9d65-427572d742b6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:47.649357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 941/1872] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:47 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:47.650821 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59530ed-87a6-479f-afd3-b54493c11e3c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.651114 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59530ed-87a6-479f-afd3-b54493c11e3c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.651509 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59530ed-87a6-479f-afd3-b54493c11e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.666807 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:47.692140 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc00d8a-9b76-41de-8a3c-129997bdd3d8 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:47.692943 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c59530ed-87a6-479f-afd3-b54493c11e3c None None] MFA Rules not processed for user `6b7f2d104b3349ac8c15cad5c4f0b882`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:47.694185 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c59530ed-87a6-479f-afd3-b54493c11e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:47.696886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0a9f2-6e45-4bee-abdb-4347da04f217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:47.697502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0a9f2-6e45-4bee-abdb-4347da04f217 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.697786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0a9f2-6e45-4bee-abdb-4347da04f217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.698070 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0a9f2-6e45-4bee-abdb-4347da04f217 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.698703 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0a9f2-6e45-4bee-abdb-4347da04f217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:47.700781 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0a9f2-6e45-4bee-abdb-4347da04f217 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:47.723752 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 932/1873] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:47 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:47.724670 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0a9f2-6e45-4bee-abdb-4347da04f217 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:47.734359 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0a9f2-6e45-4bee-abdb-4347da04f217 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:47.739336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3895369-b98d-4cbf-93d5-c4f44102d891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:47.740055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3895369-b98d-4cbf-93d5-c4f44102d891 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.740463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3895369-b98d-4cbf-93d5-c4f44102d891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.740871 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3895369-b98d-4cbf-93d5-c4f44102d891 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.741783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3895369-b98d-4cbf-93d5-c4f44102d891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:47.743824 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3895369-b98d-4cbf-93d5-c4f44102d891 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:47.769698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 942/1874] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:47.769698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59530ed-87a6-479f-afd3-b54493c11e3c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:47.769969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 933/1875] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:47 2022] POST /identity/v3/users => generated 287 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:47.769969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3895369-b98d-4cbf-93d5-c4f44102d891 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:47.776443 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59530ed-87a6-479f-afd3-b54493c11e3c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:47.776893 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3895369-b98d-4cbf-93d5-c4f44102d891 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:47.781313 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8f69a-c57b-4587-afb6-a96b48a84729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:47.781969 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8f69a-c57b-4587-afb6-a96b48a84729 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.782171 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e684b07-5d84-4904-a4b7-10c1e4d40972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:47.782389 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8f69a-c57b-4587-afb6-a96b48a84729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.782731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8f69a-c57b-4587-afb6-a96b48a84729 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.782837 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e684b07-5d84-4904-a4b7-10c1e4d40972 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.783253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e684b07-5d84-4904-a4b7-10c1e4d40972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.783391 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e684b07-5d84-4904-a4b7-10c1e4d40972 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.783602 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8f69a-c57b-4587-afb6-a96b48a84729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:47.784672 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e684b07-5d84-4904-a4b7-10c1e4d40972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:47.786315 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e684b07-5d84-4904-a4b7-10c1e4d40972 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:47.786623 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8f69a-c57b-4587-afb6-a96b48a84729 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:47.798770 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 934/1876] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:47.801169 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e684b07-5d84-4904-a4b7-10c1e4d40972 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:47.817219 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e684b07-5d84-4904-a4b7-10c1e4d40972 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:47.822370 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 943/1877] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:47 2022] POST /identity/v3/users => generated 295 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:47.823413 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8f69a-c57b-4587-afb6-a96b48a84729 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:47.826367 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d27de-5e05-4424-bda5-c390934eceb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:47.826991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d27de-5e05-4424-bda5-c390934eceb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.827268 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d27de-5e05-4424-bda5-c390934eceb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.827536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d27de-5e05-4424-bda5-c390934eceb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.828222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d27de-5e05-4424-bda5-c390934eceb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:47.829850 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d27de-5e05-4424-bda5-c390934eceb8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:47.846055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 935/1878] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:47.846055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d27de-5e05-4424-bda5-c390934eceb8 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:47.847232 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8f69a-c57b-4587-afb6-a96b48a84729 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:47.852049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221181db-1787-4fe2-9c21-0d5bcbe09a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:47.852676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221181db-1787-4fe2-9c21-0d5bcbe09a06 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.852994 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221181db-1787-4fe2-9c21-0d5bcbe09a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.853314 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221181db-1787-4fe2-9c21-0d5bcbe09a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.853998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221181db-1787-4fe2-9c21-0d5bcbe09a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:47.855592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221181db-1787-4fe2-9c21-0d5bcbe09a06 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:47.863735 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d27de-5e05-4424-bda5-c390934eceb8 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:47.870237 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 944/1879] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:47.870237 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221181db-1787-4fe2-9c21-0d5bcbe09a06 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:47.871236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d5e90-e75a-4d35-9316-ea9f1d542d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:47.871936 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d5e90-e75a-4d35-9316-ea9f1d542d8b admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.872414 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d5e90-e75a-4d35-9316-ea9f1d542d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.872823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d5e90-e75a-4d35-9316-ea9f1d542d8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.873534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d5e90-e75a-4d35-9316-ea9f1d542d8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:47.875838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d5e90-e75a-4d35-9316-ea9f1d542d8b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:47.881950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221181db-1787-4fe2-9c21-0d5bcbe09a06 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:47.886625 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001f631-fcef-48ac-adb4-b558b700f985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:47.887263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001f631-fcef-48ac-adb4-b558b700f985 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:47.887544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001f631-fcef-48ac-adb4-b558b700f985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:47.888164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001f631-fcef-48ac-adb4-b558b700f985 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:47.888461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001f631-fcef-48ac-adb4-b558b700f985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:47.890260 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001f631-fcef-48ac-adb4-b558b700f985 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:47.896681 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:47.903894 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 945/1880] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:47.904864 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001f631-fcef-48ac-adb4-b558b700f985 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:47.915044 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 936/1881] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:47 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:47.916287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d5e90-e75a-4d35-9316-ea9f1d542d8b admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:47.920444 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001f631-fcef-48ac-adb4-b558b700f985 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:47.999140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee7eb3-693b-429d-8b16-ce260c278128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:47.999774 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee7eb3-693b-429d-8b16-ce260c278128 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:48.000197 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee7eb3-693b-429d-8b16-ce260c278128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:48.000598 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee7eb3-693b-429d-8b16-ce260c278128 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:48.001365 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee7eb3-693b-429d-8b16-ce260c278128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:48.004022 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee7eb3-693b-429d-8b16-ce260c278128 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:48.015340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d5e90-e75a-4d35-9316-ea9f1d542d8b admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:48.019532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 946/1882] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:48.019532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee7eb3-693b-429d-8b16-ce260c278128 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:48.028779 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420af26c-65cb-481d-8ca5-7ab174ac6a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:48.029443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420af26c-65cb-481d-8ca5-7ab174ac6a7f admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:48.029728 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420af26c-65cb-481d-8ca5-7ab174ac6a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:48.030111 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420af26c-65cb-481d-8ca5-7ab174ac6a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:48.030829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420af26c-65cb-481d-8ca5-7ab174ac6a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:48.034584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420af26c-65cb-481d-8ca5-7ab174ac6a7f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:48.043138 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee7eb3-693b-429d-8b16-ce260c278128 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:48.050432 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743dfb6-b429-4e86-8648-2186e0836b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:48.051268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743dfb6-b429-4e86-8648-2186e0836b76 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:48.051738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743dfb6-b429-4e86-8648-2186e0836b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:48.052059 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743dfb6-b429-4e86-8648-2186e0836b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:48.055412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743dfb6-b429-4e86-8648-2186e0836b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:48.055520 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 937/1883] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:48.055520 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420af26c-65cb-481d-8ca5-7ab174ac6a7f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:48.055710 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743dfb6-b429-4e86-8648-2186e0836b76 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:48.066496 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420af26c-65cb-481d-8ca5-7ab174ac6a7f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:48.072730 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 947/1884] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:48.072730 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743dfb6-b429-4e86-8648-2186e0836b76 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:48.074070 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d274f21-4d7c-40b3-a272-f5f4fd775112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:48.074856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d274f21-4d7c-40b3-a272-f5f4fd775112 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:48.075240 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d274f21-4d7c-40b3-a272-f5f4fd775112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:48.075616 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d274f21-4d7c-40b3-a272-f5f4fd775112 admin admin] PATH_INFO: `/v3/projects/1f879bf13cd74d2093af0b9819a2984e/users/450d8bef19394cf782a3a9c5e396d1b4/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:48.088979 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743dfb6-b429-4e86-8648-2186e0836b76 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:48.093722 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d274f21-4d7c-40b3-a272-f5f4fd775112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f879bf13cd74d2093af0b9819a2984e, user_id=450d8bef19394cf782a3a9c5e396d1b4, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:48.096357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80171ed-654d-4237-82e0-5c624a9d1852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:48.097345 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d274f21-4d7c-40b3-a272-f5f4fd775112 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:48.097530 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80171ed-654d-4237-82e0-5c624a9d1852 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:48.097833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80171ed-654d-4237-82e0-5c624a9d1852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:48.098093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80171ed-654d-4237-82e0-5c624a9d1852 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:48.098725 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80171ed-654d-4237-82e0-5c624a9d1852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:48.101173 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80171ed-654d-4237-82e0-5c624a9d1852 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:48.129191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 938/1885] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:48 2022] PUT /identity/v3/projects/1f879bf13cd74d2093af0b9819a2984e/users/450d8bef19394cf782a3a9c5e396d1b4/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:48.129191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d274f21-4d7c-40b3-a272-f5f4fd775112 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:48.139050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 948/1886] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:48 2022] POST /identity/v3/users => generated 298 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:48.139050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80171ed-654d-4237-82e0-5c624a9d1852 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:48.159629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80171ed-654d-4237-82e0-5c624a9d1852 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:48.197148 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:48.230344 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d274f21-4d7c-40b3-a272-f5f4fd775112 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:48.236547 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786486a-ae1c-4163-b70c-41d7ee217b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:48.237448 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786486a-ae1c-4163-b70c-41d7ee217b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:48.237748 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786486a-ae1c-4163-b70c-41d7ee217b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:48.238031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786486a-ae1c-4163-b70c-41d7ee217b41 admin admin] PATH_INFO: `/v3/projects/df083db3270546a3bda8305e8637b928/users/35ee5c9b9a5547eeabae2130dba21344/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:48.261525 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786486a-ae1c-4163-b70c-41d7ee217b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df083db3270546a3bda8305e8637b928, user_id=35ee5c9b9a5547eeabae2130dba21344, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:48.265157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786486a-ae1c-4163-b70c-41d7ee217b41 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:48.290267 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00386f7f-63fb-49b2-91f8-78de198ca594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:48.291194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00386f7f-63fb-49b2-91f8-78de198ca594 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:48.291875 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 939/1887] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:48 2022] PUT /identity/v3/projects/df083db3270546a3bda8305e8637b928/users/35ee5c9b9a5547eeabae2130dba21344/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:48.291998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00386f7f-63fb-49b2-91f8-78de198ca594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:48.291998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00386f7f-63fb-49b2-91f8-78de198ca594 admin admin] PATH_INFO: `/v3/projects/e4386aad19e046d18b5ff48903e065b2/users/832a8b71cf644f8baf2fb076be01c236/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:48.294890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786486a-ae1c-4163-b70c-41d7ee217b41 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:48.335718 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00386f7f-63fb-49b2-91f8-78de198ca594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4386aad19e046d18b5ff48903e065b2, user_id=832a8b71cf644f8baf2fb076be01c236, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:48.338538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00386f7f-63fb-49b2-91f8-78de198ca594 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:48.376139 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 949/1888] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:48 2022] PUT /identity/v3/projects/e4386aad19e046d18b5ff48903e065b2/users/832a8b71cf644f8baf2fb076be01c236/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:48.378090 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1541e03-177c-4380-83bf-3df5e5001f80 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:48.378404 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1541e03-177c-4380-83bf-3df5e5001f80 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:48.378875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1541e03-177c-4380-83bf-3df5e5001f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:48.388147 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786486a-ae1c-4163-b70c-41d7ee217b41 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:48.434032 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e1541e03-177c-4380-83bf-3df5e5001f80 None None] MFA Rules not processed for user `450d8bef19394cf782a3a9c5e396d1b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:48.435354 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e1541e03-177c-4380-83bf-3df5e5001f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:48.458690 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9392d6f-59f2-44a6-947a-d11732c4b781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:48.459965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9392d6f-59f2-44a6-947a-d11732c4b781 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:48.460476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9392d6f-59f2-44a6-947a-d11732c4b781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:48.460975 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9392d6f-59f2-44a6-947a-d11732c4b781 admin admin] PATH_INFO: `/v3/projects/574f530ddf924059a048be8234473716/users/bb440dd92ddf465891c8aca43f2ed53d/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:48.479801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9392d6f-59f2-44a6-947a-d11732c4b781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=574f530ddf924059a048be8234473716, user_id=bb440dd92ddf465891c8aca43f2ed53d, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:48.480010 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:48.482964 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9392d6f-59f2-44a6-947a-d11732c4b781 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:48.503674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 940/1889] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:48 2022] PUT /identity/v3/projects/574f530ddf924059a048be8234473716/users/bb440dd92ddf465891c8aca43f2ed53d/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:48.504595 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9392d6f-59f2-44a6-947a-d11732c4b781 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:48.534956 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 950/1890] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:48.536663 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1541e03-177c-4380-83bf-3df5e5001f80 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:48.550168 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1541e03-177c-4380-83bf-3df5e5001f80 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:48.582841 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:48.597343 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9392d6f-59f2-44a6-947a-d11732c4b781 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:48.602754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e0694-8025-417d-b733-e4561861e1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:48.603504 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e0694-8025-417d-b733-e4561861e1bd admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:48.603787 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e0694-8025-417d-b733-e4561861e1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:48.604062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e0694-8025-417d-b733-e4561861e1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:48.604769 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e0694-8025-417d-b733-e4561861e1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:48.606376 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e0694-8025-417d-b733-e4561861e1bd admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:48.614371 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2315d-25b4-4053-bd86-6965f24c936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:48.615079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2315d-25b4-4053-bd86-6965f24c936c admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:48.615430 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2315d-25b4-4053-bd86-6965f24c936c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:48.615774 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2315d-25b4-4053-bd86-6965f24c936c admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:48.616489 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2315d-25b4-4053-bd86-6965f24c936c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:48.617155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 941/1891] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:48.618297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2315d-25b4-4053-bd86-6965f24c936c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:48.618459 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba3012-2044-448e-9baa-2ee6e1ad7a6e None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:48.618748 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba3012-2044-448e-9baa-2ee6e1ad7a6e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:48.619018 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba3012-2044-448e-9baa-2ee6e1ad7a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:48.629265 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 951/1892] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:48.630670 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64688b5b-83ec-4e67-a801-324288f8d0be None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:48.631029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64688b5b-83ec-4e67-a801-324288f8d0be None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:48.631371 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64688b5b-83ec-4e67-a801-324288f8d0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:48.650098 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ccba3012-2044-448e-9baa-2ee6e1ad7a6e None None] MFA Rules not processed for user `832a8b71cf644f8baf2fb076be01c236`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:48.651631 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ccba3012-2044-448e-9baa-2ee6e1ad7a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:48.664361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-64688b5b-83ec-4e67-a801-324288f8d0be None None] MFA Rules not processed for user `bb440dd92ddf465891c8aca43f2ed53d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:48.665650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-64688b5b-83ec-4e67-a801-324288f8d0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:48.724998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 942/1893] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:48.724998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba3012-2044-448e-9baa-2ee6e1ad7a6e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:48.733726 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba3012-2044-448e-9baa-2ee6e1ad7a6e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:48.740879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceed0c0-9417-42dc-b086-be03cc953bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:48.741626 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceed0c0-9417-42dc-b086-be03cc953bbd admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:48.741626 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceed0c0-9417-42dc-b086-be03cc953bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:48.741626 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceed0c0-9417-42dc-b086-be03cc953bbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:48.741626 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceed0c0-9417-42dc-b086-be03cc953bbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:48.741626 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceed0c0-9417-42dc-b086-be03cc953bbd admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:48.746350 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 952/1894] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:48.747275 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64688b5b-83ec-4e67-a801-324288f8d0be None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:48.759156 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64688b5b-83ec-4e67-a801-324288f8d0be None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:48.767782 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bffa20-625c-4246-85c7-198827b5566e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:48.769152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bffa20-625c-4246-85c7-198827b5566e admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:48.769446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bffa20-625c-4246-85c7-198827b5566e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:48.769726 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bffa20-625c-4246-85c7-198827b5566e admin admin] PATH_INFO: `/v3/projects/645a1f70998243c98766ceaaf8a342e1/users/58c98062838b40328ad98d47dbd9f5a7/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:48.790329 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bffa20-625c-4246-85c7-198827b5566e admin admin] RBAC: Authorizing `identity:create_grant(project_id=645a1f70998243c98766ceaaf8a342e1, user_id=58c98062838b40328ad98d47dbd9f5a7, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:48.793345 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bffa20-625c-4246-85c7-198827b5566e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:48.798964 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 943/1895] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:48 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:48.798964 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceed0c0-9417-42dc-b086-be03cc953bbd admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:48.828847 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 953/1896] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:48 2022] PUT /identity/v3/projects/645a1f70998243c98766ceaaf8a342e1/users/58c98062838b40328ad98d47dbd9f5a7/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:48.831271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bffa20-625c-4246-85c7-198827b5566e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:48.883811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceed0c0-9417-42dc-b086-be03cc953bbd admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:48.892857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:48.929835 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bffa20-625c-4246-85c7-198827b5566e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:48.934690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055928c-ff5f-481d-8107-fa052c847fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:48.935387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055928c-ff5f-481d-8107-fa052c847fab admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:48.935744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055928c-ff5f-481d-8107-fa052c847fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:48.936100 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055928c-ff5f-481d-8107-fa052c847fab admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:48.936902 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055928c-ff5f-481d-8107-fa052c847fab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:48.939064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7055928c-ff5f-481d-8107-fa052c847fab admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:48.972974 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 954/1897] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:48 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:48.973419 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0474bd-750d-4d1e-a382-9142d2c2b3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:48.974037 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055928c-ff5f-481d-8107-fa052c847fab admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:48.974235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0474bd-750d-4d1e-a382-9142d2c2b3c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:48.974589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0474bd-750d-4d1e-a382-9142d2c2b3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:48.974931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0474bd-750d-4d1e-a382-9142d2c2b3c7 admin admin] PATH_INFO: `/v3/projects/df083db3270546a3bda8305e8637b928/users/35ee5c9b9a5547eeabae2130dba21344/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:48.977110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7055928c-ff5f-481d-8107-fa052c847fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:48.977263 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0474bd-750d-4d1e-a382-9142d2c2b3c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df083db3270546a3bda8305e8637b928, user_id=35ee5c9b9a5547eeabae2130dba21344, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:48.979922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0474bd-750d-4d1e-a382-9142d2c2b3c7 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:48.986627 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:48.994323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 944/1898] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:48 2022] PUT /identity/v3/projects/df083db3270546a3bda8305e8637b928/users/35ee5c9b9a5547eeabae2130dba21344/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:48.997616 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0474bd-750d-4d1e-a382-9142d2c2b3c7 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:49.052361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055928c-ff5f-481d-8107-fa052c847fab admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:49.074586 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0474bd-750d-4d1e-a382-9142d2c2b3c7 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:49.079557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff79d5-5319-40e1-a1b0-88932f412350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:49.080248 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff79d5-5319-40e1-a1b0-88932f412350 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:49.080648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff79d5-5319-40e1-a1b0-88932f412350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:49.081607 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff79d5-5319-40e1-a1b0-88932f412350 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:49.082414 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff79d5-5319-40e1-a1b0-88932f412350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:49.084746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff79d5-5319-40e1-a1b0-88932f412350 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:49.109752 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f06811-66a2-4db6-8e16-c952c8a6d1f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:49.110374 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f06811-66a2-4db6-8e16-c952c8a6d1f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:49.110664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f06811-66a2-4db6-8e16-c952c8a6d1f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:49.110946 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f06811-66a2-4db6-8e16-c952c8a6d1f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:49.117154 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 945/1899] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:48 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:49.118095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff79d5-5319-40e1-a1b0-88932f412350 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:49.130389 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff79d5-5319-40e1-a1b0-88932f412350 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:49.135415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0497aa-6299-4856-9530-f11c102c4731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:49.136037 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0497aa-6299-4856-9530-f11c102c4731 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:49.136320 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0497aa-6299-4856-9530-f11c102c4731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:49.136599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0497aa-6299-4856-9530-f11c102c4731 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:49.137305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0497aa-6299-4856-9530-f11c102c4731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:49.138938 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0497aa-6299-4856-9530-f11c102c4731 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:49.157146 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 946/1900] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:49.158202 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0497aa-6299-4856-9530-f11c102c4731 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:49.172373 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0497aa-6299-4856-9530-f11c102c4731 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:49.177852 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4c8d9-4edc-4089-9321-39591203e111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:49.178470 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4c8d9-4edc-4089-9321-39591203e111 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:49.178749 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4c8d9-4edc-4089-9321-39591203e111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:49.179024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4c8d9-4edc-4089-9321-39591203e111 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:49.179650 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4c8d9-4edc-4089-9321-39591203e111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:49.180443 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f06811-66a2-4db6-8e16-c952c8a6d1f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:49.181595 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4c8d9-4edc-4089-9321-39591203e111 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:49.182382 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f06811-66a2-4db6-8e16-c952c8a6d1f5 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:49.191642 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 955/1901] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:49.193146 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52d25c-e7c7-4d2e-9519-22410600041d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:49.193464 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52d25c-e7c7-4d2e-9519-22410600041d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:49.193741 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52d25c-e7c7-4d2e-9519-22410600041d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:49.207123 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 947/1902] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:49 2022] POST /identity/v3/users => generated 294 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:49.207123 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4c8d9-4edc-4089-9321-39591203e111 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:49.218946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4c8d9-4edc-4089-9321-39591203e111 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:49.225422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe2508-8e5e-43f2-9134-a022de96b35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:49.226059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe2508-8e5e-43f2-9134-a022de96b35c admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:49.226345 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe2508-8e5e-43f2-9134-a022de96b35c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:49.227049 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe2508-8e5e-43f2-9134-a022de96b35c admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:49.227962 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe2508-8e5e-43f2-9134-a022de96b35c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:49.228606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6c52d25c-e7c7-4d2e-9519-22410600041d None None] MFA Rules not processed for user `35ee5c9b9a5547eeabae2130dba21344`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:49.229902 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6c52d25c-e7c7-4d2e-9519-22410600041d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:49.230804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe2508-8e5e-43f2-9134-a022de96b35c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:49.252791 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 948/1903] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:49.252791 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe2508-8e5e-43f2-9134-a022de96b35c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:49.256544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:49.280180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe2508-8e5e-43f2-9134-a022de96b35c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:49.290376 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bfda4-4352-45a0-a34b-899138f86d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:49.292970 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bfda4-4352-45a0-a34b-899138f86d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:49.295162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bfda4-4352-45a0-a34b-899138f86d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:49.295649 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bfda4-4352-45a0-a34b-899138f86d98 admin admin] PATH_INFO: `/v3/projects/645a1f70998243c98766ceaaf8a342e1/users/58c98062838b40328ad98d47dbd9f5a7/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:49.299778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bfda4-4352-45a0-a34b-899138f86d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=645a1f70998243c98766ceaaf8a342e1, user_id=58c98062838b40328ad98d47dbd9f5a7, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:49.303000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bfda4-4352-45a0-a34b-899138f86d98 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:49.326605 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 949/1904] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:49 2022] PUT /identity/v3/projects/645a1f70998243c98766ceaaf8a342e1/users/58c98062838b40328ad98d47dbd9f5a7/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:49.326605 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bfda4-4352-45a0-a34b-899138f86d98 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:49.345999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 956/1905] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:49.348502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52d25c-e7c7-4d2e-9519-22410600041d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:49.361288 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52d25c-e7c7-4d2e-9519-22410600041d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:49.418999 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bfda4-4352-45a0-a34b-899138f86d98 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:49.425085 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cad344-8198-4c7e-8bb9-00a87a3cbde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:49.425820 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cad344-8198-4c7e-8bb9-00a87a3cbde1 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:49.426175 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cad344-8198-4c7e-8bb9-00a87a3cbde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:49.426639 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cad344-8198-4c7e-8bb9-00a87a3cbde1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:49.427481 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cad344-8198-4c7e-8bb9-00a87a3cbde1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:49.429292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cad344-8198-4c7e-8bb9-00a87a3cbde1 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:49.444293 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 950/1906] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:49.445185 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cad344-8198-4c7e-8bb9-00a87a3cbde1 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:49.455468 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04847e98-04b9-4191-af81-f22ce2a94318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:49.457375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04847e98-04b9-4191-af81-f22ce2a94318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:49.457738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04847e98-04b9-4191-af81-f22ce2a94318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:49.458202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04847e98-04b9-4191-af81-f22ce2a94318 admin admin] PATH_INFO: `/v3/users/bb440dd92ddf465891c8aca43f2ed53d` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:49.461330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04847e98-04b9-4191-af81-f22ce2a94318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb440dd92ddf465891c8aca43f2ed53d)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:49.464029 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cad344-8198-4c7e-8bb9-00a87a3cbde1 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:49.464293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04847e98-04b9-4191-af81-f22ce2a94318 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:49.472815 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d5bea-368b-4902-84f7-f80a12acb0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:49.473513 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d5bea-368b-4902-84f7-f80a12acb0d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:49.473825 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d5bea-368b-4902-84f7-f80a12acb0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:49.474193 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d5bea-368b-4902-84f7-f80a12acb0d8 admin admin] PATH_INFO: `/v3/projects/3a127d3ac39f4fe7a44cb967f0a468d8/users/fd1d354c37d14106a38891aa739a2cb5/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:49.493674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d5bea-368b-4902-84f7-f80a12acb0d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a127d3ac39f4fe7a44cb967f0a468d8, user_id=fd1d354c37d14106a38891aa739a2cb5, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:49.496601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d5bea-368b-4902-84f7-f80a12acb0d8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:49.512933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 951/1907] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:49 2022] PUT /identity/v3/projects/3a127d3ac39f4fe7a44cb967f0a468d8/users/fd1d354c37d14106a38891aa739a2cb5/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:49.514545 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42fd65-76a6-4117-b55d-e0d7786e73be None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:49.515143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42fd65-76a6-4117-b55d-e0d7786e73be None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:49.515143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42fd65-76a6-4117-b55d-e0d7786e73be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:49.531266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:49.551487 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-0c42fd65-76a6-4117-b55d-e0d7786e73be None None] MFA Rules not processed for user `58c98062838b40328ad98d47dbd9f5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:49.552863 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0c42fd65-76a6-4117-b55d-e0d7786e73be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:49.564146 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-04847e98-04b9-4191-af81-f22ce2a94318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb440dd92ddf465891c8aca43f2ed53d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:49.565729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-04847e98-04b9-4191-af81-f22ce2a94318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb440dd92ddf465891c8aca43f2ed53d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:49.585903 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-04847e98-04b9-4191-af81-f22ce2a94318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb440dd92ddf465891c8aca43f2ed53d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:49.586652 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-04847e98-04b9-4191-af81-f22ce2a94318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb440dd92ddf465891c8aca43f2ed53d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:49.605003 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-04847e98-04b9-4191-af81-f22ce2a94318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb440dd92ddf465891c8aca43f2ed53d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:49.623828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 957/1908] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:49 2022] DELETE /identity/v3/users/bb440dd92ddf465891c8aca43f2ed53d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:49.624834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04847e98-04b9-4191-af81-f22ce2a94318 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:49.627965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-04847e98-04b9-4191-af81-f22ce2a94318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:49.671520 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 952/1909] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:49.671520 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42fd65-76a6-4117-b55d-e0d7786e73be None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:49.677515 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:49.682682 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0c42fd65-76a6-4117-b55d-e0d7786e73be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:49.696622 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04847e98-04b9-4191-af81-f22ce2a94318 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:49.700906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f5633-ad11-41ce-a52c-d920c60fa7bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:49.701535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f5633-ad11-41ce-a52c-d920c60fa7bb service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:49.701819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f5633-ad11-41ce-a52c-d920c60fa7bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:49.702096 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f5633-ad11-41ce-a52c-d920c60fa7bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:49.703955 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ad6f5633-ad11-41ce-a52c-d920c60fa7bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:49.768157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42fd65-76a6-4117-b55d-e0d7786e73be None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:49.777232 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f5633-ad11-41ce-a52c-d920c60fa7bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:49.778831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f5633-ad11-41ce-a52c-d920c60fa7bb service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:49.795205 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 958/1910] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:49.795946 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f5633-ad11-41ce-a52c-d920c60fa7bb service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:49.798071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ad6f5633-ad11-41ce-a52c-d920c60fa7bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:49.865362 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d465830-8052-4fa7-ad8b-902a94949091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:49.866470 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d465830-8052-4fa7-ad8b-902a94949091 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:49.869261 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d465830-8052-4fa7-ad8b-902a94949091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:49.869618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d465830-8052-4fa7-ad8b-902a94949091 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:49.870385 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d465830-8052-4fa7-ad8b-902a94949091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:49.872424 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d465830-8052-4fa7-ad8b-902a94949091 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:49.888089 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 953/1911] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:49.890150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bcba7-d33b-490f-ae8d-d7bbb30c8e77 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:49.890441 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bcba7-d33b-490f-ae8d-d7bbb30c8e77 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:49.890721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bcba7-d33b-490f-ae8d-d7bbb30c8e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:49.915237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-303bcba7-d33b-490f-ae8d-d7bbb30c8e77 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:49.916472 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-303bcba7-d33b-490f-ae8d-d7bbb30c8e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:49.935594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 954/1912] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:49.936672 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bcba7-d33b-490f-ae8d-d7bbb30c8e77 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:49.939781 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-303bcba7-d33b-490f-ae8d-d7bbb30c8e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:49.946880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f5633-ad11-41ce-a52c-d920c60fa7bb service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:49.959633 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bcba7-d33b-490f-ae8d-d7bbb30c8e77 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:49.966056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f3909-5c2c-4b84-87dc-2a7f3e8a1cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:49.966745 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f3909-5c2c-4b84-87dc-2a7f3e8a1cfe admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:49.967008 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defaf076-9933-4297-98c7-2066fbc0f825 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:49.967634 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f3909-5c2c-4b84-87dc-2a7f3e8a1cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:49.967834 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaf076-9933-4297-98c7-2066fbc0f825 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:49.967940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f3909-5c2c-4b84-87dc-2a7f3e8a1cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:49.968286 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaf076-9933-4297-98c7-2066fbc0f825 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:49.968660 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaf076-9933-4297-98c7-2066fbc0f825 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:49.968804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f3909-5c2c-4b84-87dc-2a7f3e8a1cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:49.972549 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f3909-5c2c-4b84-87dc-2a7f3e8a1cfe admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:50.011588 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 959/1913] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:50.011588 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f3909-5c2c-4b84-87dc-2a7f3e8a1cfe admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:50.015311 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:50.028164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f3909-5c2c-4b84-87dc-2a7f3e8a1cfe admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:50.046641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362c209-598a-4ec8-a793-831c720739b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:50.048891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362c209-598a-4ec8-a793-831c720739b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:50.051628 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362c209-598a-4ec8-a793-831c720739b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:50.052935 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362c209-598a-4ec8-a793-831c720739b2 admin admin] PATH_INFO: `/v3/projects/4d3b16f733e14956b4992442300a141d/users/f793225984994a24a37a0c5ecceac2d6/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:50.116069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362c209-598a-4ec8-a793-831c720739b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d3b16f733e14956b4992442300a141d, user_id=f793225984994a24a37a0c5ecceac2d6, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:50.121332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362c209-598a-4ec8-a793-831c720739b2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:50.129789 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defaf076-9933-4297-98c7-2066fbc0f825 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:50.131299 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defaf076-9933-4297-98c7-2066fbc0f825 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:50.152360 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 955/1914] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:50.157147 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 960/1915] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:50 2022] PUT /identity/v3/projects/4d3b16f733e14956b4992442300a141d/users/f793225984994a24a37a0c5ecceac2d6/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:50.157980 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362c209-598a-4ec8-a793-831c720739b2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:50.160086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defaf076-9933-4297-98c7-2066fbc0f825 service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:50.167499 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-defaf076-9933-4297-98c7-2066fbc0f825 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:50.304568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362c209-598a-4ec8-a793-831c720739b2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:50.315162 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301b52a-1690-4d1d-aa19-75dca0de663b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:50.315947 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301b52a-1690-4d1d-aa19-75dca0de663b admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:50.332721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301b52a-1690-4d1d-aa19-75dca0de663b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:50.332721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301b52a-1690-4d1d-aa19-75dca0de663b admin admin] PATH_INFO: `/v3/projects/3a127d3ac39f4fe7a44cb967f0a468d8/users/fd1d354c37d14106a38891aa739a2cb5/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:50.332721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301b52a-1690-4d1d-aa19-75dca0de663b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a127d3ac39f4fe7a44cb967f0a468d8, user_id=fd1d354c37d14106a38891aa739a2cb5, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:50.332721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301b52a-1690-4d1d-aa19-75dca0de663b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:50.333857 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defaf076-9933-4297-98c7-2066fbc0f825 service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:50.337225 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:50.347591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 961/1916] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:50 2022] PUT /identity/v3/projects/3a127d3ac39f4fe7a44cb967f0a468d8/users/fd1d354c37d14106a38891aa739a2cb5/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:50.351534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5276c42-22b4-424c-bc5d-e6f836bd6106 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:50.352035 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5276c42-22b4-424c-bc5d-e6f836bd6106 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:50.352547 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5276c42-22b4-424c-bc5d-e6f836bd6106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:50.438011 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d5276c42-22b4-424c-bc5d-e6f836bd6106 None None] MFA Rules not processed for user `f793225984994a24a37a0c5ecceac2d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:50.439747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d5276c42-22b4-424c-bc5d-e6f836bd6106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:50.475295 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff2b90-e95e-445b-8fb8-2b45aeec93a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:50.475950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff2b90-e95e-445b-8fb8-2b45aeec93a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:50.475950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff2b90-e95e-445b-8fb8-2b45aeec93a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:50.477395 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff2b90-e95e-445b-8fb8-2b45aeec93a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:50.496565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff2b90-e95e-445b-8fb8-2b45aeec93a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:50.499011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff2b90-e95e-445b-8fb8-2b45aeec93a6 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:50.514424 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 956/1917] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:50.514968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff2b90-e95e-445b-8fb8-2b45aeec93a6 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:50.516824 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-34ff2b90-e95e-445b-8fb8-2b45aeec93a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:50.539829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff2b90-e95e-445b-8fb8-2b45aeec93a6 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:50.582654 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 962/1918] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:50.585317 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f638ef-bfd9-46ee-9d98-1287832980c4 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:50.585705 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f638ef-bfd9-46ee-9d98-1287832980c4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:50.587446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f638ef-bfd9-46ee-9d98-1287832980c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:50.628431 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ce316-5429-4104-91ae-05ce1a93db20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:50.629821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ce316-5429-4104-91ae-05ce1a93db20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:50.630142 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ce316-5429-4104-91ae-05ce1a93db20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:50.630462 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ce316-5429-4104-91ae-05ce1a93db20 admin admin] PATH_INFO: `/v3/users/6b7f2d104b3349ac8c15cad5c4f0b882` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:50.631912 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ce316-5429-4104-91ae-05ce1a93db20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b7f2d104b3349ac8c15cad5c4f0b882)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:50.637284 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-69f638ef-bfd9-46ee-9d98-1287832980c4 None None] MFA Rules not processed for user `fd1d354c37d14106a38891aa739a2cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:50.638944 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ce316-5429-4104-91ae-05ce1a93db20 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:50.639280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-69f638ef-bfd9-46ee-9d98-1287832980c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:50.678306 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:50.725658 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-430ce316-5429-4104-91ae-05ce1a93db20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b7f2d104b3349ac8c15cad5c4f0b882'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:50.726921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-430ce316-5429-4104-91ae-05ce1a93db20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b7f2d104b3349ac8c15cad5c4f0b882'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:50.737399 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-430ce316-5429-4104-91ae-05ce1a93db20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b7f2d104b3349ac8c15cad5c4f0b882'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:50.738578 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-430ce316-5429-4104-91ae-05ce1a93db20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b7f2d104b3349ac8c15cad5c4f0b882'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:50.751913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-430ce316-5429-4104-91ae-05ce1a93db20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b7f2d104b3349ac8c15cad5c4f0b882'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:50.760846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 963/1919] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:50.762126 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f638ef-bfd9-46ee-9d98-1287832980c4 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:50.763774 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-69f638ef-bfd9-46ee-9d98-1287832980c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:50.785273 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f638ef-bfd9-46ee-9d98-1287832980c4 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:50.789856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 957/1920] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:50 2022] DELETE /identity/v3/users/6b7f2d104b3349ac8c15cad5c4f0b882 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:50.793896 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ce316-5429-4104-91ae-05ce1a93db20 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:50.795814 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-430ce316-5429-4104-91ae-05ce1a93db20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:50.818848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f51aa-4602-4649-b448-89b26b86e8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:50.821154 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f51aa-4602-4649-b448-89b26b86e8cb admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:50.823126 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f51aa-4602-4649-b448-89b26b86e8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:50.829550 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f51aa-4602-4649-b448-89b26b86e8cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:50.830269 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f51aa-4602-4649-b448-89b26b86e8cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:50.832870 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f51aa-4602-4649-b448-89b26b86e8cb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:50.889771 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 964/1921] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:50 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:50.889771 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0f423-fdee-4ada-b8ab-6a59af3365e0 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:50.889771 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0f423-fdee-4ada-b8ab-6a59af3365e0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:50.889771 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0f423-fdee-4ada-b8ab-6a59af3365e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:50.904414 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ce316-5429-4104-91ae-05ce1a93db20 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:50.926320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4fc0f423-fdee-4ada-b8ab-6a59af3365e0 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:50.928835 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4fc0f423-fdee-4ada-b8ab-6a59af3365e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:51.035017 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:51.039656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3cccb-4dc9-4572-aade-529857b55e57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:51.040450 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3cccb-4dc9-4572-aade-529857b55e57 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:51.040758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3cccb-4dc9-4572-aade-529857b55e57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:51.041105 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3cccb-4dc9-4572-aade-529857b55e57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:51.069383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 965/1922] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:51.071572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fe430-43a4-49eb-83ef-f36dbd35da0a None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:51.072049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fe430-43a4-49eb-83ef-f36dbd35da0a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:51.072476 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fe430-43a4-49eb-83ef-f36dbd35da0a None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:51.074690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 966/1923] 10.222.0.96 () {54 vars in 921 bytes} [Wed Aug 24 04:31:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:31:51.075647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fe430-43a4-49eb-83ef-f36dbd35da0a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:51.094349 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fe430-43a4-49eb-83ef-f36dbd35da0a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:51.106167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8078b-bdd7-409a-8113-a6151cdb3599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:51.106804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8078b-bdd7-409a-8113-a6151cdb3599 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:51.107092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8078b-bdd7-409a-8113-a6151cdb3599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:51.107369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8078b-bdd7-409a-8113-a6151cdb3599 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:51.108869 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8078b-bdd7-409a-8113-a6151cdb3599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:51.113592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8078b-bdd7-409a-8113-a6151cdb3599 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:51.149484 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 967/1924] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:51 2022] POST /identity/v3/users => generated 300 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:51.151747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8078b-bdd7-409a-8113-a6151cdb3599 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:51.153764 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c3c8078b-bdd7-409a-8113-a6151cdb3599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:51.157543 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3cccb-4dc9-4572-aade-529857b55e57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:51.161696 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3cccb-4dc9-4572-aade-529857b55e57 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:51.173228 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 958/1925] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:51.173619 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8078b-bdd7-409a-8113-a6151cdb3599 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:51.174487 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3cccb-4dc9-4572-aade-529857b55e57 service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:51.176764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d5c3cccb-4dc9-4572-aade-529857b55e57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:51.179181 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97898b-5c3d-4555-a5ff-110fdb1502e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:51.179876 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97898b-5c3d-4555-a5ff-110fdb1502e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:51.180482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97898b-5c3d-4555-a5ff-110fdb1502e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:51.180793 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97898b-5c3d-4555-a5ff-110fdb1502e4 admin admin] PATH_INFO: `/v3/projects/574f530ddf924059a048be8234473716` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:51.181960 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97898b-5c3d-4555-a5ff-110fdb1502e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=574f530ddf924059a048be8234473716)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:51.185342 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97898b-5c3d-4555-a5ff-110fdb1502e4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:51.188864 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:51.300241 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3cccb-4dc9-4572-aade-529857b55e57 service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:51.307024 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-be97898b-5c3d-4555-a5ff-110fdb1502e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '574f530ddf924059a048be8234473716', 'request_id': 'req-be97898b-5c3d-4555-a5ff-110fdb1502e4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:51.319412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-be97898b-5c3d-4555-a5ff-110fdb1502e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '574f530ddf924059a048be8234473716', 'request_id': 'req-be97898b-5c3d-4555-a5ff-110fdb1502e4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:51.334765 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-be97898b-5c3d-4555-a5ff-110fdb1502e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '574f530ddf924059a048be8234473716', 'request_id': 'req-be97898b-5c3d-4555-a5ff-110fdb1502e4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:51.358496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-be97898b-5c3d-4555-a5ff-110fdb1502e4 admin admin] The token cache is being invalidate because project 574f530ddf924059a048be8234473716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:51.359017 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-be97898b-5c3d-4555-a5ff-110fdb1502e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:51.359793 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-be97898b-5c3d-4555-a5ff-110fdb1502e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:51.366217 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 968/1926] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:51 2022] DELETE /identity/v3/projects/574f530ddf924059a048be8234473716 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:51.366217 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122397ca-8bdd-49d4-b1d3-c8204d4c4c6c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:51.366217 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122397ca-8bdd-49d4-b1d3-c8204d4c4c6c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:51.366217 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122397ca-8bdd-49d4-b1d3-c8204d4c4c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:51.409405 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-122397ca-8bdd-49d4-b1d3-c8204d4c4c6c None None] MFA Rules not processed for user `3539784b4e91472eb20addc6707dc30d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:51.412100 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-122397ca-8bdd-49d4-b1d3-c8204d4c4c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:51.414607 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7debb5bf-3b00-4335-9bb1-4f559493b016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:51.415244 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debb5bf-3b00-4335-9bb1-4f559493b016 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:51.415535 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debb5bf-3b00-4335-9bb1-4f559493b016 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:51.415812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debb5bf-3b00-4335-9bb1-4f559493b016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:51.419369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7debb5bf-3b00-4335-9bb1-4f559493b016 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:51.511997 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 969/1927] 10.222.0.96 () {58 vars in 1018 bytes} [Wed Aug 24 04:31:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:51.513151 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122397ca-8bdd-49d4-b1d3-c8204d4c4c6c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:51.515750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-122397ca-8bdd-49d4-b1d3-c8204d4c4c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:51.519872 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7debb5bf-3b00-4335-9bb1-4f559493b016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:51.521826 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7debb5bf-3b00-4335-9bb1-4f559493b016 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:51.531000 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122397ca-8bdd-49d4-b1d3-c8204d4c4c6c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:51.532451 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 959/1928] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:51.533418 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7debb5bf-3b00-4335-9bb1-4f559493b016 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:51.535584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7debb5bf-3b00-4335-9bb1-4f559493b016 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:51.540542 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf6711-5d73-43cf-be41-d5a86779d696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:51.541927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf6711-5d73-43cf-be41-d5a86779d696 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:51.542428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf6711-5d73-43cf-be41-d5a86779d696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:51.542937 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf6711-5d73-43cf-be41-d5a86779d696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:51.543970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf6711-5d73-43cf-be41-d5a86779d696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:51.545948 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf6711-5d73-43cf-be41-d5a86779d696 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:51.548019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7debb5bf-3b00-4335-9bb1-4f559493b016 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:51.554856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb71421-7673-441d-b9ea-5e04a1338132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:51.555157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb71421-7673-441d-b9ea-5e04a1338132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:51.555397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb71421-7673-441d-b9ea-5e04a1338132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:51.555572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb71421-7673-441d-b9ea-5e04a1338132 admin admin] PATH_INFO: `/v3/users/450d8bef19394cf782a3a9c5e396d1b4` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:51.557101 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb71421-7673-441d-b9ea-5e04a1338132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=450d8bef19394cf782a3a9c5e396d1b4)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:51.558779 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb71421-7673-441d-b9ea-5e04a1338132 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:51.560890 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 970/1929] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:51.561116 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156df39-0299-4e8b-8fbd-f019dc317be2 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:51.561477 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156df39-0299-4e8b-8fbd-f019dc317be2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:51.561843 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156df39-0299-4e8b-8fbd-f019dc317be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:51.582975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c156df39-0299-4e8b-8fbd-f019dc317be2 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:51.584578 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c156df39-0299-4e8b-8fbd-f019dc317be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:51.594358 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 971/1930] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:51.595291 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156df39-0299-4e8b-8fbd-f019dc317be2 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:51.597532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c156df39-0299-4e8b-8fbd-f019dc317be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:51.629982 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-9eb71421-7673-441d-b9ea-5e04a1338132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '450d8bef19394cf782a3a9c5e396d1b4'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:51.631971 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-9eb71421-7673-441d-b9ea-5e04a1338132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '450d8bef19394cf782a3a9c5e396d1b4'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:51.640461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:51.642710 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-9eb71421-7673-441d-b9ea-5e04a1338132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '450d8bef19394cf782a3a9c5e396d1b4'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:51.645094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-9eb71421-7673-441d-b9ea-5e04a1338132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '450d8bef19394cf782a3a9c5e396d1b4'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:51.656792 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-9eb71421-7673-441d-b9ea-5e04a1338132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '450d8bef19394cf782a3a9c5e396d1b4'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:51.664092 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:51.673949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156df39-0299-4e8b-8fbd-f019dc317be2 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:51.679327 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762b755-53c9-421c-8b34-7b9252ddb8d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:51.680069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762b755-53c9-421c-8b34-7b9252ddb8d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:51.680423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762b755-53c9-421c-8b34-7b9252ddb8d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:51.680804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762b755-53c9-421c-8b34-7b9252ddb8d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:51.684773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2762b755-53c9-421c-8b34-7b9252ddb8d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:51.689776 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 960/1931] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:51 2022] DELETE /identity/v3/users/450d8bef19394cf782a3a9c5e396d1b4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:51.691021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb71421-7673-441d-b9ea-5e04a1338132 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:51.692858 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9eb71421-7673-441d-b9ea-5e04a1338132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:51.780346 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762b755-53c9-421c-8b34-7b9252ddb8d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:51.782437 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762b755-53c9-421c-8b34-7b9252ddb8d5 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:51.796254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 972/1932] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:51.797343 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762b755-53c9-421c-8b34-7b9252ddb8d5 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:51.798743 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2762b755-53c9-421c-8b34-7b9252ddb8d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:51.835146 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762b755-53c9-421c-8b34-7b9252ddb8d5 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:51.868220 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb71421-7673-441d-b9ea-5e04a1338132 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:51.882808 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ae993-13e3-4290-943b-0f5e4a274893 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:51.884496 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ae993-13e3-4290-943b-0f5e4a274893 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:51.886012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ae993-13e3-4290-943b-0f5e4a274893 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:51.886301 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ae993-13e3-4290-943b-0f5e4a274893 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:51.890100 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3e7ae993-13e3-4290-943b-0f5e4a274893 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:51.919819 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ae993-13e3-4290-943b-0f5e4a274893 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:51.922257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ae993-13e3-4290-943b-0f5e4a274893 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:51.948378 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 961/1933] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:51.951327 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a6b9e-3ab3-4f6e-89fe-fe69a5adfd57 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:51.951623 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a6b9e-3ab3-4f6e-89fe-fe69a5adfd57 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:51.951909 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a6b9e-3ab3-4f6e-89fe-fe69a5adfd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:51.958290 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3c104-9e60-42ee-ad15-7ff599125b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:51.958991 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3c104-9e60-42ee-ad15-7ff599125b25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:51.959543 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3c104-9e60-42ee-ad15-7ff599125b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:51.959823 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3c104-9e60-42ee-ad15-7ff599125b25 admin admin] PATH_INFO: `/v3/projects/abe79d4ff11543ea86840153bfbb84d5/users/77ba294e1ec0411cafad0f2f83e27074/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:51.981541 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3c104-9e60-42ee-ad15-7ff599125b25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe79d4ff11543ea86840153bfbb84d5, user_id=77ba294e1ec0411cafad0f2f83e27074, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:51.984533 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3c104-9e60-42ee-ad15-7ff599125b25 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:51.995184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4d5a6b9e-3ab3-4f6e-89fe-fe69a5adfd57 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:51.996617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4d5a6b9e-3ab3-4f6e-89fe-fe69a5adfd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:52.006342 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 973/1934] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:51 2022] PUT /identity/v3/projects/abe79d4ff11543ea86840153bfbb84d5/users/77ba294e1ec0411cafad0f2f83e27074/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:52.043730 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d111d8-73d3-4892-bdc4-05e2bd402e3e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:52.044559 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d111d8-73d3-4892-bdc4-05e2bd402e3e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:52.045315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d111d8-73d3-4892-bdc4-05e2bd402e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:52.085437 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f0d111d8-73d3-4892-bdc4-05e2bd402e3e None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:52.088288 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f0d111d8-73d3-4892-bdc4-05e2bd402e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:52.140989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 962/1935] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:52.142287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a6b9e-3ab3-4f6e-89fe-fe69a5adfd57 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:52.154384 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a6b9e-3ab3-4f6e-89fe-fe69a5adfd57 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:52.161691 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705ecde-9070-4b74-8629-f641a32edd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:52.162412 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705ecde-9070-4b74-8629-f641a32edd33 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:52.162761 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705ecde-9070-4b74-8629-f641a32edd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:52.163106 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705ecde-9070-4b74-8629-f641a32edd33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:52.163897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705ecde-9070-4b74-8629-f641a32edd33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:52.165792 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705ecde-9070-4b74-8629-f641a32edd33 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:52.199117 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 963/1936] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:52.199117 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705ecde-9070-4b74-8629-f641a32edd33 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:52.200811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b705ecde-9070-4b74-8629-f641a32edd33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:52.207394 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 974/1937] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:52.208345 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d111d8-73d3-4892-bdc4-05e2bd402e3e None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:52.216680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:52.222657 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d111d8-73d3-4892-bdc4-05e2bd402e3e None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:52.225981 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705ecde-9070-4b74-8629-f641a32edd33 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:52.231545 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf13064-356c-4ea1-b929-74222ed19384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:52.232197 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf13064-356c-4ea1-b929-74222ed19384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:52.232482 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf13064-356c-4ea1-b929-74222ed19384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:52.232809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf13064-356c-4ea1-b929-74222ed19384 admin admin] PATH_INFO: `/v3/projects/cee45a466d4b49a6ac8b960900d83311` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:52.233551 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56999416-5690-4f2c-8303-9698121ee250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:52.234318 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf13064-356c-4ea1-b929-74222ed19384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee45a466d4b49a6ac8b960900d83311)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:52.235199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56999416-5690-4f2c-8303-9698121ee250 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:52.235738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56999416-5690-4f2c-8303-9698121ee250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:52.235909 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf13064-356c-4ea1-b929-74222ed19384 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:52.236398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56999416-5690-4f2c-8303-9698121ee250 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:52.238352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56999416-5690-4f2c-8303-9698121ee250 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:52.239366 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56999416-5690-4f2c-8303-9698121ee250 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:52.241832 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56999416-5690-4f2c-8303-9698121ee250 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:52.258880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 975/1938] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:31:52.261678 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56999416-5690-4f2c-8303-9698121ee250 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:52.275217 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56999416-5690-4f2c-8303-9698121ee250 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:52.281565 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a087c46-931a-4ab4-b66f-d960c0ed77b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:52.281836 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087c46-931a-4ab4-b66f-d960c0ed77b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:52.282270 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087c46-931a-4ab4-b66f-d960c0ed77b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:52.282563 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087c46-931a-4ab4-b66f-d960c0ed77b7 admin admin] PATH_INFO: `/v3/projects/abe79d4ff11543ea86840153bfbb84d5/users/77ba294e1ec0411cafad0f2f83e27074/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:52.286099 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a087c46-931a-4ab4-b66f-d960c0ed77b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe79d4ff11543ea86840153bfbb84d5, user_id=77ba294e1ec0411cafad0f2f83e27074, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:52.289531 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a087c46-931a-4ab4-b66f-d960c0ed77b7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:52.299015 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-daf13064-356c-4ea1-b929-74222ed19384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee45a466d4b49a6ac8b960900d83311', 'request_id': 'req-daf13064-356c-4ea1-b929-74222ed19384'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:52.302529 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 976/1939] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:52 2022] PUT /identity/v3/projects/abe79d4ff11543ea86840153bfbb84d5/users/77ba294e1ec0411cafad0f2f83e27074/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:52.303467 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a087c46-931a-4ab4-b66f-d960c0ed77b7 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:52.305109 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3a087c46-931a-4ab4-b66f-d960c0ed77b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:52.311503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:DELETE=7,keystone:SELECT=93 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:52.315505 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-daf13064-356c-4ea1-b929-74222ed19384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee45a466d4b49a6ac8b960900d83311', 'request_id': 'req-daf13064-356c-4ea1-b929-74222ed19384'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:52.324876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-daf13064-356c-4ea1-b929-74222ed19384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee45a466d4b49a6ac8b960900d83311', 'request_id': 'req-daf13064-356c-4ea1-b929-74222ed19384'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:52.342593 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-daf13064-356c-4ea1-b929-74222ed19384 admin admin] The token cache is being invalidate because project cee45a466d4b49a6ac8b960900d83311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:52.343150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-daf13064-356c-4ea1-b929-74222ed19384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:52.343906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-daf13064-356c-4ea1-b929-74222ed19384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:52.349603 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 964/1940] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:52 2022] DELETE /identity/v3/projects/cee45a466d4b49a6ac8b960900d83311 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:52.349603 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf13064-356c-4ea1-b929-74222ed19384 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:52.349603 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-daf13064-356c-4ea1-b929-74222ed19384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:52.384714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a087c46-931a-4ab4-b66f-d960c0ed77b7 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:52.389835 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087682d-7c6e-4e47-9aad-71d4be6c9c4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:52.390466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087682d-7c6e-4e47-9aad-71d4be6c9c4e service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:52.390796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087682d-7c6e-4e47-9aad-71d4be6c9c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:52.391075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087682d-7c6e-4e47-9aad-71d4be6c9c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:52.393748 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c087682d-7c6e-4e47-9aad-71d4be6c9c4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:52.445579 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf13064-356c-4ea1-b929-74222ed19384 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:52.490067 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087682d-7c6e-4e47-9aad-71d4be6c9c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:52.493567 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087682d-7c6e-4e47-9aad-71d4be6c9c4e service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:52.508535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 977/1941] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:52.510718 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19807cf8-9d76-425d-8638-c3f479e6cbc7 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:52.511010 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19807cf8-9d76-425d-8638-c3f479e6cbc7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:52.511451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19807cf8-9d76-425d-8638-c3f479e6cbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:52.554105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-19807cf8-9d76-425d-8638-c3f479e6cbc7 None None] MFA Rules not processed for user `77ba294e1ec0411cafad0f2f83e27074`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:52.555774 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-19807cf8-9d76-425d-8638-c3f479e6cbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:52.572322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649f3c7-085d-4ada-9bbb-573572b96454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:52.573598 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649f3c7-085d-4ada-9bbb-573572b96454 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:52.574054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649f3c7-085d-4ada-9bbb-573572b96454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:52.574499 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649f3c7-085d-4ada-9bbb-573572b96454 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:52.575303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649f3c7-085d-4ada-9bbb-573572b96454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:52.577473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649f3c7-085d-4ada-9bbb-573572b96454 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:52.623166 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 965/1942] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:52 2022] POST /identity/v3/projects => generated 389 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:52.623166 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649f3c7-085d-4ada-9bbb-573572b96454 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:52.625323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e649f3c7-085d-4ada-9bbb-573572b96454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:52.669352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 978/1943] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:52.670820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19807cf8-9d76-425d-8638-c3f479e6cbc7 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:52.686145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19807cf8-9d76-425d-8638-c3f479e6cbc7 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:52.701595 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:52.719215 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649f3c7-085d-4ada-9bbb-573572b96454 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:52.726066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d4e87-514e-4ec7-9fde-72fb40969fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:52.726774 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d4e87-514e-4ec7-9fde-72fb40969fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:52.727058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d4e87-514e-4ec7-9fde-72fb40969fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:52.727337 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d4e87-514e-4ec7-9fde-72fb40969fd0 admin admin] PATH_INFO: `/v3/users/58c98062838b40328ad98d47dbd9f5a7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:52.728871 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d4e87-514e-4ec7-9fde-72fb40969fd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58c98062838b40328ad98d47dbd9f5a7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:52.731182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d4e87-514e-4ec7-9fde-72fb40969fd0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:52.753491 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:52.796414 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ffad1-b6b5-4ff7-9e2f-eccd770c2722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:52.799265 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ffad1-b6b5-4ff7-9e2f-eccd770c2722 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:52.799615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ffad1-b6b5-4ff7-9e2f-eccd770c2722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:52.800605 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ffad1-b6b5-4ff7-9e2f-eccd770c2722 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:52.801340 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ffad1-b6b5-4ff7-9e2f-eccd770c2722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:52.803463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ffad1-b6b5-4ff7-9e2f-eccd770c2722 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:52.811050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-dd9d4e87-514e-4ec7-9fde-72fb40969fd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58c98062838b40328ad98d47dbd9f5a7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:52.811864 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-dd9d4e87-514e-4ec7-9fde-72fb40969fd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58c98062838b40328ad98d47dbd9f5a7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:52.823585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-dd9d4e87-514e-4ec7-9fde-72fb40969fd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58c98062838b40328ad98d47dbd9f5a7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:52.825521 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-dd9d4e87-514e-4ec7-9fde-72fb40969fd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58c98062838b40328ad98d47dbd9f5a7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:52.840868 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-dd9d4e87-514e-4ec7-9fde-72fb40969fd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58c98062838b40328ad98d47dbd9f5a7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:52.853712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 979/1944] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:52 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:52.854655 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ffad1-b6b5-4ff7-9e2f-eccd770c2722 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:52.874106 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-760ffad1-b6b5-4ff7-9e2f-eccd770c2722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:52.918307 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 966/1945] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:52 2022] DELETE /identity/v3/users/58c98062838b40328ad98d47dbd9f5a7 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:52.919746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d4e87-514e-4ec7-9fde-72fb40969fd0 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:52.928804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-dd9d4e87-514e-4ec7-9fde-72fb40969fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:52.953181 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ffad1-b6b5-4ff7-9e2f-eccd770c2722 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:53.013964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931a198-7651-4214-af49-d59b27cbd995 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:53.014609 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931a198-7651-4214-af49-d59b27cbd995 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:53.014903 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931a198-7651-4214-af49-d59b27cbd995 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:53.015182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931a198-7651-4214-af49-d59b27cbd995 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:53.017076 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7931a198-7651-4214-af49-d59b27cbd995 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:53.079770 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d4e87-514e-4ec7-9fde-72fb40969fd0 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:53.094380 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075e87b-c572-4788-b619-550bbc855ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:53.095133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075e87b-c572-4788-b619-550bbc855ceb admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:53.095499 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075e87b-c572-4788-b619-550bbc855ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:53.095843 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075e87b-c572-4788-b619-550bbc855ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:53.097491 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075e87b-c572-4788-b619-550bbc855ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:53.099344 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075e87b-c572-4788-b619-550bbc855ceb admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:53.103281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931a198-7651-4214-af49-d59b27cbd995 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:53.105204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931a198-7651-4214-af49-d59b27cbd995 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:53.127857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 980/1946] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:52 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:53.130941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 967/1947] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:53.132249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931a198-7651-4214-af49-d59b27cbd995 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:53.159735 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075e87b-c572-4788-b619-550bbc855ceb admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:53.161673 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b075e87b-c572-4788-b619-550bbc855ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:53.163323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931a198-7651-4214-af49-d59b27cbd995 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:53.176145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d50476-4500-4372-a871-686770d914bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:53.176827 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d50476-4500-4372-a871-686770d914bc admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:53.177108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d50476-4500-4372-a871-686770d914bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:53.177599 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d50476-4500-4372-a871-686770d914bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:53.178266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d50476-4500-4372-a871-686770d914bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:53.180112 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d50476-4500-4372-a871-686770d914bc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:53.182584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075e87b-c572-4788-b619-550bbc855ceb admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:53.183594 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:53.199098 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 981/1948] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:31:53.208001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de7732-eaba-48d6-a27a-f85e781a279c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:53.208708 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de7732-eaba-48d6-a27a-f85e781a279c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:53.211557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de7732-eaba-48d6-a27a-f85e781a279c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:53.211855 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de7732-eaba-48d6-a27a-f85e781a279c admin admin] PATH_INFO: `/v3/projects/1f879bf13cd74d2093af0b9819a2984e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:53.213257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de7732-eaba-48d6-a27a-f85e781a279c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f879bf13cd74d2093af0b9819a2984e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:53.215231 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de7732-eaba-48d6-a27a-f85e781a279c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:53.220306 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d50476-4500-4372-a871-686770d914bc admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:53.235199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d50476-4500-4372-a871-686770d914bc admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:53.242796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614e482-59a5-4a8e-b34d-3f4353a281b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:53.244148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614e482-59a5-4a8e-b34d-3f4353a281b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:53.244713 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614e482-59a5-4a8e-b34d-3f4353a281b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:53.245533 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614e482-59a5-4a8e-b34d-3f4353a281b2 admin admin] PATH_INFO: `/v3/projects/d5b225900ee6421781bf6f7e425490c0/users/13924a87d9d64a66a57ce76ae61421c2/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:53.282881 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614e482-59a5-4a8e-b34d-3f4353a281b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b225900ee6421781bf6f7e425490c0, user_id=13924a87d9d64a66a57ce76ae61421c2, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:53.289778 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614e482-59a5-4a8e-b34d-3f4353a281b2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:53.300105 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a5de7732-eaba-48d6-a27a-f85e781a279c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f879bf13cd74d2093af0b9819a2984e', 'request_id': 'req-a5de7732-eaba-48d6-a27a-f85e781a279c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:53.321940 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a5de7732-eaba-48d6-a27a-f85e781a279c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f879bf13cd74d2093af0b9819a2984e', 'request_id': 'req-a5de7732-eaba-48d6-a27a-f85e781a279c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:53.323646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 982/1949] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:53 2022] PUT /identity/v3/projects/d5b225900ee6421781bf6f7e425490c0/users/13924a87d9d64a66a57ce76ae61421c2/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:53.335430 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17f478-8930-4e9e-83d1-59390a42a226 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:53.335622 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17f478-8930-4e9e-83d1-59390a42a226 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:53.335994 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17f478-8930-4e9e-83d1-59390a42a226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:53.352500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a5de7732-eaba-48d6-a27a-f85e781a279c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f879bf13cd74d2093af0b9819a2984e', 'request_id': 'req-a5de7732-eaba-48d6-a27a-f85e781a279c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:53.380275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a5de7732-eaba-48d6-a27a-f85e781a279c admin admin] The token cache is being invalidate because project 1f879bf13cd74d2093af0b9819a2984e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:53.382243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a5de7732-eaba-48d6-a27a-f85e781a279c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:53.383979 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ed17f478-8930-4e9e-83d1-59390a42a226 None None] MFA Rules not processed for user `13924a87d9d64a66a57ce76ae61421c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:53.385106 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a5de7732-eaba-48d6-a27a-f85e781a279c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:53.386444 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ed17f478-8930-4e9e-83d1-59390a42a226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:53.391085 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 968/1950] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:53 2022] DELETE /identity/v3/projects/1f879bf13cd74d2093af0b9819a2984e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:53.395998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de7732-eaba-48d6-a27a-f85e781a279c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:53.397649 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a5de7732-eaba-48d6-a27a-f85e781a279c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:53.437634 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:53.550543 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 983/1951] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:53.552034 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17f478-8930-4e9e-83d1-59390a42a226 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:53.554193 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ed17f478-8930-4e9e-83d1-59390a42a226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:53.593963 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de7732-eaba-48d6-a27a-f85e781a279c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:53.676089 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17f478-8930-4e9e-83d1-59390a42a226 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:53.692267 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c380a-7425-4180-8500-bdd0f774f9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:53.692967 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c380a-7425-4180-8500-bdd0f774f9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:53.693252 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c380a-7425-4180-8500-bdd0f774f9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:53.693529 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c380a-7425-4180-8500-bdd0f774f9bb admin admin] PATH_INFO: `/v3/projects/645a1f70998243c98766ceaaf8a342e1` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:53.706303 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c380a-7425-4180-8500-bdd0f774f9bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=645a1f70998243c98766ceaaf8a342e1)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:53.708794 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c380a-7425-4180-8500-bdd0f774f9bb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:53.730156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f47c13-b3af-42c3-9028-d8e472ea71ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:53.730914 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f47c13-b3af-42c3-9028-d8e472ea71ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:53.731270 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f47c13-b3af-42c3-9028-d8e472ea71ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:53.731678 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f47c13-b3af-42c3-9028-d8e472ea71ef admin admin] PATH_INFO: `/v3/users/fd1d354c37d14106a38891aa739a2cb5` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:53.735154 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f47c13-b3af-42c3-9028-d8e472ea71ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd1d354c37d14106a38891aa739a2cb5)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:53.740322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f47c13-b3af-42c3-9028-d8e472ea71ef admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:53.786336 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-330c380a-7425-4180-8500-bdd0f774f9bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '645a1f70998243c98766ceaaf8a342e1', 'request_id': 'req-330c380a-7425-4180-8500-bdd0f774f9bb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:53.798541 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-330c380a-7425-4180-8500-bdd0f774f9bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '645a1f70998243c98766ceaaf8a342e1', 'request_id': 'req-330c380a-7425-4180-8500-bdd0f774f9bb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:53.809122 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-330c380a-7425-4180-8500-bdd0f774f9bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '645a1f70998243c98766ceaaf8a342e1', 'request_id': 'req-330c380a-7425-4180-8500-bdd0f774f9bb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:53.814175 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:53.849064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-330c380a-7425-4180-8500-bdd0f774f9bb admin admin] The token cache is being invalidate because project 645a1f70998243c98766ceaaf8a342e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:53.849677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-330c380a-7425-4180-8500-bdd0f774f9bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:53.851075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-330c380a-7425-4180-8500-bdd0f774f9bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:53.852128 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-13f47c13-b3af-42c3-9028-d8e472ea71ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd1d354c37d14106a38891aa739a2cb5'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:53.853102 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 984/1952] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:53 2022] DELETE /identity/v3/projects/645a1f70998243c98766ceaaf8a342e1 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:53.853828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c380a-7425-4180-8500-bdd0f774f9bb admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:53.854249 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-13f47c13-b3af-42c3-9028-d8e472ea71ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd1d354c37d14106a38891aa739a2cb5'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:53.858216 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-330c380a-7425-4180-8500-bdd0f774f9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:53.867302 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-13f47c13-b3af-42c3-9028-d8e472ea71ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd1d354c37d14106a38891aa739a2cb5'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:53.868668 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-13f47c13-b3af-42c3-9028-d8e472ea71ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd1d354c37d14106a38891aa739a2cb5'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:53.879882 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-13f47c13-b3af-42c3-9028-d8e472ea71ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd1d354c37d14106a38891aa739a2cb5'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:53.922283 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 969/1953] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:53 2022] DELETE /identity/v3/users/fd1d354c37d14106a38891aa739a2cb5 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:53.925812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb720d9-0856-42ff-8bda-488533d3fdf9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:53.927689 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb720d9-0856-42ff-8bda-488533d3fdf9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:53.928050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb720d9-0856-42ff-8bda-488533d3fdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:53.968241 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-cbb720d9-0856-42ff-8bda-488533d3fdf9 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:53.969526 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cbb720d9-0856-42ff-8bda-488533d3fdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:53.976192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c380a-7425-4180-8500-bdd0f774f9bb admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:54.053425 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd456e-e03e-4490-b5c2-6d7e79ee381c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:54.054301 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd456e-e03e-4490-b5c2-6d7e79ee381c service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:54.054745 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd456e-e03e-4490-b5c2-6d7e79ee381c service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:54.055139 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd456e-e03e-4490-b5c2-6d7e79ee381c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:54.055923 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:54.060064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-09bd456e-e03e-4490-b5c2-6d7e79ee381c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:54.142150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 970/1954] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:54.146059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8567a-5da0-48eb-8c59-744e9f703f93 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:54.147660 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8567a-5da0-48eb-8c59-744e9f703f93 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:54.148190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8567a-5da0-48eb-8c59-744e9f703f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:54.182006 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd456e-e03e-4490-b5c2-6d7e79ee381c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:54.183953 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd456e-e03e-4490-b5c2-6d7e79ee381c service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:54.203524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-2df8567a-5da0-48eb-8c59-744e9f703f93 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:54.205421 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2df8567a-5da0-48eb-8c59-744e9f703f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:54.221739 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 985/1955] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:54.240440 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 971/1956] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:54.245003 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd456e-e03e-4490-b5c2-6d7e79ee381c service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:54.271840 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd456e-e03e-4490-b5c2-6d7e79ee381c service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:54.285514 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cdfa1-b4d6-44c5-8662-9d000630eea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:54.288423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cdfa1-b4d6-44c5-8662-9d000630eea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:54.289705 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cdfa1-b4d6-44c5-8662-9d000630eea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:54.289996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cdfa1-b4d6-44c5-8662-9d000630eea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:54.290714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cdfa1-b4d6-44c5-8662-9d000630eea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:54.293264 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cdfa1-b4d6-44c5-8662-9d000630eea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:54.298328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cdfa1-b4d6-44c5-8662-9d000630eea6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:54.356432 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 986/1957] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:31:54.357998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8567a-5da0-48eb-8c59-744e9f703f93 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:54.389322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8567a-5da0-48eb-8c59-744e9f703f93 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:54.416161 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf40b9-6fba-4078-bfce-649a63018264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:54.420366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf40b9-6fba-4078-bfce-649a63018264 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:54.420643 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf40b9-6fba-4078-bfce-649a63018264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:54.420967 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf40b9-6fba-4078-bfce-649a63018264 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:54.421657 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf40b9-6fba-4078-bfce-649a63018264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:54.431415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf40b9-6fba-4078-bfce-649a63018264 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:54.464629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cdfa1-b4d6-44c5-8662-9d000630eea6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:54.466724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-102cdfa1-b4d6-44c5-8662-9d000630eea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:54.492615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cdfa1-b4d6-44c5-8662-9d000630eea6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:54.506656 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03d49f-bd7d-45dc-99e1-3af4a09c33b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:54.507724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03d49f-bd7d-45dc-99e1-3af4a09c33b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:54.508299 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03d49f-bd7d-45dc-99e1-3af4a09c33b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:54.509010 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03d49f-bd7d-45dc-99e1-3af4a09c33b9 admin admin] PATH_INFO: `/v3/projects/3a127d3ac39f4fe7a44cb967f0a468d8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:54.513940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03d49f-bd7d-45dc-99e1-3af4a09c33b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a127d3ac39f4fe7a44cb967f0a468d8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:54.517788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03d49f-bd7d-45dc-99e1-3af4a09c33b9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:54.536158 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 972/1958] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:54 2022] POST /identity/v3/projects => generated 399 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:54.542095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf40b9-6fba-4078-bfce-649a63018264 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:54.641957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:54.648064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ac03d49f-bd7d-45dc-99e1-3af4a09c33b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a127d3ac39f4fe7a44cb967f0a468d8', 'request_id': 'req-ac03d49f-bd7d-45dc-99e1-3af4a09c33b9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:54.666376 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ac03d49f-bd7d-45dc-99e1-3af4a09c33b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a127d3ac39f4fe7a44cb967f0a468d8', 'request_id': 'req-ac03d49f-bd7d-45dc-99e1-3af4a09c33b9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:54.667941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf40b9-6fba-4078-bfce-649a63018264 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:54.675727 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ac03d49f-bd7d-45dc-99e1-3af4a09c33b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a127d3ac39f4fe7a44cb967f0a468d8', 'request_id': 'req-ac03d49f-bd7d-45dc-99e1-3af4a09c33b9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:54.700750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ac03d49f-bd7d-45dc-99e1-3af4a09c33b9 admin admin] The token cache is being invalidate because project 3a127d3ac39f4fe7a44cb967f0a468d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:54.701269 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ac03d49f-bd7d-45dc-99e1-3af4a09c33b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:54.702233 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ac03d49f-bd7d-45dc-99e1-3af4a09c33b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:54.708769 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 987/1959] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:54 2022] DELETE /identity/v3/projects/3a127d3ac39f4fe7a44cb967f0a468d8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:54.710932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03d49f-bd7d-45dc-99e1-3af4a09c33b9 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:54.713533 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ac03d49f-bd7d-45dc-99e1-3af4a09c33b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:54.788229 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7405702-2273-47aa-a6e0-402b2f3d35ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:54.789582 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7405702-2273-47aa-a6e0-402b2f3d35ba admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:54.789990 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7405702-2273-47aa-a6e0-402b2f3d35ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:54.790278 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7405702-2273-47aa-a6e0-402b2f3d35ba admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:54.790931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7405702-2273-47aa-a6e0-402b2f3d35ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:54.794338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7405702-2273-47aa-a6e0-402b2f3d35ba admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:54.805359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03d49f-bd7d-45dc-99e1-3af4a09c33b9 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:54.809670 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75743a41-1831-41f1-b75b-fac90c6a6556 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:54.811210 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75743a41-1831-41f1-b75b-fac90c6a6556 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:54.811634 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75743a41-1831-41f1-b75b-fac90c6a6556 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:54.811924 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75743a41-1831-41f1-b75b-fac90c6a6556 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:54.815750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-75743a41-1831-41f1-b75b-fac90c6a6556 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:54.849507 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 973/1960] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:54 2022] POST /identity/v3/users => generated 300 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:54.866788 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0f44b-019a-45ec-b384-eb8775ba6718 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:54.867078 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0f44b-019a-45ec-b384-eb8775ba6718 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:54.867367 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0f44b-019a-45ec-b384-eb8775ba6718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:54.904616 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-20f0f44b-019a-45ec-b384-eb8775ba6718 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:54.906096 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-20f0f44b-019a-45ec-b384-eb8775ba6718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:54.917992 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 974/1961] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:54.919239 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0f44b-019a-45ec-b384-eb8775ba6718 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:54.921440 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-20f0f44b-019a-45ec-b384-eb8775ba6718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:54.938439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0f44b-019a-45ec-b384-eb8775ba6718 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:54.944552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75743a41-1831-41f1-b75b-fac90c6a6556 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:54.945459 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c8f68-90d5-491f-97f6-55c1b9b7917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:54.946215 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c8f68-90d5-491f-97f6-55c1b9b7917a admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:54.946352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75743a41-1831-41f1-b75b-fac90c6a6556 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:54.946706 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c8f68-90d5-491f-97f6-55c1b9b7917a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:54.947083 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c8f68-90d5-491f-97f6-55c1b9b7917a admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:54.947950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c8f68-90d5-491f-97f6-55c1b9b7917a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:54.949959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c8f68-90d5-491f-97f6-55c1b9b7917a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:54.962711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 988/1962] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:54.964300 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b509fe9-fd3c-4f01-b32a-edb33161399e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:54.964767 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b509fe9-fd3c-4f01-b32a-edb33161399e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:54.965152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b509fe9-fd3c-4f01-b32a-edb33161399e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:54.968736 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 975/1963] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:54.970167 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c8f68-90d5-491f-97f6-55c1b9b7917a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:54.986843 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c8f68-90d5-491f-97f6-55c1b9b7917a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:54.995117 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c2c62-3e09-4fb6-a692-ab0abc0c8847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:54.996085 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c2c62-3e09-4fb6-a692-ab0abc0c8847 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:54.996457 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c2c62-3e09-4fb6-a692-ab0abc0c8847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:54.996889 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c2c62-3e09-4fb6-a692-ab0abc0c8847 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:54.997800 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c2c62-3e09-4fb6-a692-ab0abc0c8847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:55.000583 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c2c62-3e09-4fb6-a692-ab0abc0c8847 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:55.012980 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3b509fe9-fd3c-4f01-b32a-edb33161399e None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:55.015283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3b509fe9-fd3c-4f01-b32a-edb33161399e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:55.036258 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 976/1964] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:55.038413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c2c62-3e09-4fb6-a692-ab0abc0c8847 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:55.038828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 989/1965] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:55.045924 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b509fe9-fd3c-4f01-b32a-edb33161399e None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:55.059210 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b509fe9-fd3c-4f01-b32a-edb33161399e None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:55.071366 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26009572-06ad-403a-b3a9-820289f066d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:55.072361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26009572-06ad-403a-b3a9-820289f066d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:55.072870 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26009572-06ad-403a-b3a9-820289f066d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:55.073365 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26009572-06ad-403a-b3a9-820289f066d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:55.074339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26009572-06ad-403a-b3a9-820289f066d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:55.074877 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26009572-06ad-403a-b3a9-820289f066d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:55.075494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c2c62-3e09-4fb6-a692-ab0abc0c8847 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:55.078755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26009572-06ad-403a-b3a9-820289f066d1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:55.092332 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30248178-efb3-4945-994d-eba79b15bcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:55.093075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30248178-efb3-4945-994d-eba79b15bcba admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:55.096856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30248178-efb3-4945-994d-eba79b15bcba admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:55.097196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30248178-efb3-4945-994d-eba79b15bcba admin admin] PATH_INFO: `/v3/projects/d8c223d117964ea9bbcddcdcc992bab8/users/a3d60b4e1c794a8a9f06a2447bfc128c/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:55.103488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 990/1966] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:31:55.108927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26009572-06ad-403a-b3a9-820289f066d1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:55.131597 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26009572-06ad-403a-b3a9-820289f066d1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:55.142932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30248178-efb3-4945-994d-eba79b15bcba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c223d117964ea9bbcddcdcc992bab8, user_id=a3d60b4e1c794a8a9f06a2447bfc128c, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:55.149572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30248178-efb3-4945-994d-eba79b15bcba admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:55.155885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:55.159999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5667b9d-47e1-47a0-aa43-eeb7ce96794f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:55.161111 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5667b9d-47e1-47a0-aa43-eeb7ce96794f admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:55.161111 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5667b9d-47e1-47a0-aa43-eeb7ce96794f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:55.161377 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5667b9d-47e1-47a0-aa43-eeb7ce96794f admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:55.162192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5667b9d-47e1-47a0-aa43-eeb7ce96794f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:55.164762 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5667b9d-47e1-47a0-aa43-eeb7ce96794f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:55.213390 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 977/1967] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:55 2022] PUT /identity/v3/projects/d8c223d117964ea9bbcddcdcc992bab8/users/a3d60b4e1c794a8a9f06a2447bfc128c/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:55.214942 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecaae59-e5c6-4b5e-a7e3-b751395d10df None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:55.215779 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecaae59-e5c6-4b5e-a7e3-b751395d10df None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:55.215779 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecaae59-e5c6-4b5e-a7e3-b751395d10df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:55.238174 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 991/1968] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:55 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:55.241465 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5667b9d-47e1-47a0-aa43-eeb7ce96794f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:55.277456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-7ecaae59-e5c6-4b5e-a7e3-b751395d10df None None] MFA Rules not processed for user `a3d60b4e1c794a8a9f06a2447bfc128c`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:55.279018 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7ecaae59-e5c6-4b5e-a7e3-b751395d10df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:55.334862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:55.355232 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5667b9d-47e1-47a0-aa43-eeb7ce96794f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:55.362591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81edc6-3a8e-4f85-b0bf-f669f89ef513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:55.363273 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81edc6-3a8e-4f85-b0bf-f669f89ef513 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:55.363569 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81edc6-3a8e-4f85-b0bf-f669f89ef513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:55.363943 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81edc6-3a8e-4f85-b0bf-f669f89ef513 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:55.364496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81edc6-3a8e-4f85-b0bf-f669f89ef513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:55.366533 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81edc6-3a8e-4f85-b0bf-f669f89ef513 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:55.396426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 978/1969] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:55 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:55.402122 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecaae59-e5c6-4b5e-a7e3-b751395d10df None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:55.405110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 992/1970] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:55 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:55.406003 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81edc6-3a8e-4f85-b0bf-f669f89ef513 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:55.419469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81edc6-3a8e-4f85-b0bf-f669f89ef513 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:55.421839 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecaae59-e5c6-4b5e-a7e3-b751395d10df None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:55.430219 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da1728-da67-4b6d-9d98-37e291c78e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:55.431115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da1728-da67-4b6d-9d98-37e291c78e6a admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:55.431754 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da1728-da67-4b6d-9d98-37e291c78e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:55.432566 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da1728-da67-4b6d-9d98-37e291c78e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:55.433390 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da1728-da67-4b6d-9d98-37e291c78e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:55.434759 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086a40d-0e32-4f35-b0ee-17db35164794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:55.435562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086a40d-0e32-4f35-b0ee-17db35164794 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:55.435743 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da1728-da67-4b6d-9d98-37e291c78e6a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:55.436116 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086a40d-0e32-4f35-b0ee-17db35164794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:55.436613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086a40d-0e32-4f35-b0ee-17db35164794 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:55.437925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086a40d-0e32-4f35-b0ee-17db35164794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:55.440816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086a40d-0e32-4f35-b0ee-17db35164794 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:55.451361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 993/1971] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:31:55.458928 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da1728-da67-4b6d-9d98-37e291c78e6a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:55.474167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da1728-da67-4b6d-9d98-37e291c78e6a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:55.480409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86ceaf-3090-4a27-ab61-53a21bd171b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:55.481435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86ceaf-3090-4a27-ab61-53a21bd171b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:55.481792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86ceaf-3090-4a27-ab61-53a21bd171b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:55.482389 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86ceaf-3090-4a27-ab61-53a21bd171b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:55.483417 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86ceaf-3090-4a27-ab61-53a21bd171b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:55.485385 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86ceaf-3090-4a27-ab61-53a21bd171b1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:55.492760 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 979/1972] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:55 2022] POST /identity/v3/projects => generated 397 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:31:55.496197 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086a40d-0e32-4f35-b0ee-17db35164794 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:55.501477 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 994/1973] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:55.505829 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86ceaf-3090-4a27-ab61-53a21bd171b1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:55.517638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86ceaf-3090-4a27-ab61-53a21bd171b1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:55.586788 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086a40d-0e32-4f35-b0ee-17db35164794 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:55.593243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf370b2-9bc8-41ad-bb8a-654573e6c3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:55.594331 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf370b2-9bc8-41ad-bb8a-654573e6c3ce admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:55.594628 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf370b2-9bc8-41ad-bb8a-654573e6c3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:55.594893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed155da5-608f-4f88-8934-d6dc405f7ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:55.595047 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf370b2-9bc8-41ad-bb8a-654573e6c3ce admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:55.595744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed155da5-608f-4f88-8934-d6dc405f7ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:55.595862 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf370b2-9bc8-41ad-bb8a-654573e6c3ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:55.596655 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed155da5-608f-4f88-8934-d6dc405f7ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:55.596975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed155da5-608f-4f88-8934-d6dc405f7ae9 admin admin] PATH_INFO: `/v3/projects/888092ab8b9c432dba87de498f97ea7d/users/fe50714f5a1b4fce97a9a7346af74381/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:55.598976 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf370b2-9bc8-41ad-bb8a-654573e6c3ce admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:55.617487 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed155da5-608f-4f88-8934-d6dc405f7ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=888092ab8b9c432dba87de498f97ea7d, user_id=fe50714f5a1b4fce97a9a7346af74381, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:55.620238 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed155da5-608f-4f88-8934-d6dc405f7ae9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:55.623313 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 980/1974] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:55 2022] POST /identity/v3/users => generated 305 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:55.627150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf370b2-9bc8-41ad-bb8a-654573e6c3ce admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:55.636196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 995/1975] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:55 2022] PUT /identity/v3/projects/888092ab8b9c432dba87de498f97ea7d/users/fe50714f5a1b4fce97a9a7346af74381/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:31:55.637286 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf370b2-9bc8-41ad-bb8a-654573e6c3ce admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:55.648036 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bf456-4f0a-4b88-b053-0a3d0fdd4244 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:55.648329 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bf456-4f0a-4b88-b053-0a3d0fdd4244 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:55.648626 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bf456-4f0a-4b88-b053-0a3d0fdd4244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:55.679916 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d72bf456-4f0a-4b88-b053-0a3d0fdd4244 None None] MFA Rules not processed for user `fe50714f5a1b4fce97a9a7346af74381`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:55.681075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d72bf456-4f0a-4b88-b053-0a3d0fdd4244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:55.695460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:55.707089 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c32190-994f-4715-b2d7-901f9966b77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:55.707719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c32190-994f-4715-b2d7-901f9966b77d admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:55.708001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c32190-994f-4715-b2d7-901f9966b77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:55.708275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c32190-994f-4715-b2d7-901f9966b77d admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:55.708997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c32190-994f-4715-b2d7-901f9966b77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:55.710913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c32190-994f-4715-b2d7-901f9966b77d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:55.722293 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 981/1976] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:31:55.726472 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c32190-994f-4715-b2d7-901f9966b77d admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:55.746501 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c32190-994f-4715-b2d7-901f9966b77d admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:55.751501 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2819e6c-e70e-4514-ac8b-affe8d86a0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:55.752171 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2819e6c-e70e-4514-ac8b-affe8d86a0be admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:55.752554 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2819e6c-e70e-4514-ac8b-affe8d86a0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:55.752836 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2819e6c-e70e-4514-ac8b-affe8d86a0be admin admin] PATH_INFO: `/v3/projects/927be1ba1b7843d09ec74bdb9557d6d4/users/a82f48e06ff54689b7317b22eaca22c9/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:55.754364 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 996/1977] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:31:55.758615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bf456-4f0a-4b88-b053-0a3d0fdd4244 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:55.771086 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bf456-4f0a-4b88-b053-0a3d0fdd4244 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:55.774020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2819e6c-e70e-4514-ac8b-affe8d86a0be admin admin] RBAC: Authorizing `identity:create_grant(project_id=927be1ba1b7843d09ec74bdb9557d6d4, user_id=a82f48e06ff54689b7317b22eaca22c9, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:55.775968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3a556-3834-4d25-b552-2e1d039d9bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:55.776594 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3a556-3834-4d25-b552-2e1d039d9bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:55.776791 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2819e6c-e70e-4514-ac8b-affe8d86a0be admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:55.777181 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3a556-3834-4d25-b552-2e1d039d9bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:55.777467 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3a556-3834-4d25-b552-2e1d039d9bc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:55.778110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3a556-3834-4d25-b552-2e1d039d9bc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:55.780229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3a556-3834-4d25-b552-2e1d039d9bc3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:55.796305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 982/1978] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:55 2022] PUT /identity/v3/projects/927be1ba1b7843d09ec74bdb9557d6d4/users/a82f48e06ff54689b7317b22eaca22c9/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:31:55.797912 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2819e6c-e70e-4514-ac8b-affe8d86a0be admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:55.820725 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 997/1979] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:55 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:31:55.823195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3a556-3834-4d25-b552-2e1d039d9bc3 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:55.831300 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:55.894514 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2819e6c-e70e-4514-ac8b-affe8d86a0be admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:55.917985 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3a556-3834-4d25-b552-2e1d039d9bc3 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:55.922819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b43f0a-d6f4-4956-b3c0-1453977f1974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:55.923442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b43f0a-d6f4-4956-b3c0-1453977f1974 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:55.923722 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b43f0a-d6f4-4956-b3c0-1453977f1974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:55.923997 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b43f0a-d6f4-4956-b3c0-1453977f1974 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:55.925399 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b43f0a-d6f4-4956-b3c0-1453977f1974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:55.927340 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b43f0a-d6f4-4956-b3c0-1453977f1974 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:55.960771 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 998/1980] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:55 2022] POST /identity/v3/users => generated 298 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:55.961930 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b43f0a-d6f4-4956-b3c0-1453977f1974 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:55.974905 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b43f0a-d6f4-4956-b3c0-1453977f1974 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:55.985748 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6e996-0168-4a2b-9965-4bb77ab11f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:55.986496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6e996-0168-4a2b-9965-4bb77ab11f7d admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:55.988032 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6e996-0168-4a2b-9965-4bb77ab11f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:55.988032 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6e996-0168-4a2b-9965-4bb77ab11f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:55.988859 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6e996-0168-4a2b-9965-4bb77ab11f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:55.989024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923312b-4e72-4401-8dd9-cfa9d51d5a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:55.989670 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923312b-4e72-4401-8dd9-cfa9d51d5a41 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:55.989956 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923312b-4e72-4401-8dd9-cfa9d51d5a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:55.990262 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923312b-4e72-4401-8dd9-cfa9d51d5a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:55.990487 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6e996-0168-4a2b-9965-4bb77ab11f7d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:55.990925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923312b-4e72-4401-8dd9-cfa9d51d5a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:55.993256 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923312b-4e72-4401-8dd9-cfa9d51d5a41 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:56.004727 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 999/1981] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:56.006292 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6e996-0168-4a2b-9965-4bb77ab11f7d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:56.013160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 983/1982] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:31:56.014088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923312b-4e72-4401-8dd9-cfa9d51d5a41 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:56.017831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6e996-0168-4a2b-9965-4bb77ab11f7d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:56.024399 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f4f81-ad4e-4143-9c00-c3227365a759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:56.025025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923312b-4e72-4401-8dd9-cfa9d51d5a41 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:56.025301 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f4f81-ad4e-4143-9c00-c3227365a759 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:56.025754 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f4f81-ad4e-4143-9c00-c3227365a759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:56.026063 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f4f81-ad4e-4143-9c00-c3227365a759 admin admin] PATH_INFO: `/v3/projects/a755acc749c84acd8acc21415454590e/users/a323c39b1318471c9e45da9236af3507/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:56.034388 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b55ad-12cb-4465-9599-076ebd107529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:56.035118 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b55ad-12cb-4465-9599-076ebd107529 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:56.035413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b55ad-12cb-4465-9599-076ebd107529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:56.035699 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b55ad-12cb-4465-9599-076ebd107529 admin admin] PATH_INFO: `/v3/projects/927be1ba1b7843d09ec74bdb9557d6d4/users/a82f48e06ff54689b7317b22eaca22c9/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:56.038771 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b55ad-12cb-4465-9599-076ebd107529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=927be1ba1b7843d09ec74bdb9557d6d4, user_id=a82f48e06ff54689b7317b22eaca22c9, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:56.041853 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b55ad-12cb-4465-9599-076ebd107529 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:56.045342 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f4f81-ad4e-4143-9c00-c3227365a759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a755acc749c84acd8acc21415454590e, user_id=a323c39b1318471c9e45da9236af3507, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:56.048082 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f4f81-ad4e-4143-9c00-c3227365a759 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:56.054593 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 984/1983] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:56 2022] PUT /identity/v3/projects/927be1ba1b7843d09ec74bdb9557d6d4/users/a82f48e06ff54689b7317b22eaca22c9/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:31:56.067317 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2156b81-e139-42e9-9c40-e23f03a5af82 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:56.067604 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2156b81-e139-42e9-9c40-e23f03a5af82 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:56.067882 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2156b81-e139-42e9-9c40-e23f03a5af82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:56.070813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1000/1984] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:56 2022] PUT /identity/v3/projects/a755acc749c84acd8acc21415454590e/users/a323c39b1318471c9e45da9236af3507/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:31:56.075353 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f4f81-ad4e-4143-9c00-c3227365a759 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:56.102255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d2156b81-e139-42e9-9c40-e23f03a5af82 None None] MFA Rules not processed for user `a82f48e06ff54689b7317b22eaca22c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:56.103684 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d2156b81-e139-42e9-9c40-e23f03a5af82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:56.169172 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:56.179371 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f4f81-ad4e-4143-9c00-c3227365a759 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:56.186176 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619e9c2-daf1-4c18-9f3f-7be4bc6ae73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:56.187024 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619e9c2-daf1-4c18-9f3f-7be4bc6ae73e admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:56.187309 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619e9c2-daf1-4c18-9f3f-7be4bc6ae73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:56.187736 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619e9c2-daf1-4c18-9f3f-7be4bc6ae73e admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:56.188404 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619e9c2-daf1-4c18-9f3f-7be4bc6ae73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:56.191307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619e9c2-daf1-4c18-9f3f-7be4bc6ae73e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:56.204931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 985/1985] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:56 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:56.212751 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1001/1986] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:56.215943 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2156b81-e139-42e9-9c40-e23f03a5af82 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:56.222933 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619e9c2-daf1-4c18-9f3f-7be4bc6ae73e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:56.226235 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8619e9c2-daf1-4c18-9f3f-7be4bc6ae73e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:56.228606 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2156b81-e139-42e9-9c40-e23f03a5af82 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:56.235713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bf134-a4cd-40b7-b44e-d5f8ca2d89c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:56.236493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bf134-a4cd-40b7-b44e-d5f8ca2d89c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:56.236938 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bf134-a4cd-40b7-b44e-d5f8ca2d89c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:56.237289 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bf134-a4cd-40b7-b44e-d5f8ca2d89c1 admin admin] PATH_INFO: `/v3/projects/a755acc749c84acd8acc21415454590e/users/a323c39b1318471c9e45da9236af3507/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:56.240159 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90bf134-a4cd-40b7-b44e-d5f8ca2d89c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a755acc749c84acd8acc21415454590e, user_id=a323c39b1318471c9e45da9236af3507, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:56.243472 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90bf134-a4cd-40b7-b44e-d5f8ca2d89c1 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:56.260779 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 986/1987] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:56 2022] PUT /identity/v3/projects/a755acc749c84acd8acc21415454590e/users/a323c39b1318471c9e45da9236af3507/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:56.267171 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521bd6d-4450-4766-90ed-b499ad45e106 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:56.267460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521bd6d-4450-4766-90ed-b499ad45e106 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:56.267725 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521bd6d-4450-4766-90ed-b499ad45e106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:56.317660 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619e9c2-daf1-4c18-9f3f-7be4bc6ae73e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:56.329683 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-0521bd6d-4450-4766-90ed-b499ad45e106 None None] MFA Rules not processed for user `a323c39b1318471c9e45da9236af3507`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:56.331369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:56.332769 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0521bd6d-4450-4766-90ed-b499ad45e106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:56.390453 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a04ab-e765-4af3-b380-3fee18dec38a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:56.391090 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a04ab-e765-4af3-b380-3fee18dec38a service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:56.391370 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a04ab-e765-4af3-b380-3fee18dec38a service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:56.391643 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a04ab-e765-4af3-b380-3fee18dec38a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:56.426243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 987/1988] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:31:56.427157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521bd6d-4450-4766-90ed-b499ad45e106 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:56.429070 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0521bd6d-4450-4766-90ed-b499ad45e106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:56.519784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a04ab-e765-4af3-b380-3fee18dec38a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:56.522320 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521bd6d-4450-4766-90ed-b499ad45e106 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:56.524669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a04ab-e765-4af3-b380-3fee18dec38a service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:56.528588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e4fb2-a38c-41e7-b8cf-ef850fa3f92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:56.529311 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e4fb2-a38c-41e7-b8cf-ef850fa3f92d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:56.529597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e4fb2-a38c-41e7-b8cf-ef850fa3f92d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:56.529878 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e4fb2-a38c-41e7-b8cf-ef850fa3f92d admin admin] PATH_INFO: `/v3/users/566e35f5860a4968975bd622470fea4b` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:56.531203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e4fb2-a38c-41e7-b8cf-ef850fa3f92d admin admin] RBAC: Authorizing `identity:delete_user(user_id=566e35f5860a4968975bd622470fea4b)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:56.533236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e4fb2-a38c-41e7-b8cf-ef850fa3f92d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:56.554887 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1002/1989] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:56 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:56.611610 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-216e4fb2-a38c-41e7-b8cf-ef850fa3f92d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '566e35f5860a4968975bd622470fea4b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:56.616068 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-216e4fb2-a38c-41e7-b8cf-ef850fa3f92d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '566e35f5860a4968975bd622470fea4b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:56.634033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:56.635201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a04ab-e765-4af3-b380-3fee18dec38a service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:56.636454 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-216e4fb2-a38c-41e7-b8cf-ef850fa3f92d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '566e35f5860a4968975bd622470fea4b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:56.637301 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-216e4fb2-a38c-41e7-b8cf-ef850fa3f92d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '566e35f5860a4968975bd622470fea4b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:56.647876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-216e4fb2-a38c-41e7-b8cf-ef850fa3f92d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '566e35f5860a4968975bd622470fea4b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:56.656857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a04ab-e765-4af3-b380-3fee18dec38a service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:56.662094 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380136ff-46f2-4002-8fa9-81fbc20268ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:56.662724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380136ff-46f2-4002-8fa9-81fbc20268ac service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:56.663760 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380136ff-46f2-4002-8fa9-81fbc20268ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:56.664241 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380136ff-46f2-4002-8fa9-81fbc20268ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:56.666841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-380136ff-46f2-4002-8fa9-81fbc20268ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:56.680926 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380136ff-46f2-4002-8fa9-81fbc20268ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:56.682553 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380136ff-46f2-4002-8fa9-81fbc20268ac service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:56.692456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 988/1990] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:56 2022] DELETE /identity/v3/users/566e35f5860a4968975bd622470fea4b => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:56.694777 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1003/1991] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:56.707526 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdf099-19b8-4e60-b999-34667142415a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:56.707815 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdf099-19b8-4e60-b999-34667142415a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:56.708098 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdf099-19b8-4e60-b999-34667142415a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:56.732177 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f5cdf099-19b8-4e60-b999-34667142415a None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:56.733461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f5cdf099-19b8-4e60-b999-34667142415a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:56.870242 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 989/1992] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:56.877183 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380136ff-46f2-4002-8fa9-81fbc20268ac service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:56.880152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-380136ff-46f2-4002-8fa9-81fbc20268ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:56.921437 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdf099-19b8-4e60-b999-34667142415a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:56.923221 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f5cdf099-19b8-4e60-b999-34667142415a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:56.981332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380136ff-46f2-4002-8fa9-81fbc20268ac service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:57.032308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdf099-19b8-4e60-b999-34667142415a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:57.037019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fd036-7b39-481e-afb5-a7c8d2d46960 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:57.038142 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fd036-7b39-481e-afb5-a7c8d2d46960 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:57.038644 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fd036-7b39-481e-afb5-a7c8d2d46960 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:57.039106 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fd036-7b39-481e-afb5-a7c8d2d46960 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:57.041216 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-987fd036-7b39-481e-afb5-a7c8d2d46960 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:57.053585 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070373f-4ef1-4801-bf41-993bd5badb69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:57.054223 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070373f-4ef1-4801-bf41-993bd5badb69 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:57.054511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070373f-4ef1-4801-bf41-993bd5badb69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:57.054787 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070373f-4ef1-4801-bf41-993bd5badb69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:57.068195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070373f-4ef1-4801-bf41-993bd5badb69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:57.069917 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070373f-4ef1-4801-bf41-993bd5badb69 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:57.089070 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1004/1993] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:57.090201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070373f-4ef1-4801-bf41-993bd5badb69 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:57.098246 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4070373f-4ef1-4801-bf41-993bd5badb69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:57.128213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070373f-4ef1-4801-bf41-993bd5badb69 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:57.150738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1c1db-7c57-45cd-b544-7cc1d38de443 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:57.150738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1c1db-7c57-45cd-b544-7cc1d38de443 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:57.150738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1c1db-7c57-45cd-b544-7cc1d38de443 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:57.150738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1c1db-7c57-45cd-b544-7cc1d38de443 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:57.155643 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-aaf1c1db-7c57-45cd-b544-7cc1d38de443 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:57.163495 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:57.174456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987fd036-7b39-481e-afb5-a7c8d2d46960 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:57.176608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987fd036-7b39-481e-afb5-a7c8d2d46960 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:57.196587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 990/1994] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:56 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:31:57.267161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1c1db-7c57-45cd-b544-7cc1d38de443 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:57.269903 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1c1db-7c57-45cd-b544-7cc1d38de443 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:57.286512 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1005/1995] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:31:57.475950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fd036-7b39-481e-afb5-a7c8d2d46960 service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:57.477736 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-987fd036-7b39-481e-afb5-a7c8d2d46960 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:57.501236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fd036-7b39-481e-afb5-a7c8d2d46960 service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:57.508045 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fd7b5-165e-4da7-afd9-aedf3289587e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:57.509277 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fd7b5-165e-4da7-afd9-aedf3289587e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:57.509277 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fd7b5-165e-4da7-afd9-aedf3289587e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:57.509548 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fd7b5-165e-4da7-afd9-aedf3289587e admin admin] PATH_INFO: `/v3/projects/8867b3d276fc431e80324af3d1ede257` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:57.511758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fd7b5-165e-4da7-afd9-aedf3289587e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8867b3d276fc431e80324af3d1ede257)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:57.513999 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fd7b5-165e-4da7-afd9-aedf3289587e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:57.564716 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:57.615017 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7d0fd7b5-165e-4da7-afd9-aedf3289587e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8867b3d276fc431e80324af3d1ede257', 'request_id': 'req-7d0fd7b5-165e-4da7-afd9-aedf3289587e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:57.628194 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7d0fd7b5-165e-4da7-afd9-aedf3289587e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8867b3d276fc431e80324af3d1ede257', 'request_id': 'req-7d0fd7b5-165e-4da7-afd9-aedf3289587e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:57.639726 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7d0fd7b5-165e-4da7-afd9-aedf3289587e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8867b3d276fc431e80324af3d1ede257', 'request_id': 'req-7d0fd7b5-165e-4da7-afd9-aedf3289587e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:57.681160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7d0fd7b5-165e-4da7-afd9-aedf3289587e admin admin] The token cache is being invalidate because project 8867b3d276fc431e80324af3d1ede257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:57.681718 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7d0fd7b5-165e-4da7-afd9-aedf3289587e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:57.682850 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7d0fd7b5-165e-4da7-afd9-aedf3289587e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:57.685037 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 991/1996] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:57 2022] DELETE /identity/v3/projects/8867b3d276fc431e80324af3d1ede257 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:57.689477 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1c1db-7c57-45cd-b544-7cc1d38de443 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:57.719810 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1c1db-7c57-45cd-b544-7cc1d38de443 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:57.840900 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b117642-a712-47d3-a841-2746c57e5dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:57.844790 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b117642-a712-47d3-a841-2746c57e5dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:57.845464 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b117642-a712-47d3-a841-2746c57e5dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:57.845678 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b117642-a712-47d3-a841-2746c57e5dbd admin admin] PATH_INFO: `/v3/users/35ee5c9b9a5547eeabae2130dba21344` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:57.848144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b117642-a712-47d3-a841-2746c57e5dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=35ee5c9b9a5547eeabae2130dba21344)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:57.850407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b117642-a712-47d3-a841-2746c57e5dbd admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:57.937186 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5b117642-a712-47d3-a841-2746c57e5dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35ee5c9b9a5547eeabae2130dba21344'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:57.938101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5b117642-a712-47d3-a841-2746c57e5dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35ee5c9b9a5547eeabae2130dba21344'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:57.948036 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5b117642-a712-47d3-a841-2746c57e5dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35ee5c9b9a5547eeabae2130dba21344'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:57.948979 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5b117642-a712-47d3-a841-2746c57e5dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35ee5c9b9a5547eeabae2130dba21344'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:57.997365 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5b117642-a712-47d3-a841-2746c57e5dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35ee5c9b9a5547eeabae2130dba21344'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:58.038756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1006/1997] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:31:57 2022] DELETE /identity/v3/users/35ee5c9b9a5547eeabae2130dba21344 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:31:58.447337 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fd7b5-165e-4da7-afd9-aedf3289587e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:58.448965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7d0fd7b5-165e-4da7-afd9-aedf3289587e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:58.463686 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fd7b5-165e-4da7-afd9-aedf3289587e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:58.533338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a65be-5769-4abe-808a-927745f427f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:58.534097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a65be-5769-4abe-808a-927745f427f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:58.534409 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a65be-5769-4abe-808a-927745f427f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:58.534694 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a65be-5769-4abe-808a-927745f427f6 admin admin] PATH_INFO: `/v3/projects/df083db3270546a3bda8305e8637b928` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:58.535877 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a65be-5769-4abe-808a-927745f427f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df083db3270546a3bda8305e8637b928)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:58.537858 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a65be-5769-4abe-808a-927745f427f6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:58.593179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a89a65be-5769-4abe-808a-927745f427f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df083db3270546a3bda8305e8637b928', 'request_id': 'req-a89a65be-5769-4abe-808a-927745f427f6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:58.600386 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a89a65be-5769-4abe-808a-927745f427f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df083db3270546a3bda8305e8637b928', 'request_id': 'req-a89a65be-5769-4abe-808a-927745f427f6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:58.607357 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a89a65be-5769-4abe-808a-927745f427f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df083db3270546a3bda8305e8637b928', 'request_id': 'req-a89a65be-5769-4abe-808a-927745f427f6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:58.624142 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a89a65be-5769-4abe-808a-927745f427f6 admin admin] The token cache is being invalidate because project df083db3270546a3bda8305e8637b928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:31:58.624442 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a89a65be-5769-4abe-808a-927745f427f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:58.625103 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a89a65be-5769-4abe-808a-927745f427f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:31:58.626700 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 992/1998] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:31:58 2022] DELETE /identity/v3/projects/df083db3270546a3bda8305e8637b928 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:58.631585 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddf71c-bb84-4c88-a50e-c8c0af0bfe89 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:58.631877 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddf71c-bb84-4c88-a50e-c8c0af0bfe89 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:58.632160 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddf71c-bb84-4c88-a50e-c8c0af0bfe89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:58.651813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-1dddf71c-bb84-4c88-a50e-c8c0af0bfe89 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:58.653082 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1dddf71c-bb84-4c88-a50e-c8c0af0bfe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:58.673961 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:58.736675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1007/1999] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:58.744661 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6302fd-9b0a-43a5-a17c-4be7a3c35f9c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:58.745024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6302fd-9b0a-43a5-a17c-4be7a3c35f9c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:58.745342 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6302fd-9b0a-43a5-a17c-4be7a3c35f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:58.787055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-af6302fd-9b0a-43a5-a17c-4be7a3c35f9c None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:58.788562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-af6302fd-9b0a-43a5-a17c-4be7a3c35f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:58.816617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 993/2000] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:58.817841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dddf71c-bb84-4c88-a50e-c8c0af0bfe89 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:58.835376 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dddf71c-bb84-4c88-a50e-c8c0af0bfe89 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:58.849217 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c473f05-0fab-456b-b500-513504e7248f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:58.849858 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c473f05-0fab-456b-b500-513504e7248f admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:58.850155 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c473f05-0fab-456b-b500-513504e7248f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:58.850417 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c473f05-0fab-456b-b500-513504e7248f admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:58.851191 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c473f05-0fab-456b-b500-513504e7248f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:31:58.857471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c473f05-0fab-456b-b500-513504e7248f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:58.859789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c473f05-0fab-456b-b500-513504e7248f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:58.885044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1008/2001] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:31:58.889916 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6302fd-9b0a-43a5-a17c-4be7a3c35f9c None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:58.902199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6302fd-9b0a-43a5-a17c-4be7a3c35f9c None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:58.907849 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a517ff8-bb07-4c1e-82a3-9f38c3d97f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:58.908522 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a517ff8-bb07-4c1e-82a3-9f38c3d97f7b admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:58.909462 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a517ff8-bb07-4c1e-82a3-9f38c3d97f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:58.909762 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a517ff8-bb07-4c1e-82a3-9f38c3d97f7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:58.910684 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a517ff8-bb07-4c1e-82a3-9f38c3d97f7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:58.912768 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a517ff8-bb07-4c1e-82a3-9f38c3d97f7b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:58.957051 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 994/2002] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:58 2022] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:58.963316 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c473f05-0fab-456b-b500-513504e7248f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:58.976753 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c473f05-0fab-456b-b500-513504e7248f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:59.078830 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdf3ff-1cb1-44b7-9688-43f28c8753c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:59.079485 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdf3ff-1cb1-44b7-9688-43f28c8753c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:59.079773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdf3ff-1cb1-44b7-9688-43f28c8753c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:59.080051 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdf3ff-1cb1-44b7-9688-43f28c8753c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:59.080902 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdf3ff-1cb1-44b7-9688-43f28c8753c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:59.083435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdf3ff-1cb1-44b7-9688-43f28c8753c2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:59.132958 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1009/2003] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:58 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:59.135337 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a517ff8-bb07-4c1e-82a3-9f38c3d97f7b admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:59.153792 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a517ff8-bb07-4c1e-82a3-9f38c3d97f7b admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:59.178334 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b9d36-71f2-4488-bd8d-ed569de29987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:59.179415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b9d36-71f2-4488-bd8d-ed569de29987 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:59.181000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b9d36-71f2-4488-bd8d-ed569de29987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:59.182439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b9d36-71f2-4488-bd8d-ed569de29987 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:59.183515 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b9d36-71f2-4488-bd8d-ed569de29987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:59.189978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b9d36-71f2-4488-bd8d-ed569de29987 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:59.211484 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:59.229669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 995/2004] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:59.230699 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdf3ff-1cb1-44b7-9688-43f28c8753c2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:59.251028 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdf3ff-1cb1-44b7-9688-43f28c8753c2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:59.262547 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af0a91-4eee-4722-ac3d-8574ee47c65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:59.263538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af0a91-4eee-4722-ac3d-8574ee47c65a admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:59.263987 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af0a91-4eee-4722-ac3d-8574ee47c65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:59.264399 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af0a91-4eee-4722-ac3d-8574ee47c65a admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:59.265634 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af0a91-4eee-4722-ac3d-8574ee47c65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:59.267827 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af0a91-4eee-4722-ac3d-8574ee47c65a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:59.284564 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1010/2005] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:31:59.289298 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b9d36-71f2-4488-bd8d-ed569de29987 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:59.322235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b9d36-71f2-4488-bd8d-ed569de29987 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:59.329207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01575a-5dd8-4574-bc88-afcb2353139f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:59.330208 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01575a-5dd8-4574-bc88-afcb2353139f admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:59.330822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01575a-5dd8-4574-bc88-afcb2353139f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:59.331402 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01575a-5dd8-4574-bc88-afcb2353139f admin admin] PATH_INFO: `/v3/projects/575db5e1fb5742ab810da8d93f7ae6e4/users/1cb5127c0d2b4ca7aebe599b2cd7e83f/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:59.356550 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01575a-5dd8-4574-bc88-afcb2353139f admin admin] RBAC: Authorizing `identity:create_grant(project_id=575db5e1fb5742ab810da8d93f7ae6e4, user_id=1cb5127c0d2b4ca7aebe599b2cd7e83f, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:59.361334 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01575a-5dd8-4574-bc88-afcb2353139f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:59.392754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 996/2006] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:59 2022] PUT /identity/v3/projects/575db5e1fb5742ab810da8d93f7ae6e4/users/1cb5127c0d2b4ca7aebe599b2cd7e83f/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:31:59.407671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879dbfb-3d53-4e89-a6f1-9f00a219f387 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:59.407995 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879dbfb-3d53-4e89-a6f1-9f00a219f387 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:59.408283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879dbfb-3d53-4e89-a6f1-9f00a219f387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:59.456765 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4879dbfb-3d53-4e89-a6f1-9f00a219f387 None None] MFA Rules not processed for user `1cb5127c0d2b4ca7aebe599b2cd7e83f`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:31:59.458597 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4879dbfb-3d53-4e89-a6f1-9f00a219f387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:59.591968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1011/2007] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:31:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:31:59.592941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01575a-5dd8-4574-bc88-afcb2353139f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:59.684907 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01575a-5dd8-4574-bc88-afcb2353139f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:59.691197 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db141e-f2e3-4356-8277-954ea1fdfed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:59.691834 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db141e-f2e3-4356-8277-954ea1fdfed5 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:59.693537 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db141e-f2e3-4356-8277-954ea1fdfed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:59.693537 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db141e-f2e3-4356-8277-954ea1fdfed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:59.693537 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db141e-f2e3-4356-8277-954ea1fdfed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:59.695328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db141e-f2e3-4356-8277-954ea1fdfed5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:59.741097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 997/2008] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:31:59 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:59.741295 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879dbfb-3d53-4e89-a6f1-9f00a219f387 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:59.759053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879dbfb-3d53-4e89-a6f1-9f00a219f387 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:59.781215 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db141e-f2e3-4356-8277-954ea1fdfed5 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:59.782123 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:31:59.783320 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-71db141e-f2e3-4356-8277-954ea1fdfed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:59.871748 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff7089-6e87-4f67-9c1e-e3ed11872bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:59.872442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff7089-6e87-4f67-9c1e-e3ed11872bbd admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:59.873138 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff7089-6e87-4f67-9c1e-e3ed11872bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:59.873469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff7089-6e87-4f67-9c1e-e3ed11872bbd admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:59.874891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff7089-6e87-4f67-9c1e-e3ed11872bbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:59.876608 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff7089-6e87-4f67-9c1e-e3ed11872bbd admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:59.890891 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db141e-f2e3-4356-8277-954ea1fdfed5 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:59.895865 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e965c39-e591-4203-8d51-e5c07886dc9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:59.896503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e965c39-e591-4203-8d51-e5c07886dc9f service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:59.896811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e965c39-e591-4203-8d51-e5c07886dc9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:59.897092 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e965c39-e591-4203-8d51-e5c07886dc9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:59.899055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1e965c39-e591-4203-8d51-e5c07886dc9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:31:59.910686 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1012/2009] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:31:59 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:31:59.914730 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff7089-6e87-4f67-9c1e-e3ed11872bbd admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:59.929279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff7089-6e87-4f67-9c1e-e3ed11872bbd admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:59.934237 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e0458-e001-4189-87b0-1aa7ff3c9d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:59.934885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e0458-e001-4189-87b0-1aa7ff3c9d4b admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:59.935170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e0458-e001-4189-87b0-1aa7ff3c9d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:59.935451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e0458-e001-4189-87b0-1aa7ff3c9d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:31:59.936148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e0458-e001-4189-87b0-1aa7ff3c9d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:31:59.937754 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e0458-e001-4189-87b0-1aa7ff3c9d4b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:31:59.950722 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1013/2010] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:31:59.955314 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e0458-e001-4189-87b0-1aa7ff3c9d4b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:31:59.975890 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e0458-e001-4189-87b0-1aa7ff3c9d4b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:31:59.983290 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affeb5cc-8a8d-4f55-aa51-062c28c1b617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:31:59.984911 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affeb5cc-8a8d-4f55-aa51-062c28c1b617 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:31:59.985417 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affeb5cc-8a8d-4f55-aa51-062c28c1b617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:31:59.985768 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affeb5cc-8a8d-4f55-aa51-062c28c1b617 admin admin] PATH_INFO: `/v3/projects/c9ab472fbb1f478caadfcab311437a5c/users/66fdf17fbbe247ca994de4deae93c531/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:00.007474 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e965c39-e591-4203-8d51-e5c07886dc9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:00.012861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e965c39-e591-4203-8d51-e5c07886dc9f service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:00.016785 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affeb5cc-8a8d-4f55-aa51-062c28c1b617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ab472fbb1f478caadfcab311437a5c, user_id=66fdf17fbbe247ca994de4deae93c531, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:00.022360 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affeb5cc-8a8d-4f55-aa51-062c28c1b617 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:00.039726 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 998/2011] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:31:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:32:00.054619 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1014/2012] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:31:59 2022] PUT /identity/v3/projects/c9ab472fbb1f478caadfcab311437a5c/users/66fdf17fbbe247ca994de4deae93c531/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:32:00.059605 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e965c39-e591-4203-8d51-e5c07886dc9f service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:00.083327 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e965c39-e591-4203-8d51-e5c07886dc9f service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:00.098771 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:00.160640 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f44453-9db9-4b76-a533-0d5f7cccc292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:00.161300 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f44453-9db9-4b76-a533-0d5f7cccc292 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:00.161594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f44453-9db9-4b76-a533-0d5f7cccc292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:00.161873 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f44453-9db9-4b76-a533-0d5f7cccc292 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:00.162560 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f44453-9db9-4b76-a533-0d5f7cccc292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:00.164417 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f44453-9db9-4b76-a533-0d5f7cccc292 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:00.176216 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 999/2013] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:00.181184 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affeb5cc-8a8d-4f55-aa51-062c28c1b617 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:00.199706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affeb5cc-8a8d-4f55-aa51-062c28c1b617 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:00.212849 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1559b-3335-448e-8f3f-7d2ed1f5240d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:00.213545 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1559b-3335-448e-8f3f-7d2ed1f5240d admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:00.214281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1559b-3335-448e-8f3f-7d2ed1f5240d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:00.214281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1559b-3335-448e-8f3f-7d2ed1f5240d admin admin] PATH_INFO: `/v3/projects/c9ab472fbb1f478caadfcab311437a5c/users/66fdf17fbbe247ca994de4deae93c531/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:00.217788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1559b-3335-448e-8f3f-7d2ed1f5240d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ab472fbb1f478caadfcab311437a5c, user_id=66fdf17fbbe247ca994de4deae93c531, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:00.221407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1559b-3335-448e-8f3f-7d2ed1f5240d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:00.233667 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1015/2014] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:00 2022] PUT /identity/v3/projects/c9ab472fbb1f478caadfcab311437a5c/users/66fdf17fbbe247ca994de4deae93c531/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:00.244913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681774a8-911a-41e4-9819-9cc7a94b3fd9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:00.245207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681774a8-911a-41e4-9819-9cc7a94b3fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:00.245493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681774a8-911a-41e4-9819-9cc7a94b3fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:00.278923 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-681774a8-911a-41e4-9819-9cc7a94b3fd9 None None] MFA Rules not processed for user `66fdf17fbbe247ca994de4deae93c531`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:00.280236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-681774a8-911a-41e4-9819-9cc7a94b3fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:00.387791 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1000/2015] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:00.863506 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1559b-3335-448e-8f3f-7d2ed1f5240d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:00.865507 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-33b1559b-3335-448e-8f3f-7d2ed1f5240d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:00.979145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1559b-3335-448e-8f3f-7d2ed1f5240d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:00.998230 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0dfbe-c562-43d4-9ff7-6e71b23b9c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:00.998898 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0dfbe-c562-43d4-9ff7-6e71b23b9c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:00.999239 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0dfbe-c562-43d4-9ff7-6e71b23b9c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:00.999523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0dfbe-c562-43d4-9ff7-6e71b23b9c26 admin admin] PATH_INFO: `/v3/users/fe50714f5a1b4fce97a9a7346af74381` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:01.001462 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0dfbe-c562-43d4-9ff7-6e71b23b9c26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe50714f5a1b4fce97a9a7346af74381)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:01.004327 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0dfbe-c562-43d4-9ff7-6e71b23b9c26 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:01.090432 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681774a8-911a-41e4-9819-9cc7a94b3fd9 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:01.093173 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-681774a8-911a-41e4-9819-9cc7a94b3fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:01.103391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d9b0dfbe-c562-43d4-9ff7-6e71b23b9c26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe50714f5a1b4fce97a9a7346af74381'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:01.105994 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d9b0dfbe-c562-43d4-9ff7-6e71b23b9c26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe50714f5a1b4fce97a9a7346af74381'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:01.121886 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d9b0dfbe-c562-43d4-9ff7-6e71b23b9c26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe50714f5a1b4fce97a9a7346af74381'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:01.122513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d9b0dfbe-c562-43d4-9ff7-6e71b23b9c26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe50714f5a1b4fce97a9a7346af74381'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:01.129330 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681774a8-911a-41e4-9819-9cc7a94b3fd9 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:01.132796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=85,keystone:INSERT=6,keystone:DELETE=9 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:01.138355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dde86-22c2-4024-94f8-294bf4f30539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:01.139179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dde86-22c2-4024-94f8-294bf4f30539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:01.140415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dde86-22c2-4024-94f8-294bf4f30539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:01.140590 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dde86-22c2-4024-94f8-294bf4f30539 admin admin] PATH_INFO: `/v3/users/a3d60b4e1c794a8a9f06a2447bfc128c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:01.142162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709dde86-22c2-4024-94f8-294bf4f30539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d60b4e1c794a8a9f06a2447bfc128c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:01.145369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d9b0dfbe-c562-43d4-9ff7-6e71b23b9c26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe50714f5a1b4fce97a9a7346af74381'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:01.148191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709dde86-22c2-4024-94f8-294bf4f30539 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:01.165043 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1016/2016] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:00 2022] DELETE /identity/v3/users/fe50714f5a1b4fce97a9a7346af74381 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:01.169984 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef4f3e-f393-4f43-89be-ee7c2e98c8a6 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:01.170409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef4f3e-f393-4f43-89be-ee7c2e98c8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:01.170610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef4f3e-f393-4f43-89be-ee7c2e98c8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:01.203174 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-71ef4f3e-f393-4f43-89be-ee7c2e98c8a6 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:01.205095 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-71ef4f3e-f393-4f43-89be-ee7c2e98c8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:01.241255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-709dde86-22c2-4024-94f8-294bf4f30539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d60b4e1c794a8a9f06a2447bfc128c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:01.242136 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-709dde86-22c2-4024-94f8-294bf4f30539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d60b4e1c794a8a9f06a2447bfc128c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:01.256815 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-709dde86-22c2-4024-94f8-294bf4f30539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d60b4e1c794a8a9f06a2447bfc128c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:01.260258 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-709dde86-22c2-4024-94f8-294bf4f30539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d60b4e1c794a8a9f06a2447bfc128c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:01.288069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-709dde86-22c2-4024-94f8-294bf4f30539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d60b4e1c794a8a9f06a2447bfc128c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:01.296295 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1017/2017] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:32:01.309022 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef4f3e-f393-4f43-89be-ee7c2e98c8a6 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:01.311987 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-71ef4f3e-f393-4f43-89be-ee7c2e98c8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:01.324061 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1001/2018] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:01 2022] DELETE /identity/v3/users/a3d60b4e1c794a8a9f06a2447bfc128c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:01.330489 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2c62c-1586-43b0-b992-e9c5718fa484 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:01.330957 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2c62c-1586-43b0-b992-e9c5718fa484 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:01.331245 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2c62c-1586-43b0-b992-e9c5718fa484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:01.355494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-06c2c62c-1586-43b0-b992-e9c5718fa484 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:01.357051 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-06c2c62c-1586-43b0-b992-e9c5718fa484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:01.362226 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:01.416392 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef4f3e-f393-4f43-89be-ee7c2e98c8a6 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:01.462933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1002/2019] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:01.482429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2c62c-1586-43b0-b992-e9c5718fa484 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:01.499293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bda862-fcff-43e4-88c5-6f811be9dd40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:01.500410 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bda862-fcff-43e4-88c5-6f811be9dd40 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:01.500928 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bda862-fcff-43e4-88c5-6f811be9dd40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:01.501942 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bda862-fcff-43e4-88c5-6f811be9dd40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:01.515635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bda862-fcff-43e4-88c5-6f811be9dd40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:01.519511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bda862-fcff-43e4-88c5-6f811be9dd40 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:01.548869 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1018/2020] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:01.577371 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2c62c-1586-43b0-b992-e9c5718fa484 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:01.582802 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910448d-8878-4790-bd41-2dfe97c455ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:01.583498 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910448d-8878-4790-bd41-2dfe97c455ba service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:01.583844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910448d-8878-4790-bd41-2dfe97c455ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:01.584127 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910448d-8878-4790-bd41-2dfe97c455ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:01.602257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910448d-8878-4790-bd41-2dfe97c455ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:01.604351 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910448d-8878-4790-bd41-2dfe97c455ba service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:01.630734 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1003/2021] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:02.072864 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bda862-fcff-43e4-88c5-6f811be9dd40 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:02.074782 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-86bda862-fcff-43e4-88c5-6f811be9dd40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:02.100625 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bda862-fcff-43e4-88c5-6f811be9dd40 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:02.111482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e261804-f317-42cc-9b34-d59b97aef743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:02.112477 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e261804-f317-42cc-9b34-d59b97aef743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:02.112813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e261804-f317-42cc-9b34-d59b97aef743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:02.113098 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e261804-f317-42cc-9b34-d59b97aef743 admin admin] PATH_INFO: `/v3/projects/d8c223d117964ea9bbcddcdcc992bab8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:02.114820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e261804-f317-42cc-9b34-d59b97aef743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8c223d117964ea9bbcddcdcc992bab8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:02.116787 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e261804-f317-42cc-9b34-d59b97aef743 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:02.176169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:02.188813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7e261804-f317-42cc-9b34-d59b97aef743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8c223d117964ea9bbcddcdcc992bab8', 'request_id': 'req-7e261804-f317-42cc-9b34-d59b97aef743'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:02.197840 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7e261804-f317-42cc-9b34-d59b97aef743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8c223d117964ea9bbcddcdcc992bab8', 'request_id': 'req-7e261804-f317-42cc-9b34-d59b97aef743'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:02.205172 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7e261804-f317-42cc-9b34-d59b97aef743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8c223d117964ea9bbcddcdcc992bab8', 'request_id': 'req-7e261804-f317-42cc-9b34-d59b97aef743'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:02.220250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7e261804-f317-42cc-9b34-d59b97aef743 admin admin] The token cache is being invalidate because project d8c223d117964ea9bbcddcdcc992bab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:02.220763 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7e261804-f317-42cc-9b34-d59b97aef743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:02.222234 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7e261804-f317-42cc-9b34-d59b97aef743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:02.224681 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1019/2022] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:02 2022] DELETE /identity/v3/projects/d8c223d117964ea9bbcddcdcc992bab8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:02.229020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910448d-8878-4790-bd41-2dfe97c455ba service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:02.240030 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910448d-8878-4790-bd41-2dfe97c455ba service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:02.309592 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379e17c-33f6-4f29-8d0d-5007e63c8320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:02.310424 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379e17c-33f6-4f29-8d0d-5007e63c8320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:02.310858 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379e17c-33f6-4f29-8d0d-5007e63c8320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:02.311284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379e17c-33f6-4f29-8d0d-5007e63c8320 admin admin] PATH_INFO: `/v3/users/a82f48e06ff54689b7317b22eaca22c9` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:02.312620 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379e17c-33f6-4f29-8d0d-5007e63c8320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a82f48e06ff54689b7317b22eaca22c9)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:02.314752 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379e17c-33f6-4f29-8d0d-5007e63c8320 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:02.364502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e261804-f317-42cc-9b34-d59b97aef743 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:02.367157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7e261804-f317-42cc-9b34-d59b97aef743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:02.401534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e261804-f317-42cc-9b34-d59b97aef743 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:02.410696 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3299142-2c82-4d2b-9baa-afd945e88ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:02.411772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3299142-2c82-4d2b-9baa-afd945e88ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:02.412393 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8379e17c-33f6-4f29-8d0d-5007e63c8320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a82f48e06ff54689b7317b22eaca22c9'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:02.412565 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3299142-2c82-4d2b-9baa-afd945e88ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:02.413067 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3299142-2c82-4d2b-9baa-afd945e88ea7 admin admin] PATH_INFO: `/v3/projects/888092ab8b9c432dba87de498f97ea7d` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:02.413510 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8379e17c-33f6-4f29-8d0d-5007e63c8320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a82f48e06ff54689b7317b22eaca22c9'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:02.415358 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3299142-2c82-4d2b-9baa-afd945e88ea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=888092ab8b9c432dba87de498f97ea7d)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:02.418550 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3299142-2c82-4d2b-9baa-afd945e88ea7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:02.423836 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:02.428958 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8379e17c-33f6-4f29-8d0d-5007e63c8320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a82f48e06ff54689b7317b22eaca22c9'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:02.430326 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8379e17c-33f6-4f29-8d0d-5007e63c8320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a82f48e06ff54689b7317b22eaca22c9'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:02.444991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8379e17c-33f6-4f29-8d0d-5007e63c8320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a82f48e06ff54689b7317b22eaca22c9'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:02.478507 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1004/2023] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:02 2022] DELETE /identity/v3/users/a82f48e06ff54689b7317b22eaca22c9 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:02.514235 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f3299142-2c82-4d2b-9baa-afd945e88ea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '888092ab8b9c432dba87de498f97ea7d', 'request_id': 'req-f3299142-2c82-4d2b-9baa-afd945e88ea7'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:02.524227 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f3299142-2c82-4d2b-9baa-afd945e88ea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '888092ab8b9c432dba87de498f97ea7d', 'request_id': 'req-f3299142-2c82-4d2b-9baa-afd945e88ea7'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:02.531423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f3299142-2c82-4d2b-9baa-afd945e88ea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '888092ab8b9c432dba87de498f97ea7d', 'request_id': 'req-f3299142-2c82-4d2b-9baa-afd945e88ea7'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:02.546863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f3299142-2c82-4d2b-9baa-afd945e88ea7 admin admin] The token cache is being invalidate because project 888092ab8b9c432dba87de498f97ea7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:02.547180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f3299142-2c82-4d2b-9baa-afd945e88ea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:02.547912 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f3299142-2c82-4d2b-9baa-afd945e88ea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:02.551482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1020/2024] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:02 2022] DELETE /identity/v3/projects/888092ab8b9c432dba87de498f97ea7d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:32:02.556639 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379e17c-33f6-4f29-8d0d-5007e63c8320 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:02.560944 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8379e17c-33f6-4f29-8d0d-5007e63c8320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:02.738587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379e17c-33f6-4f29-8d0d-5007e63c8320 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:02.896423 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b75be5-58e5-48ef-ab0f-785a7e88d4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:02.897256 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b75be5-58e5-48ef-ab0f-785a7e88d4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:02.897550 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b75be5-58e5-48ef-ab0f-785a7e88d4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:02.900158 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b75be5-58e5-48ef-ab0f-785a7e88d4f4 admin admin] PATH_INFO: `/v3/users/a323c39b1318471c9e45da9236af3507` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:02.911330 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b75be5-58e5-48ef-ab0f-785a7e88d4f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a323c39b1318471c9e45da9236af3507)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:02.913691 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b75be5-58e5-48ef-ab0f-785a7e88d4f4 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:02.914236 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3299142-2c82-4d2b-9baa-afd945e88ea7 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:02.915981 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f3299142-2c82-4d2b-9baa-afd945e88ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:03.060955 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-56b75be5-58e5-48ef-ab0f-785a7e88d4f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a323c39b1318471c9e45da9236af3507'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:03.061651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-56b75be5-58e5-48ef-ab0f-785a7e88d4f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a323c39b1318471c9e45da9236af3507'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:03.076104 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-56b75be5-58e5-48ef-ab0f-785a7e88d4f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a323c39b1318471c9e45da9236af3507'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:03.078984 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-56b75be5-58e5-48ef-ab0f-785a7e88d4f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a323c39b1318471c9e45da9236af3507'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:03.089711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3299142-2c82-4d2b-9baa-afd945e88ea7 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:03.093768 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-56b75be5-58e5-48ef-ab0f-785a7e88d4f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a323c39b1318471c9e45da9236af3507'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:03.100776 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811f2cd-9849-4345-8c6c-54da1365c734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:03.101411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811f2cd-9849-4345-8c6c-54da1365c734 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:03.102406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811f2cd-9849-4345-8c6c-54da1365c734 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:03.102406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811f2cd-9849-4345-8c6c-54da1365c734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:03.105761 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5811f2cd-9849-4345-8c6c-54da1365c734 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:03.123265 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:03.135867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1005/2025] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:02 2022] DELETE /identity/v3/users/a323c39b1318471c9e45da9236af3507 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:03.138023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b75be5-58e5-48ef-ab0f-785a7e88d4f4 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:03.147021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-56b75be5-58e5-48ef-ab0f-785a7e88d4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:03.234336 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:03.241209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811f2cd-9849-4345-8c6c-54da1365c734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:03.244566 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811f2cd-9849-4345-8c6c-54da1365c734 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:03.255109 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b75be5-58e5-48ef-ab0f-785a7e88d4f4 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:03.261089 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8503c97-dba0-4a44-a12e-7eb6214510b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:03.261387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1021/2026] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:02 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:03.262472 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8503c97-dba0-4a44-a12e-7eb6214510b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:03.262590 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811f2cd-9849-4345-8c6c-54da1365c734 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:03.263020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8503c97-dba0-4a44-a12e-7eb6214510b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:03.263232 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8503c97-dba0-4a44-a12e-7eb6214510b7 admin admin] PATH_INFO: `/v3/projects/927be1ba1b7843d09ec74bdb9557d6d4` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:03.264547 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8503c97-dba0-4a44-a12e-7eb6214510b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=927be1ba1b7843d09ec74bdb9557d6d4)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:03.264680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5811f2cd-9849-4345-8c6c-54da1365c734 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:03.267260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8503c97-dba0-4a44-a12e-7eb6214510b7 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:03.284941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811f2cd-9849-4345-8c6c-54da1365c734 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:03.293504 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af62fb-d643-42c9-be68-75d84e045542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:03.294603 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af62fb-d643-42c9-be68-75d84e045542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:03.294753 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af62fb-d643-42c9-be68-75d84e045542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:03.295115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af62fb-d643-42c9-be68-75d84e045542 admin admin] PATH_INFO: `/v3/users/832a8b71cf644f8baf2fb076be01c236` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:03.297092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af62fb-d643-42c9-be68-75d84e045542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=832a8b71cf644f8baf2fb076be01c236)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:03.301041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af62fb-d643-42c9-be68-75d84e045542 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:03.371315 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d8503c97-dba0-4a44-a12e-7eb6214510b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '927be1ba1b7843d09ec74bdb9557d6d4', 'request_id': 'req-d8503c97-dba0-4a44-a12e-7eb6214510b7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:03.394196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d8503c97-dba0-4a44-a12e-7eb6214510b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '927be1ba1b7843d09ec74bdb9557d6d4', 'request_id': 'req-d8503c97-dba0-4a44-a12e-7eb6214510b7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:03.412201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d8503c97-dba0-4a44-a12e-7eb6214510b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '927be1ba1b7843d09ec74bdb9557d6d4', 'request_id': 'req-d8503c97-dba0-4a44-a12e-7eb6214510b7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:03.413355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f1af62fb-d643-42c9-be68-75d84e045542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832a8b71cf644f8baf2fb076be01c236'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:03.414432 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f1af62fb-d643-42c9-be68-75d84e045542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832a8b71cf644f8baf2fb076be01c236'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:03.439502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f1af62fb-d643-42c9-be68-75d84e045542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832a8b71cf644f8baf2fb076be01c236'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:03.443044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f1af62fb-d643-42c9-be68-75d84e045542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832a8b71cf644f8baf2fb076be01c236'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:03.447746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d8503c97-dba0-4a44-a12e-7eb6214510b7 admin admin] The token cache is being invalidate because project 927be1ba1b7843d09ec74bdb9557d6d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:03.448046 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d8503c97-dba0-4a44-a12e-7eb6214510b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:03.448763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d8503c97-dba0-4a44-a12e-7eb6214510b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:03.450391 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1006/2027] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:03 2022] DELETE /identity/v3/projects/927be1ba1b7843d09ec74bdb9557d6d4 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:03.455053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fc85b-b5ba-4f28-a6f5-df9089778bb4 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:03.456792 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fc85b-b5ba-4f28-a6f5-df9089778bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:03.457353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fc85b-b5ba-4f28-a6f5-df9089778bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:03.465067 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f1af62fb-d643-42c9-be68-75d84e045542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832a8b71cf644f8baf2fb076be01c236'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:03.483777 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-1e0fc85b-b5ba-4f28-a6f5-df9089778bb4 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:03.485634 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1022/2028] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:03 2022] DELETE /identity/v3/users/832a8b71cf644f8baf2fb076be01c236 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:03.485921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1e0fc85b-b5ba-4f28-a6f5-df9089778bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:03.490757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1004c-aec4-4c6e-b6c6-3d3c9fb9418c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:03.491176 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1004c-aec4-4c6e-b6c6-3d3c9fb9418c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:03.491469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1004c-aec4-4c6e-b6c6-3d3c9fb9418c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:03.522800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-59a1004c-aec4-4c6e-b6c6-3d3c9fb9418c None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:03.530258 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-59a1004c-aec4-4c6e-b6c6-3d3c9fb9418c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:03.670731 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1007/2029] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:03.675918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75f317-d36a-48f9-8259-b87add50b544 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:03.676322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75f317-d36a-48f9-8259-b87add50b544 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:03.676857 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75f317-d36a-48f9-8259-b87add50b544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:03.714760 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-8d75f317-d36a-48f9-8259-b87add50b544 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:03.715152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1023/2030] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:03.715975 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8d75f317-d36a-48f9-8259-b87add50b544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:03.728063 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1008/2031] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:03.732379 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1004c-aec4-4c6e-b6c6-3d3c9fb9418c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:03.739316 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75f317-d36a-48f9-8259-b87add50b544 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:03.740963 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8d75f317-d36a-48f9-8259-b87add50b544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:03.753255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1004c-aec4-4c6e-b6c6-3d3c9fb9418c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:03.772125 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17450f6-3814-4760-aee4-8806879d16af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:03.773269 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17450f6-3814-4760-aee4-8806879d16af admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:03.773772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17450f6-3814-4760-aee4-8806879d16af admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:03.774556 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17450f6-3814-4760-aee4-8806879d16af admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:03.775350 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17450f6-3814-4760-aee4-8806879d16af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:32:03.775615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17450f6-3814-4760-aee4-8806879d16af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:03.781465 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17450f6-3814-4760-aee4-8806879d16af admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:03.787438 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:03.815779 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1024/2032] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:32:03.817286 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17450f6-3814-4760-aee4-8806879d16af admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:03.836282 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17450f6-3814-4760-aee4-8806879d16af admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:03.850822 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0ace9-903f-4612-8c8e-e8d24d06d9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:03.851463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0ace9-903f-4612-8c8e-e8d24d06d9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:03.851713 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0ace9-903f-4612-8c8e-e8d24d06d9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:03.852093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0ace9-903f-4612-8c8e-e8d24d06d9c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:03.852625 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0ace9-903f-4612-8c8e-e8d24d06d9c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:03.859996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0ace9-903f-4612-8c8e-e8d24d06d9c2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:03.871895 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75f317-d36a-48f9-8259-b87add50b544 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:03.882705 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de45967-72ee-448e-9256-b221f9265968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:03.885284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de45967-72ee-448e-9256-b221f9265968 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:03.887819 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de45967-72ee-448e-9256-b221f9265968 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:03.888171 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de45967-72ee-448e-9256-b221f9265968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:03.900480 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1025/2033] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:32:03 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:03.904976 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de45967-72ee-448e-9256-b221f9265968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:03.905640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0ace9-903f-4612-8c8e-e8d24d06d9c2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:03.906437 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de45967-72ee-448e-9256-b221f9265968 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:03.907889 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-eac0ace9-903f-4612-8c8e-e8d24d06d9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:03.920301 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1009/2034] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:32:03.921187 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de45967-72ee-448e-9256-b221f9265968 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:03.937689 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de45967-72ee-448e-9256-b221f9265968 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:03.954453 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:03.998116 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0ace9-903f-4612-8c8e-e8d24d06d9c2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:04.004900 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7c9f0-e757-4929-8736-d7d74ff6be52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:04.006134 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7c9f0-e757-4929-8736-d7d74ff6be52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:04.006656 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7c9f0-e757-4929-8736-d7d74ff6be52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:04.007030 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7c9f0-e757-4929-8736-d7d74ff6be52 admin admin] PATH_INFO: `/v3/projects/a755acc749c84acd8acc21415454590e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:04.009087 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7c9f0-e757-4929-8736-d7d74ff6be52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a755acc749c84acd8acc21415454590e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:04.012156 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7c9f0-e757-4929-8736-d7d74ff6be52 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:04.025887 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0f9a6-8446-4b69-bddf-dcd19d6c7363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:04.026795 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0f9a6-8446-4b69-bddf-dcd19d6c7363 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:04.027297 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0f9a6-8446-4b69-bddf-dcd19d6c7363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:04.027834 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0f9a6-8446-4b69-bddf-dcd19d6c7363 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:04.028756 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0f9a6-8446-4b69-bddf-dcd19d6c7363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:04.031078 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0f9a6-8446-4b69-bddf-dcd19d6c7363 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:04.067455 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1010/2035] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:32:03 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:04.067455 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0f9a6-8446-4b69-bddf-dcd19d6c7363 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:04.071297 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9ec0f9a6-8446-4b69-bddf-dcd19d6c7363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:04.101020 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3fd7c9f0-e757-4929-8736-d7d74ff6be52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a755acc749c84acd8acc21415454590e', 'request_id': 'req-3fd7c9f0-e757-4929-8736-d7d74ff6be52'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:04.109972 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3fd7c9f0-e757-4929-8736-d7d74ff6be52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a755acc749c84acd8acc21415454590e', 'request_id': 'req-3fd7c9f0-e757-4929-8736-d7d74ff6be52'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:04.117320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3fd7c9f0-e757-4929-8736-d7d74ff6be52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a755acc749c84acd8acc21415454590e', 'request_id': 'req-3fd7c9f0-e757-4929-8736-d7d74ff6be52'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:04.140398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3fd7c9f0-e757-4929-8736-d7d74ff6be52 admin admin] The token cache is being invalidate because project a755acc749c84acd8acc21415454590e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:04.140824 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3fd7c9f0-e757-4929-8736-d7d74ff6be52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:04.141931 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3fd7c9f0-e757-4929-8736-d7d74ff6be52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:04.147074 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1026/2036] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:03 2022] DELETE /identity/v3/projects/a755acc749c84acd8acc21415454590e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:04.148177 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7c9f0-e757-4929-8736-d7d74ff6be52 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:04.151809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3fd7c9f0-e757-4929-8736-d7d74ff6be52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:04.176882 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0f9a6-8446-4b69-bddf-dcd19d6c7363 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:04.272747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7c9f0-e757-4929-8736-d7d74ff6be52 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:04.278459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec9f45-2dea-4942-b313-0a316420f661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:04.285926 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec9f45-2dea-4942-b313-0a316420f661 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:04.286028 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec9f45-2dea-4942-b313-0a316420f661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:04.286236 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec9f45-2dea-4942-b313-0a316420f661 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:04.287098 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec9f45-2dea-4942-b313-0a316420f661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:04.288983 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec9f45-2dea-4942-b313-0a316420f661 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:04.307516 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1027/2037] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:04.308664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce1722-9452-4b6c-97bd-d70e8511280e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:04.309106 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce1722-9452-4b6c-97bd-d70e8511280e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:04.309393 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce1722-9452-4b6c-97bd-d70e8511280e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:04.315753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3e911-f401-4767-8659-c36b35ffd934 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66fdf17fbbe247ca994de4deae93c531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9ab472fbb1f478caadfcab311437a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:04.315753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3e911-f401-4767-8659-c36b35ffd934 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:04.315753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3e911-f401-4767-8659-c36b35ffd934 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:04.316562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3e911-f401-4767-8659-c36b35ffd934 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:04.316849 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3e911-f401-4767-8659-c36b35ffd934 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:32:04.317131 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3e911-f401-4767-8659-c36b35ffd934 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:04.322076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3e911-f401-4767-8659-c36b35ffd934 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:04.328860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:04.351617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-26ce1722-9452-4b6c-97bd-d70e8511280e None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:04.353410 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-26ce1722-9452-4b6c-97bd-d70e8511280e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:04.356809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1011/2038] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:32:04.357790 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3e911-f401-4767-8659-c36b35ffd934 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:04.376632 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1028/2039] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:04.382522 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce1722-9452-4b6c-97bd-d70e8511280e None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:04.385732 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-26ce1722-9452-4b6c-97bd-d70e8511280e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:04.388018 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3e911-f401-4767-8659-c36b35ffd934 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:04.405073 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83a2ee-1600-41a0-9827-1abdc1e39893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:04.405954 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83a2ee-1600-41a0-9827-1abdc1e39893 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:04.406476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83a2ee-1600-41a0-9827-1abdc1e39893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:04.406904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83a2ee-1600-41a0-9827-1abdc1e39893 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:04.408018 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83a2ee-1600-41a0-9827-1abdc1e39893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:04.409373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce1722-9452-4b6c-97bd-d70e8511280e None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:04.410411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83a2ee-1600-41a0-9827-1abdc1e39893 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:04.418129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc901cb-9992-4aa4-9db3-d95274873d41 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66fdf17fbbe247ca994de4deae93c531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9ab472fbb1f478caadfcab311437a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:04.418779 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc901cb-9992-4aa4-9db3-d95274873d41 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:04.419132 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc901cb-9992-4aa4-9db3-d95274873d41 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:04.419424 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc901cb-9992-4aa4-9db3-d95274873d41 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:04.420141 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc901cb-9992-4aa4-9db3-d95274873d41 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:04.422218 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc901cb-9992-4aa4-9db3-d95274873d41 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:04.449120 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1012/2040] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:04.450519 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8819a-c2d2-47a5-9048-fa1001d63297 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:04.451095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8819a-c2d2-47a5-9048-fa1001d63297 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:04.451715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8819a-c2d2-47a5-9048-fa1001d63297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:04.467334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1029/2041] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:32:04 2022] POST /identity/v3/projects => generated 353 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:04.471698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc901cb-9992-4aa4-9db3-d95274873d41 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:04.473103 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7cc901cb-9992-4aa4-9db3-d95274873d41 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:04.489347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-09a8819a-c2d2-47a5-9048-fa1001d63297 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:04.491024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-09a8819a-c2d2-47a5-9048-fa1001d63297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:04.540843 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:04.580342 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1013/2042] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:04.582241 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8819a-c2d2-47a5-9048-fa1001d63297 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:04.591579 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc901cb-9992-4aa4-9db3-d95274873d41 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:04.598348 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e1246-d060-47fe-a564-bbce2155e191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:04.599239 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e1246-d060-47fe-a564-bbce2155e191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:04.599586 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e1246-d060-47fe-a564-bbce2155e191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:04.599975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e1246-d060-47fe-a564-bbce2155e191 admin admin] PATH_INFO: `/v3/projects/e4386aad19e046d18b5ff48903e065b2` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:04.601367 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e1246-d060-47fe-a564-bbce2155e191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4386aad19e046d18b5ff48903e065b2)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:04.602002 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8819a-c2d2-47a5-9048-fa1001d63297 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:04.603510 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e1246-d060-47fe-a564-bbce2155e191 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:04.610942 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923f0ed-a346-4045-9111-cb0e3ce552f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:04.612160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923f0ed-a346-4045-9111-cb0e3ce552f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:04.612674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923f0ed-a346-4045-9111-cb0e3ce552f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:04.613217 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923f0ed-a346-4045-9111-cb0e3ce552f6 admin admin] PATH_INFO: `/v3/projects/ad11df05518642c2a17a95fccc691ab7/users/9ffa3a725cf14fe09192222d2d5e7938/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:04.640988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923f0ed-a346-4045-9111-cb0e3ce552f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad11df05518642c2a17a95fccc691ab7, user_id=9ffa3a725cf14fe09192222d2d5e7938, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:04.646081 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923f0ed-a346-4045-9111-cb0e3ce552f6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:04.673001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1014/2043] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:04 2022] PUT /identity/v3/projects/ad11df05518642c2a17a95fccc691ab7/users/9ffa3a725cf14fe09192222d2d5e7938/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:04.675313 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b57e1246-d060-47fe-a564-bbce2155e191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4386aad19e046d18b5ff48903e065b2', 'request_id': 'req-b57e1246-d060-47fe-a564-bbce2155e191'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:04.682496 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923f0ed-a346-4045-9111-cb0e3ce552f6 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:04.691226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b57e1246-d060-47fe-a564-bbce2155e191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4386aad19e046d18b5ff48903e065b2', 'request_id': 'req-b57e1246-d060-47fe-a564-bbce2155e191'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:04.699205 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b57e1246-d060-47fe-a564-bbce2155e191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4386aad19e046d18b5ff48903e065b2', 'request_id': 'req-b57e1246-d060-47fe-a564-bbce2155e191'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:04.712569 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b57e1246-d060-47fe-a564-bbce2155e191 admin admin] The token cache is being invalidate because project e4386aad19e046d18b5ff48903e065b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:04.713013 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b57e1246-d060-47fe-a564-bbce2155e191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:04.714052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b57e1246-d060-47fe-a564-bbce2155e191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:04.716062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1030/2044] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:04 2022] DELETE /identity/v3/projects/e4386aad19e046d18b5ff48903e065b2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:04.716783 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e1246-d060-47fe-a564-bbce2155e191 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:04.718951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b57e1246-d060-47fe-a564-bbce2155e191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:04.775448 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923f0ed-a346-4045-9111-cb0e3ce552f6 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:04.780786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65530ac4-3df7-43dc-ae97-59afcd14f3c9 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66fdf17fbbe247ca994de4deae93c531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9ab472fbb1f478caadfcab311437a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:04.781415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65530ac4-3df7-43dc-ae97-59afcd14f3c9 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:04.781708 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65530ac4-3df7-43dc-ae97-59afcd14f3c9 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:04.782068 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65530ac4-3df7-43dc-ae97-59afcd14f3c9 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:04.782750 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65530ac4-3df7-43dc-ae97-59afcd14f3c9 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:32:04.783068 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65530ac4-3df7-43dc-ae97-59afcd14f3c9 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:04.784755 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65530ac4-3df7-43dc-ae97-59afcd14f3c9 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:04.803414 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1015/2045] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:32:04.803414 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68923aa-e13e-4508-9b3d-0a43f32ee6c8 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:04.803414 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68923aa-e13e-4508-9b3d-0a43f32ee6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:04.803414 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68923aa-e13e-4508-9b3d-0a43f32ee6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:04.844097 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a68923aa-e13e-4508-9b3d-0a43f32ee6c8 None None] MFA Rules not processed for user `9ffa3a725cf14fe09192222d2d5e7938`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:04.845521 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a68923aa-e13e-4508-9b3d-0a43f32ee6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:04.847065 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e1246-d060-47fe-a564-bbce2155e191 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:04.910165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:04.932385 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd20ae-ad22-445e-99b2-cc0680ca17c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:04.933202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd20ae-ad22-445e-99b2-cc0680ca17c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:04.933548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd20ae-ad22-445e-99b2-cc0680ca17c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:04.933901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd20ae-ad22-445e-99b2-cc0680ca17c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:04.934664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd20ae-ad22-445e-99b2-cc0680ca17c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:32:04.935190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd20ae-ad22-445e-99b2-cc0680ca17c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:04.937067 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd20ae-ad22-445e-99b2-cc0680ca17c6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:04.944669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1016/2046] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:04.944669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68923aa-e13e-4508-9b3d-0a43f32ee6c8 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:04.944669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a68923aa-e13e-4508-9b3d-0a43f32ee6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:04.961286 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1031/2047] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:32:04.961815 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68923aa-e13e-4508-9b3d-0a43f32ee6c8 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:04.962433 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd20ae-ad22-445e-99b2-cc0680ca17c6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:04.966255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3bcd20ae-ad22-445e-99b2-cc0680ca17c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:04.970882 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6993e-5203-477b-97a2-e66112afd1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:04.972457 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6993e-5203-477b-97a2-e66112afd1da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:04.972797 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6993e-5203-477b-97a2-e66112afd1da admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:04.973063 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6993e-5203-477b-97a2-e66112afd1da admin admin] PATH_INFO: `/v3/users/f793225984994a24a37a0c5ecceac2d6` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:04.974457 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6993e-5203-477b-97a2-e66112afd1da admin admin] RBAC: Authorizing `identity:delete_user(user_id=f793225984994a24a37a0c5ecceac2d6)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:04.976618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6993e-5203-477b-97a2-e66112afd1da admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:04.980145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:04.996755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd20ae-ad22-445e-99b2-cc0680ca17c6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:05.002077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577479f-fab5-40b7-9f70-bc9c35f7a612 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66fdf17fbbe247ca994de4deae93c531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c9ab472fbb1f478caadfcab311437a5c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:05.002671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577479f-fab5-40b7-9f70-bc9c35f7a612 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:05.002962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577479f-fab5-40b7-9f70-bc9c35f7a612 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:05.003245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577479f-fab5-40b7-9f70-bc9c35f7a612 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] PATH_INFO: `/v3/projects/400bf9416b7144d8924fac6e39ef16ac` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:05.004412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577479f-fab5-40b7-9f70-bc9c35f7a612 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] RBAC: Authorizing `identity:delete_project(project_id=400bf9416b7144d8924fac6e39ef16ac)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:05.006737 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577479f-fab5-40b7-9f70-bc9c35f7a612 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:05.056335 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5bd6993e-5203-477b-97a2-e66112afd1da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f793225984994a24a37a0c5ecceac2d6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:05.056996 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5bd6993e-5203-477b-97a2-e66112afd1da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f793225984994a24a37a0c5ecceac2d6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:05.065565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5bd6993e-5203-477b-97a2-e66112afd1da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f793225984994a24a37a0c5ecceac2d6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:05.066238 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3577479f-fab5-40b7-9f70-bc9c35f7a612 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '400bf9416b7144d8924fac6e39ef16ac', 'request_id': 'req-3577479f-fab5-40b7-9f70-bc9c35f7a612'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:05.066570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5bd6993e-5203-477b-97a2-e66112afd1da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f793225984994a24a37a0c5ecceac2d6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:05.075749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3577479f-fab5-40b7-9f70-bc9c35f7a612 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '400bf9416b7144d8924fac6e39ef16ac', 'request_id': 'req-3577479f-fab5-40b7-9f70-bc9c35f7a612'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:05.078296 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5bd6993e-5203-477b-97a2-e66112afd1da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f793225984994a24a37a0c5ecceac2d6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:05.084193 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3577479f-fab5-40b7-9f70-bc9c35f7a612 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '400bf9416b7144d8924fac6e39ef16ac', 'request_id': 'req-3577479f-fab5-40b7-9f70-bc9c35f7a612'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:05.104645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3577479f-fab5-40b7-9f70-bc9c35f7a612 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] The token cache is being invalidate because project 400bf9416b7144d8924fac6e39ef16ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:05.105377 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3577479f-fab5-40b7-9f70-bc9c35f7a612 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:05.106195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3577479f-fab5-40b7-9f70-bc9c35f7a612 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:05.107782 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1017/2048] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:04 2022] DELETE /identity/v3/users/f793225984994a24a37a0c5ecceac2d6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:05.108877 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6993e-5203-477b-97a2-e66112afd1da admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:05.110269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5bd6993e-5203-477b-97a2-e66112afd1da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:05.112892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1032/2049] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:04 2022] DELETE /identity/v3/projects/400bf9416b7144d8924fac6e39ef16ac => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:05.114281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577479f-fab5-40b7-9f70-bc9c35f7a612 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:05.116477 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3577479f-fab5-40b7-9f70-bc9c35f7a612 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:05.215622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6993e-5203-477b-97a2-e66112afd1da admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:05.225580 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bd677-7c85-478a-9fc4-490d98802865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:05.226236 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bd677-7c85-478a-9fc4-490d98802865 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:05.226696 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bd677-7c85-478a-9fc4-490d98802865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:05.227011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bd677-7c85-478a-9fc4-490d98802865 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:05.228033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bd677-7c85-478a-9fc4-490d98802865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:05.230630 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bd677-7c85-478a-9fc4-490d98802865 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:05.271046 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577479f-fab5-40b7-9f70-bc9c35f7a612 tempest-VolumeQuotaClassesTest-1706761773 tempest-VolumeQuotaClassesTest-1706761773-project-admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:05.281258 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1018/2050] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:32:05 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:05.284251 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353dd50-7160-40bf-8796-a087a039f316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:05.284896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353dd50-7160-40bf-8796-a087a039f316 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:05.285291 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353dd50-7160-40bf-8796-a087a039f316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:05.285524 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353dd50-7160-40bf-8796-a087a039f316 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:05.286257 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353dd50-7160-40bf-8796-a087a039f316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:05.287982 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bd677-7c85-478a-9fc4-490d98802865 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:05.288376 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353dd50-7160-40bf-8796-a087a039f316 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:05.292603 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-233bd677-7c85-478a-9fc4-490d98802865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:05.336162 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1033/2051] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:32:05 2022] POST /identity/v3/projects => generated 375 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:05.337424 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353dd50-7160-40bf-8796-a087a039f316 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:05.431923 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:05.485129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353dd50-7160-40bf-8796-a087a039f316 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:05.492158 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3865c7-4e01-4f4f-8d17-5f2e03801b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:05.492942 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3865c7-4e01-4f4f-8d17-5f2e03801b4e admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:05.493369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3865c7-4e01-4f4f-8d17-5f2e03801b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:05.494216 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3865c7-4e01-4f4f-8d17-5f2e03801b4e admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:05.494449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3865c7-4e01-4f4f-8d17-5f2e03801b4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:05.496906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3865c7-4e01-4f4f-8d17-5f2e03801b4e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:05.501578 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bd677-7c85-478a-9fc4-490d98802865 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:05.511110 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2913be4-b631-4031-9801-c0ab7011388b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:05.512650 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2913be4-b631-4031-9801-c0ab7011388b admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:05.513031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2913be4-b631-4031-9801-c0ab7011388b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:05.513274 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2913be4-b631-4031-9801-c0ab7011388b admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:05.514092 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2913be4-b631-4031-9801-c0ab7011388b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:05.516676 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2913be4-b631-4031-9801-c0ab7011388b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:05.525241 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:05.540818 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1034/2052] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:32:05 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:05.540818 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3865c7-4e01-4f4f-8d17-5f2e03801b4e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:05.544468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1019/2053] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:32:05 2022] POST /identity/v3/users => generated 290 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:05.545770 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2913be4-b631-4031-9801-c0ab7011388b admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:05.549771 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-aa3865c7-4e01-4f4f-8d17-5f2e03801b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:05.559876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2913be4-b631-4031-9801-c0ab7011388b admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:05.567119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3865c7-4e01-4f4f-8d17-5f2e03801b4e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:05.569242 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fab0ef-7ea9-4eb8-adf3-14563dfda6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:05.570070 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fab0ef-7ea9-4eb8-adf3-14563dfda6ac admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:05.570947 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fab0ef-7ea9-4eb8-adf3-14563dfda6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:05.571269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fab0ef-7ea9-4eb8-adf3-14563dfda6ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:05.572485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fab0ef-7ea9-4eb8-adf3-14563dfda6ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:05.576127 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fab0ef-7ea9-4eb8-adf3-14563dfda6ac admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:05.580323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33c99b-3ae8-402f-a8a7-f3feff5ababe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:05.581889 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33c99b-3ae8-402f-a8a7-f3feff5ababe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:05.582213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33c99b-3ae8-402f-a8a7-f3feff5ababe admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:05.582490 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33c99b-3ae8-402f-a8a7-f3feff5ababe admin admin] PATH_INFO: `/v3/users/1cb5127c0d2b4ca7aebe599b2cd7e83f` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:05.585563 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33c99b-3ae8-402f-a8a7-f3feff5ababe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cb5127c0d2b4ca7aebe599b2cd7e83f)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:05.589479 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33c99b-3ae8-402f-a8a7-f3feff5ababe admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:05.589878 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1020/2054] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:05.594080 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fab0ef-7ea9-4eb8-adf3-14563dfda6ac admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:05.605884 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fab0ef-7ea9-4eb8-adf3-14563dfda6ac admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:05.611564 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491ec76-a630-43d2-a86b-7b9247ec2344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:05.612855 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491ec76-a630-43d2-a86b-7b9247ec2344 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:05.613203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491ec76-a630-43d2-a86b-7b9247ec2344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:05.613450 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491ec76-a630-43d2-a86b-7b9247ec2344 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:05.614049 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491ec76-a630-43d2-a86b-7b9247ec2344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:05.615762 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491ec76-a630-43d2-a86b-7b9247ec2344 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:05.627885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1021/2055] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:05.631862 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491ec76-a630-43d2-a86b-7b9247ec2344 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:05.649711 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491ec76-a630-43d2-a86b-7b9247ec2344 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:05.658366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506b67c-41de-41df-81ae-4d1ebcbccddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:05.660193 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506b67c-41de-41df-81ae-4d1ebcbccddf admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:05.660799 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506b67c-41de-41df-81ae-4d1ebcbccddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:05.661311 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506b67c-41de-41df-81ae-4d1ebcbccddf admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:05.662115 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506b67c-41de-41df-81ae-4d1ebcbccddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:05.664189 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506b67c-41de-41df-81ae-4d1ebcbccddf admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:05.685443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1022/2056] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:05.686853 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506b67c-41de-41df-81ae-4d1ebcbccddf admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:05.692836 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ab33c99b-3ae8-402f-a8a7-f3feff5ababe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cb5127c0d2b4ca7aebe599b2cd7e83f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:05.693817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ab33c99b-3ae8-402f-a8a7-f3feff5ababe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cb5127c0d2b4ca7aebe599b2cd7e83f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:05.703884 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ab33c99b-3ae8-402f-a8a7-f3feff5ababe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cb5127c0d2b4ca7aebe599b2cd7e83f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:05.704831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ab33c99b-3ae8-402f-a8a7-f3feff5ababe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cb5127c0d2b4ca7aebe599b2cd7e83f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:05.712000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506b67c-41de-41df-81ae-4d1ebcbccddf admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:05.722310 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314c5a2-27a5-45a9-a933-1e482081e9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:05.723146 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314c5a2-27a5-45a9-a933-1e482081e9ff admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:05.723441 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314c5a2-27a5-45a9-a933-1e482081e9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:05.723720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314c5a2-27a5-45a9-a933-1e482081e9ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:05.724410 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314c5a2-27a5-45a9-a933-1e482081e9ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:05.724971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ab33c99b-3ae8-402f-a8a7-f3feff5ababe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cb5127c0d2b4ca7aebe599b2cd7e83f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:05.726186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314c5a2-27a5-45a9-a933-1e482081e9ff admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:05.748018 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1035/2057] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:05 2022] DELETE /identity/v3/users/1cb5127c0d2b4ca7aebe599b2cd7e83f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:05.749122 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1023/2058] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:05.750032 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314c5a2-27a5-45a9-a933-1e482081e9ff admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:05.750862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33c99b-3ae8-402f-a8a7-f3feff5ababe admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:05.752384 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7314c5a2-27a5-45a9-a933-1e482081e9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:05.754725 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ab33c99b-3ae8-402f-a8a7-f3feff5ababe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:05.768960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314c5a2-27a5-45a9-a933-1e482081e9ff admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:05.850108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33c99b-3ae8-402f-a8a7-f3feff5ababe admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:05.854233 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c05e95-8858-4f0b-9f26-45fb433b8251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:05.854908 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c05e95-8858-4f0b-9f26-45fb433b8251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:05.855203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c05e95-8858-4f0b-9f26-45fb433b8251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:05.855486 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c05e95-8858-4f0b-9f26-45fb433b8251 admin admin] PATH_INFO: `/v3/projects/4d3b16f733e14956b4992442300a141d` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:05.855857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9e1b7-2c0b-4a43-929e-f861f6211804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:05.856677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9e1b7-2c0b-4a43-929e-f861f6211804 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:05.856842 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c05e95-8858-4f0b-9f26-45fb433b8251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d3b16f733e14956b4992442300a141d)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:05.857148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9e1b7-2c0b-4a43-929e-f861f6211804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:05.857437 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9e1b7-2c0b-4a43-929e-f861f6211804 admin admin] PATH_INFO: `/v3/projects/a7a59487ad6a49d5b186d4a579c29bde/users/4970946a1ad94282a5d895b293fe8b5a/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:05.859418 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c05e95-8858-4f0b-9f26-45fb433b8251 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:05.874508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9e1b7-2c0b-4a43-929e-f861f6211804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a59487ad6a49d5b186d4a579c29bde, user_id=4970946a1ad94282a5d895b293fe8b5a, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:05.877332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9e1b7-2c0b-4a43-929e-f861f6211804 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:05.902415 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1036/2059] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:05 2022] PUT /identity/v3/projects/a7a59487ad6a49d5b186d4a579c29bde/users/4970946a1ad94282a5d895b293fe8b5a/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:05.902415 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246d597-aec9-41e0-a782-580328df9042 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:05.902415 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246d597-aec9-41e0-a782-580328df9042 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:05.902415 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246d597-aec9-41e0-a782-580328df9042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:05.918516 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4246d597-aec9-41e0-a782-580328df9042 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:05.919958 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4246d597-aec9-41e0-a782-580328df9042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:05.932477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c3c05e95-8858-4f0b-9f26-45fb433b8251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d3b16f733e14956b4992442300a141d', 'request_id': 'req-c3c05e95-8858-4f0b-9f26-45fb433b8251'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:05.939716 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c3c05e95-8858-4f0b-9f26-45fb433b8251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d3b16f733e14956b4992442300a141d', 'request_id': 'req-c3c05e95-8858-4f0b-9f26-45fb433b8251'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:05.951283 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c3c05e95-8858-4f0b-9f26-45fb433b8251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d3b16f733e14956b4992442300a141d', 'request_id': 'req-c3c05e95-8858-4f0b-9f26-45fb433b8251'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:05.968782 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c3c05e95-8858-4f0b-9f26-45fb433b8251 admin admin] The token cache is being invalidate because project 4d3b16f733e14956b4992442300a141d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:05.969510 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c3c05e95-8858-4f0b-9f26-45fb433b8251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:05.970456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c3c05e95-8858-4f0b-9f26-45fb433b8251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:05.973364 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1024/2060] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:05 2022] DELETE /identity/v3/projects/4d3b16f733e14956b4992442300a141d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:05.974489 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c05e95-8858-4f0b-9f26-45fb433b8251 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:05.976360 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c3c05e95-8858-4f0b-9f26-45fb433b8251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:05.997900 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:06.013363 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:06.019583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1037/2061] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:06.021533 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161d180-7e15-4811-b296-22ec6c8a94bf None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:06.022006 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161d180-7e15-4811-b296-22ec6c8a94bf None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:06.022489 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161d180-7e15-4811-b296-22ec6c8a94bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:06.066863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b161d180-7e15-4811-b296-22ec6c8a94bf None None] MFA Rules not processed for user `4970946a1ad94282a5d895b293fe8b5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:06.068526 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b161d180-7e15-4811-b296-22ec6c8a94bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:06.121743 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c05e95-8858-4f0b-9f26-45fb433b8251 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:06.131235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c88b9-ff6d-4156-90a9-028192786b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:06.132403 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c88b9-ff6d-4156-90a9-028192786b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:06.133548 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c88b9-ff6d-4156-90a9-028192786b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:06.133548 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c88b9-ff6d-4156-90a9-028192786b7e admin admin] PATH_INFO: `/v3/projects/cffd6364d87445339a06644def679383/users/a4d1e98338864119a82f864309d8fd5a/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:06.166290 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1038/2062] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:06.166790 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c88b9-ff6d-4156-90a9-028192786b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cffd6364d87445339a06644def679383, user_id=a4d1e98338864119a82f864309d8fd5a, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:06.166907 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161d180-7e15-4811-b296-22ec6c8a94bf None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:06.168605 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b161d180-7e15-4811-b296-22ec6c8a94bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:06.169775 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c88b9-ff6d-4156-90a9-028192786b7e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:06.186299 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161d180-7e15-4811-b296-22ec6c8a94bf None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:06.193772 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1025/2063] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:05 2022] PUT /identity/v3/projects/cffd6364d87445339a06644def679383/users/a4d1e98338864119a82f864309d8fd5a/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:06.195256 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c88b9-ff6d-4156-90a9-028192786b7e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:06.197523 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ad4c88b9-ff6d-4156-90a9-028192786b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:06.281519 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c88b9-ff6d-4156-90a9-028192786b7e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:06.282758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932c031-58a7-4e84-9c9b-64449a5237ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:06.284198 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932c031-58a7-4e84-9c9b-64449a5237ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:06.284790 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932c031-58a7-4e84-9c9b-64449a5237ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:06.285245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932c031-58a7-4e84-9c9b-64449a5237ed admin admin] PATH_INFO: `/v3/users/77ba294e1ec0411cafad0f2f83e27074` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:06.287185 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559930a8-c294-4daa-8f4c-729bf24de2ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:06.287526 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932c031-58a7-4e84-9c9b-64449a5237ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ba294e1ec0411cafad0f2f83e27074)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:06.288820 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559930a8-c294-4daa-8f4c-729bf24de2ae service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:06.289404 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559930a8-c294-4daa-8f4c-729bf24de2ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:06.289996 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559930a8-c294-4daa-8f4c-729bf24de2ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:06.291148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932c031-58a7-4e84-9c9b-64449a5237ed admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:06.304200 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559930a8-c294-4daa-8f4c-729bf24de2ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:06.306559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559930a8-c294-4daa-8f4c-729bf24de2ae service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:06.320356 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1026/2064] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:06.321574 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559930a8-c294-4daa-8f4c-729bf24de2ae service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:06.323467 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-559930a8-c294-4daa-8f4c-729bf24de2ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:06.392605 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4932c031-58a7-4e84-9c9b-64449a5237ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ba294e1ec0411cafad0f2f83e27074'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:06.394362 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4932c031-58a7-4e84-9c9b-64449a5237ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ba294e1ec0411cafad0f2f83e27074'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:06.396178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559930a8-c294-4daa-8f4c-729bf24de2ae service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:06.403316 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b5fd5-a39b-4728-a371-19a040c2b7d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:06.404262 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b5fd5-a39b-4728-a371-19a040c2b7d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:06.404883 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b5fd5-a39b-4728-a371-19a040c2b7d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:06.405308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b5fd5-a39b-4728-a371-19a040c2b7d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:06.407930 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c82b5fd5-a39b-4728-a371-19a040c2b7d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:06.411648 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4932c031-58a7-4e84-9c9b-64449a5237ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ba294e1ec0411cafad0f2f83e27074'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:06.412463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4932c031-58a7-4e84-9c9b-64449a5237ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ba294e1ec0411cafad0f2f83e27074'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:06.442771 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4932c031-58a7-4e84-9c9b-64449a5237ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ba294e1ec0411cafad0f2f83e27074'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:06.466746 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1039/2065] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:06 2022] DELETE /identity/v3/users/77ba294e1ec0411cafad0f2f83e27074 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:06.468448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce61a0-22a4-4d11-97da-dbb9d85a0cc3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:06.468957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce61a0-22a4-4d11-97da-dbb9d85a0cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:06.470173 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce61a0-22a4-4d11-97da-dbb9d85a0cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:06.481600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:06.535560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bbce61a0-22a4-4d11-97da-dbb9d85a0cc3 None None] MFA Rules not processed for user `a4d1e98338864119a82f864309d8fd5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:06.537195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bbce61a0-22a4-4d11-97da-dbb9d85a0cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:06.575656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b5fd5-a39b-4728-a371-19a040c2b7d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:06.578038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b5fd5-a39b-4728-a371-19a040c2b7d7 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:06.610903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:06.642251 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1027/2066] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:06.676139 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b5fd5-a39b-4728-a371-19a040c2b7d7 service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:06.678023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c82b5fd5-a39b-4728-a371-19a040c2b7d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:06.698419 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1040/2067] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:06.702778 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce61a0-22a4-4d11-97da-dbb9d85a0cc3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:06.704418 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b5fd5-a39b-4728-a371-19a040c2b7d7 service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:06.706078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bbce61a0-22a4-4d11-97da-dbb9d85a0cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:06.875950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d75625-5b0d-41ca-8889-28f68ec70407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:06.879315 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d75625-5b0d-41ca-8889-28f68ec70407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:06.879718 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d75625-5b0d-41ca-8889-28f68ec70407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:06.880147 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d75625-5b0d-41ca-8889-28f68ec70407 admin admin] PATH_INFO: `/v3/users/13924a87d9d64a66a57ce76ae61421c2` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:06.882162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d75625-5b0d-41ca-8889-28f68ec70407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13924a87d9d64a66a57ce76ae61421c2)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:06.888384 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d75625-5b0d-41ca-8889-28f68ec70407 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:06.919593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce61a0-22a4-4d11-97da-dbb9d85a0cc3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:06.934386 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0666b0-5f4f-4c40-885b-743d094b0357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:06.935801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0666b0-5f4f-4c40-885b-743d094b0357 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:06.936101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0666b0-5f4f-4c40-885b-743d094b0357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:06.936833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0666b0-5f4f-4c40-885b-743d094b0357 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:06.938509 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0666b0-5f4f-4c40-885b-743d094b0357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:06.943320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0666b0-5f4f-4c40-885b-743d094b0357 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:07.010326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1041/2068] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:32:06 2022] POST /identity/v3/projects => generated 379 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:07.016089 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0666b0-5f4f-4c40-885b-743d094b0357 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:07.091676 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-92d75625-5b0d-41ca-8889-28f68ec70407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13924a87d9d64a66a57ce76ae61421c2'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:07.093905 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-92d75625-5b0d-41ca-8889-28f68ec70407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13924a87d9d64a66a57ce76ae61421c2'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:07.115591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0666b0-5f4f-4c40-885b-743d094b0357 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:07.123146 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887a0d3-1a61-4487-b45e-ffbcc1999562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:07.124242 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887a0d3-1a61-4487-b45e-ffbcc1999562 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:07.124355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887a0d3-1a61-4487-b45e-ffbcc1999562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:07.124976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887a0d3-1a61-4487-b45e-ffbcc1999562 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:07.125847 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887a0d3-1a61-4487-b45e-ffbcc1999562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:07.128584 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887a0d3-1a61-4487-b45e-ffbcc1999562 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:07.138374 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-92d75625-5b0d-41ca-8889-28f68ec70407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13924a87d9d64a66a57ce76ae61421c2'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:07.139195 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-92d75625-5b0d-41ca-8889-28f68ec70407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13924a87d9d64a66a57ce76ae61421c2'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:07.150811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-92d75625-5b0d-41ca-8889-28f68ec70407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13924a87d9d64a66a57ce76ae61421c2'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:07.182446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1042/2069] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:32:07 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:07.185613 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887a0d3-1a61-4487-b45e-ffbcc1999562 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:07.189648 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0887a0d3-1a61-4487-b45e-ffbcc1999562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:07.197911 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1028/2070] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:06 2022] DELETE /identity/v3/users/13924a87d9d64a66a57ce76ae61421c2 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:07.199061 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d75625-5b0d-41ca-8889-28f68ec70407 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:07.202405 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-92d75625-5b0d-41ca-8889-28f68ec70407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:07.241066 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887a0d3-1a61-4487-b45e-ffbcc1999562 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:07.249132 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:07.332166 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d75625-5b0d-41ca-8889-28f68ec70407 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:07.338613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52badcb6-0ee9-4a3b-968e-e0f9e43ef8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:07.339240 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52badcb6-0ee9-4a3b-968e-e0f9e43ef8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:07.339599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52badcb6-0ee9-4a3b-968e-e0f9e43ef8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:07.339952 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52badcb6-0ee9-4a3b-968e-e0f9e43ef8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:07.340724 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52badcb6-0ee9-4a3b-968e-e0f9e43ef8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:07.342466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52badcb6-0ee9-4a3b-968e-e0f9e43ef8d1 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:07.358996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84a3f0-34ac-4fd4-b24d-be416aef7d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:07.359737 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84a3f0-34ac-4fd4-b24d-be416aef7d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:07.360095 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84a3f0-34ac-4fd4-b24d-be416aef7d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:07.360471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84a3f0-34ac-4fd4-b24d-be416aef7d58 admin admin] PATH_INFO: `/v3/projects/abe79d4ff11543ea86840153bfbb84d5` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:07.362276 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84a3f0-34ac-4fd4-b24d-be416aef7d58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abe79d4ff11543ea86840153bfbb84d5)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:07.364473 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84a3f0-34ac-4fd4-b24d-be416aef7d58 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:07.369748 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1029/2071] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:07.369748 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f6d9d-0a1d-4b82-b444-a66e6b43d12a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:07.370215 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f6d9d-0a1d-4b82-b444-a66e6b43d12a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:07.370838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f6d9d-0a1d-4b82-b444-a66e6b43d12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:07.406035 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-370f6d9d-0a1d-4b82-b444-a66e6b43d12a None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:07.407488 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-370f6d9d-0a1d-4b82-b444-a66e6b43d12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:07.419779 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1030/2072] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:07.421424 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f6d9d-0a1d-4b82-b444-a66e6b43d12a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:07.422788 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-370f6d9d-0a1d-4b82-b444-a66e6b43d12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:07.434739 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6d84a3f0-34ac-4fd4-b24d-be416aef7d58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abe79d4ff11543ea86840153bfbb84d5', 'request_id': 'req-6d84a3f0-34ac-4fd4-b24d-be416aef7d58'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:07.436600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f6d9d-0a1d-4b82-b444-a66e6b43d12a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:07.442149 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:07.443720 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6d84a3f0-34ac-4fd4-b24d-be416aef7d58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abe79d4ff11543ea86840153bfbb84d5', 'request_id': 'req-6d84a3f0-34ac-4fd4-b24d-be416aef7d58'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:07.450118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6d84a3f0-34ac-4fd4-b24d-be416aef7d58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abe79d4ff11543ea86840153bfbb84d5', 'request_id': 'req-6d84a3f0-34ac-4fd4-b24d-be416aef7d58'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:07.465226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6d84a3f0-34ac-4fd4-b24d-be416aef7d58 admin admin] The token cache is being invalidate because project abe79d4ff11543ea86840153bfbb84d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:07.465520 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6d84a3f0-34ac-4fd4-b24d-be416aef7d58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:07.466271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6d84a3f0-34ac-4fd4-b24d-be416aef7d58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:07.467790 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1043/2073] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:07 2022] DELETE /identity/v3/projects/abe79d4ff11543ea86840153bfbb84d5 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:07.468560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84a3f0-34ac-4fd4-b24d-be416aef7d58 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:07.470158 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6d84a3f0-34ac-4fd4-b24d-be416aef7d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:07.511805 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3cbc5-e913-4013-a133-6e9004cd462c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:07.511805 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3cbc5-e913-4013-a133-6e9004cd462c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:07.511805 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3cbc5-e913-4013-a133-6e9004cd462c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:07.512181 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3cbc5-e913-4013-a133-6e9004cd462c admin admin] PATH_INFO: `/v3/projects/575db5e1fb5742ab810da8d93f7ae6e4` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:07.513147 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3cbc5-e913-4013-a133-6e9004cd462c admin admin] RBAC: Authorizing `identity:delete_project(project_id=575db5e1fb5742ab810da8d93f7ae6e4)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:07.515082 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3cbc5-e913-4013-a133-6e9004cd462c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:07.541860 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84a3f0-34ac-4fd4-b24d-be416aef7d58 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:07.547750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990c884-c184-4761-9c2d-82bd3d223c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:07.548531 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990c884-c184-4761-9c2d-82bd3d223c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:07.548998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990c884-c184-4761-9c2d-82bd3d223c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:07.549833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990c884-c184-4761-9c2d-82bd3d223c15 admin admin] PATH_INFO: `/v3/projects/49f33a147aaf4acfbe4460ef86a8f757/users/ea9eb0b0b654476a9d8a4bbbf4fdaf6d/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:07.569747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990c884-c184-4761-9c2d-82bd3d223c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49f33a147aaf4acfbe4460ef86a8f757, user_id=ea9eb0b0b654476a9d8a4bbbf4fdaf6d, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:07.572439 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990c884-c184-4761-9c2d-82bd3d223c15 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:07.573356 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7bb3cbc5-e913-4013-a133-6e9004cd462c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '575db5e1fb5742ab810da8d93f7ae6e4', 'request_id': 'req-7bb3cbc5-e913-4013-a133-6e9004cd462c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:07.582045 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7bb3cbc5-e913-4013-a133-6e9004cd462c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '575db5e1fb5742ab810da8d93f7ae6e4', 'request_id': 'req-7bb3cbc5-e913-4013-a133-6e9004cd462c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:07.591275 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1044/2074] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:07 2022] PUT /identity/v3/projects/49f33a147aaf4acfbe4460ef86a8f757/users/ea9eb0b0b654476a9d8a4bbbf4fdaf6d/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:07.592599 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990c884-c184-4761-9c2d-82bd3d223c15 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:07.594946 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7990c884-c184-4761-9c2d-82bd3d223c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:07.595485 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7bb3cbc5-e913-4013-a133-6e9004cd462c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '575db5e1fb5742ab810da8d93f7ae6e4', 'request_id': 'req-7bb3cbc5-e913-4013-a133-6e9004cd462c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:07.614368 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7bb3cbc5-e913-4013-a133-6e9004cd462c admin admin] The token cache is being invalidate because project 575db5e1fb5742ab810da8d93f7ae6e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:07.614661 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7bb3cbc5-e913-4013-a133-6e9004cd462c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:07.615345 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7bb3cbc5-e913-4013-a133-6e9004cd462c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:07.617439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1031/2075] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:07 2022] DELETE /identity/v3/projects/575db5e1fb5742ab810da8d93f7ae6e4 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:07.619764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4451075-a42f-497a-9d09-ccf6ef433699 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:07.620673 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4451075-a42f-497a-9d09-ccf6ef433699 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:07.622834 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4451075-a42f-497a-9d09-ccf6ef433699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:07.646010 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:07.650206 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-c4451075-a42f-497a-9d09-ccf6ef433699 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:07.651471 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c4451075-a42f-497a-9d09-ccf6ef433699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:07.703863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990c884-c184-4761-9c2d-82bd3d223c15 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:07.711124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f82a6f-2898-45f6-aa55-f56d4078df27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:07.712018 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f82a6f-2898-45f6-aa55-f56d4078df27 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:07.712492 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f82a6f-2898-45f6-aa55-f56d4078df27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:07.712927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f82a6f-2898-45f6-aa55-f56d4078df27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:07.714873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f9f82a6f-2898-45f6-aa55-f56d4078df27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:07.722175 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1032/2076] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:07.724069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4451075-a42f-497a-9d09-ccf6ef433699 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:07.725489 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c4451075-a42f-497a-9d09-ccf6ef433699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:07.739239 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4451075-a42f-497a-9d09-ccf6ef433699 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:07.742624 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f82a6f-2898-45f6-aa55-f56d4078df27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:07.743881 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f82a6f-2898-45f6-aa55-f56d4078df27 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:07.745604 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74661ea5-35b4-4deb-b340-c76ee0530bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:07.746393 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74661ea5-35b4-4deb-b340-c76ee0530bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:07.746618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74661ea5-35b4-4deb-b340-c76ee0530bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:07.746884 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74661ea5-35b4-4deb-b340-c76ee0530bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:07.747721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74661ea5-35b4-4deb-b340-c76ee0530bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:07.749625 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74661ea5-35b4-4deb-b340-c76ee0530bb9 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:07.763272 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1045/2077] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:07.764103 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f82a6f-2898-45f6-aa55-f56d4078df27 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:07.765608 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f9f82a6f-2898-45f6-aa55-f56d4078df27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:07.774941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1033/2078] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:07.776592 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639bfc4-6405-4b2f-a0bf-73b7ed10ab0b None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:07.776894 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639bfc4-6405-4b2f-a0bf-73b7ed10ab0b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:07.777174 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639bfc4-6405-4b2f-a0bf-73b7ed10ab0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:07.783946 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f82a6f-2898-45f6-aa55-f56d4078df27 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:07.795658 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126b158-b5af-41bd-9931-f91afa84b079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:07.796324 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126b158-b5af-41bd-9931-f91afa84b079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:07.796601 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126b158-b5af-41bd-9931-f91afa84b079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:07.796912 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126b158-b5af-41bd-9931-f91afa84b079 admin admin] PATH_INFO: `/v3/users/66fdf17fbbe247ca994de4deae93c531` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:07.799031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126b158-b5af-41bd-9931-f91afa84b079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66fdf17fbbe247ca994de4deae93c531)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:07.801717 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126b158-b5af-41bd-9931-f91afa84b079 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:07.805718 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-8639bfc4-6405-4b2f-a0bf-73b7ed10ab0b None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:07.808161 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8639bfc4-6405-4b2f-a0bf-73b7ed10ab0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:07.825769 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1034/2079] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:07.827083 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639bfc4-6405-4b2f-a0bf-73b7ed10ab0b None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:07.842084 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639bfc4-6405-4b2f-a0bf-73b7ed10ab0b None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:07.851569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a731a-c8f1-41fe-a91f-4d124c271103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:07.852995 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a731a-c8f1-41fe-a91f-4d124c271103 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:07.853261 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a731a-c8f1-41fe-a91f-4d124c271103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:07.853558 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a731a-c8f1-41fe-a91f-4d124c271103 admin admin] PATH_INFO: `/v3/projects/49f33a147aaf4acfbe4460ef86a8f757/users/ea9eb0b0b654476a9d8a4bbbf4fdaf6d/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:07.857240 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a731a-c8f1-41fe-a91f-4d124c271103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49f33a147aaf4acfbe4460ef86a8f757, user_id=ea9eb0b0b654476a9d8a4bbbf4fdaf6d, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:07.860319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a731a-c8f1-41fe-a91f-4d124c271103 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:07.876146 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1035/2080] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:07 2022] PUT /identity/v3/projects/49f33a147aaf4acfbe4460ef86a8f757/users/ea9eb0b0b654476a9d8a4bbbf4fdaf6d/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:07.877804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a731a-c8f1-41fe-a91f-4d124c271103 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:07.892096 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1126b158-b5af-41bd-9931-f91afa84b079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66fdf17fbbe247ca994de4deae93c531'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:07.893700 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1126b158-b5af-41bd-9931-f91afa84b079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66fdf17fbbe247ca994de4deae93c531'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:07.900429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:07.902448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1126b158-b5af-41bd-9931-f91afa84b079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66fdf17fbbe247ca994de4deae93c531'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:07.903212 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1126b158-b5af-41bd-9931-f91afa84b079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66fdf17fbbe247ca994de4deae93c531'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:07.921747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1126b158-b5af-41bd-9931-f91afa84b079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66fdf17fbbe247ca994de4deae93c531'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:07.938053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1046/2081] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:07 2022] DELETE /identity/v3/users/66fdf17fbbe247ca994de4deae93c531 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:07.941366 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f360da-095d-4b26-b3f0-8d5e1d512d46 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:07.944706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f360da-095d-4b26-b3f0-8d5e1d512d46 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:07.945246 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f360da-095d-4b26-b3f0-8d5e1d512d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:07.969026 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a731a-c8f1-41fe-a91f-4d124c271103 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:07.989275 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d1f360da-095d-4b26-b3f0-8d5e1d512d46 None None] MFA Rules not processed for user `ea9eb0b0b654476a9d8a4bbbf4fdaf6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:07.990885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d1f360da-095d-4b26-b3f0-8d5e1d512d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:08.098912 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1047/2082] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:07 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:08.105844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da555423-8975-4aad-9055-db33e23894c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:08.108544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da555423-8975-4aad-9055-db33e23894c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:08.108880 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da555423-8975-4aad-9055-db33e23894c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:08.109168 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da555423-8975-4aad-9055-db33e23894c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:08.109924 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f360da-095d-4b26-b3f0-8d5e1d512d46 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:08.110587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da555423-8975-4aad-9055-db33e23894c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:32:08.110906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da555423-8975-4aad-9055-db33e23894c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:08.113147 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da555423-8975-4aad-9055-db33e23894c8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:08.114150 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d1f360da-095d-4b26-b3f0-8d5e1d512d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:08.135668 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1036/2083] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:32:08.141259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da555423-8975-4aad-9055-db33e23894c8 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:08.143370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-da555423-8975-4aad-9055-db33e23894c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:08.171576 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:08.176783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da555423-8975-4aad-9055-db33e23894c8 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:08.196337 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0e332-b80b-4965-8e62-ea255145b30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:08.197583 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0e332-b80b-4965-8e62-ea255145b30b admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:08.197713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0e332-b80b-4965-8e62-ea255145b30b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:08.198865 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0e332-b80b-4965-8e62-ea255145b30b admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:08.200295 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0e332-b80b-4965-8e62-ea255145b30b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:08.202469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f0e332-b80b-4965-8e62-ea255145b30b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:08.243354 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f360da-095d-4b26-b3f0-8d5e1d512d46 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:08.248071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f6e3f-79d5-4a93-b0a4-affe459ce28f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:08.249091 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f6e3f-79d5-4a93-b0a4-affe459ce28f service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:08.249272 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f6e3f-79d5-4a93-b0a4-affe459ce28f service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:08.249576 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f6e3f-79d5-4a93-b0a4-affe459ce28f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:08.263638 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1037/2084] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:32:08 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:08.263638 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0e332-b80b-4965-8e62-ea255145b30b admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:08.263887 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f6e3f-79d5-4a93-b0a4-affe459ce28f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:08.263969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-67f0e332-b80b-4965-8e62-ea255145b30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:08.264760 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f6e3f-79d5-4a93-b0a4-affe459ce28f service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:08.278226 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1048/2085] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:08 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:08.279404 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f6e3f-79d5-4a93-b0a4-affe459ce28f service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:08.293069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f6e3f-79d5-4a93-b0a4-affe459ce28f service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:08.347140 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0e332-b80b-4965-8e62-ea255145b30b admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:08.358193 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbda8f6-a174-4297-a8fa-4df401ebd03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:08.358430 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbda8f6-a174-4297-a8fa-4df401ebd03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:08.358712 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbda8f6-a174-4297-a8fa-4df401ebd03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:08.359004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbda8f6-a174-4297-a8fa-4df401ebd03d admin admin] PATH_INFO: `/v3/projects/d5b225900ee6421781bf6f7e425490c0` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:08.360914 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbda8f6-a174-4297-a8fa-4df401ebd03d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b225900ee6421781bf6f7e425490c0)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:08.363029 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbda8f6-a174-4297-a8fa-4df401ebd03d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:08.379910 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55be54-6569-4f14-bd69-fabf5b32f52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:08.380537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55be54-6569-4f14-bd69-fabf5b32f52f admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:08.380882 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55be54-6569-4f14-bd69-fabf5b32f52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:08.381161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55be54-6569-4f14-bd69-fabf5b32f52f admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:08.381853 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55be54-6569-4f14-bd69-fabf5b32f52f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:08.384111 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55be54-6569-4f14-bd69-fabf5b32f52f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:08.419132 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1049/2086] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:32:08 2022] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:08.422142 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55be54-6569-4f14-bd69-fabf5b32f52f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:08.452411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:08.494265 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-9fbda8f6-a174-4297-a8fa-4df401ebd03d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b225900ee6421781bf6f7e425490c0', 'request_id': 'req-9fbda8f6-a174-4297-a8fa-4df401ebd03d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:08.511095 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55be54-6569-4f14-bd69-fabf5b32f52f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:08.526568 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-9fbda8f6-a174-4297-a8fa-4df401ebd03d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b225900ee6421781bf6f7e425490c0', 'request_id': 'req-9fbda8f6-a174-4297-a8fa-4df401ebd03d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:08.540567 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-9fbda8f6-a174-4297-a8fa-4df401ebd03d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b225900ee6421781bf6f7e425490c0', 'request_id': 'req-9fbda8f6-a174-4297-a8fa-4df401ebd03d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:08.561024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-9fbda8f6-a174-4297-a8fa-4df401ebd03d admin admin] The token cache is being invalidate because project d5b225900ee6421781bf6f7e425490c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:08.561222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-9fbda8f6-a174-4297-a8fa-4df401ebd03d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:08.561923 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-9fbda8f6-a174-4297-a8fa-4df401ebd03d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:08.563859 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1038/2087] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:08 2022] DELETE /identity/v3/projects/d5b225900ee6421781bf6f7e425490c0 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:08.565267 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbda8f6-a174-4297-a8fa-4df401ebd03d admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:08.567024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9fbda8f6-a174-4297-a8fa-4df401ebd03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:08.576429 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea5142-c769-40a5-bf38-e6e92bfc1847 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:08.577094 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea5142-c769-40a5-bf38-e6e92bfc1847 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:08.577703 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea5142-c769-40a5-bf38-e6e92bfc1847 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:08.577703 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea5142-c769-40a5-bf38-e6e92bfc1847 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:08.579664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-91ea5142-c769-40a5-bf38-e6e92bfc1847 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:08.608976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:08.662658 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea5142-c769-40a5-bf38-e6e92bfc1847 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:08.664113 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea5142-c769-40a5-bf38-e6e92bfc1847 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:08.664342 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbda8f6-a174-4297-a8fa-4df401ebd03d admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:08.672811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b36887-16a8-42ad-990d-0d3775d6adf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:08.673442 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b36887-16a8-42ad-990d-0d3775d6adf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:08.673721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b36887-16a8-42ad-990d-0d3775d6adf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:08.673995 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b36887-16a8-42ad-990d-0d3775d6adf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:08.675211 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b36887-16a8-42ad-990d-0d3775d6adf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:08.676505 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b36887-16a8-42ad-990d-0d3775d6adf9 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:08.681391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1050/2088] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:08.686580 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea5142-c769-40a5-bf38-e6e92bfc1847 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:08.686580 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-91ea5142-c769-40a5-bf38-e6e92bfc1847 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:08.692976 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1039/2089] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:08.695621 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28839a0-ef98-423a-a096-56e274041462 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:08.696131 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28839a0-ef98-423a-a096-56e274041462 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:08.696413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28839a0-ef98-423a-a096-56e274041462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:08.698544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea5142-c769-40a5-bf38-e6e92bfc1847 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:08.704024 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67942c8b-0a3e-45b2-850e-8dbcd898b7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:08.704664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67942c8b-0a3e-45b2-850e-8dbcd898b7e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:08.705135 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67942c8b-0a3e-45b2-850e-8dbcd898b7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:08.706165 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67942c8b-0a3e-45b2-850e-8dbcd898b7e8 admin admin] PATH_INFO: `/v3/projects/c9ab472fbb1f478caadfcab311437a5c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:08.707515 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67942c8b-0a3e-45b2-850e-8dbcd898b7e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9ab472fbb1f478caadfcab311437a5c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:08.709730 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67942c8b-0a3e-45b2-850e-8dbcd898b7e8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:08.725227 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e28839a0-ef98-423a-a096-56e274041462 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:08.726477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e28839a0-ef98-423a-a096-56e274041462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:08.736399 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1040/2090] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:08.737727 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28839a0-ef98-423a-a096-56e274041462 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:08.751884 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28839a0-ef98-423a-a096-56e274041462 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:08.768413 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-67942c8b-0a3e-45b2-850e-8dbcd898b7e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ab472fbb1f478caadfcab311437a5c', 'request_id': 'req-67942c8b-0a3e-45b2-850e-8dbcd898b7e8'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:08.785853 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-67942c8b-0a3e-45b2-850e-8dbcd898b7e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ab472fbb1f478caadfcab311437a5c', 'request_id': 'req-67942c8b-0a3e-45b2-850e-8dbcd898b7e8'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:08.793900 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-67942c8b-0a3e-45b2-850e-8dbcd898b7e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ab472fbb1f478caadfcab311437a5c', 'request_id': 'req-67942c8b-0a3e-45b2-850e-8dbcd898b7e8'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:08.810997 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-67942c8b-0a3e-45b2-850e-8dbcd898b7e8 admin admin] The token cache is being invalidate because project c9ab472fbb1f478caadfcab311437a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:08.811307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-67942c8b-0a3e-45b2-850e-8dbcd898b7e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:08.812065 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-67942c8b-0a3e-45b2-850e-8dbcd898b7e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:08.816438 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1051/2091] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:08 2022] DELETE /identity/v3/projects/c9ab472fbb1f478caadfcab311437a5c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:08.818353 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c45be-edcb-49da-b2b1-353aa0b7ed56 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:08.818573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c45be-edcb-49da-b2b1-353aa0b7ed56 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:08.818880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c45be-edcb-49da-b2b1-353aa0b7ed56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:08.860096 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-094c45be-edcb-49da-b2b1-353aa0b7ed56 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:08.863248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-094c45be-edcb-49da-b2b1-353aa0b7ed56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:08.865639 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65197a42-cad5-46dc-860c-aa9d80bd8e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:08.866359 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65197a42-cad5-46dc-860c-aa9d80bd8e60 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:08.866992 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65197a42-cad5-46dc-860c-aa9d80bd8e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:08.867427 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65197a42-cad5-46dc-860c-aa9d80bd8e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:08.868780 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65197a42-cad5-46dc-860c-aa9d80bd8e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:08.871286 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65197a42-cad5-46dc-860c-aa9d80bd8e60 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:08.881629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1052/2092] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:08.881629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9877ee-0fa8-4df6-90fe-b2a9e4372870 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:08.881629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9877ee-0fa8-4df6-90fe-b2a9e4372870 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:08.881629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9877ee-0fa8-4df6-90fe-b2a9e4372870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:08.884659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1041/2093] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:08.885432 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65197a42-cad5-46dc-860c-aa9d80bd8e60 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:08.901604 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65197a42-cad5-46dc-860c-aa9d80bd8e60 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:08.907430 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e67bb-3f16-4379-ab60-9a08882579e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:08.908047 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e67bb-3f16-4379-ab60-9a08882579e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:08.908334 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e67bb-3f16-4379-ab60-9a08882579e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:08.909002 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e67bb-3f16-4379-ab60-9a08882579e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:08.909802 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e67bb-3f16-4379-ab60-9a08882579e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:32:08.910158 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e67bb-3f16-4379-ab60-9a08882579e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:08.911904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e67bb-3f16-4379-ab60-9a08882579e6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:08.912611 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9f9877ee-0fa8-4df6-90fe-b2a9e4372870 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:08.918451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9f9877ee-0fa8-4df6-90fe-b2a9e4372870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:08.935335 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1053/2094] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:08.935335 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9877ee-0fa8-4df6-90fe-b2a9e4372870 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:08.937092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9f9877ee-0fa8-4df6-90fe-b2a9e4372870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:08.942774 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1042/2095] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:32:08.946558 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25e2f1-8390-4aa5-ad67-44dcf3587ad1 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:08.948706 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25e2f1-8390-4aa5-ad67-44dcf3587ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:08.948706 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25e2f1-8390-4aa5-ad67-44dcf3587ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:08.952672 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9877ee-0fa8-4df6-90fe-b2a9e4372870 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:08.960264 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d3112-3429-4938-9514-96602157d430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:08.961617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d3112-3429-4938-9514-96602157d430 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:08.962105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d3112-3429-4938-9514-96602157d430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:08.962579 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d3112-3429-4938-9514-96602157d430 admin admin] PATH_INFO: `/v3/projects/2848d9fd529f486cbd00ffd395ae120a/users/1d12e3ba322845fc97f54765566d76fb/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:08.974052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ea25e2f1-8390-4aa5-ad67-44dcf3587ad1 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:08.975503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ea25e2f1-8390-4aa5-ad67-44dcf3587ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:08.985017 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d3112-3429-4938-9514-96602157d430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2848d9fd529f486cbd00ffd395ae120a, user_id=1d12e3ba322845fc97f54765566d76fb, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:08.989148 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1043/2096] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:08.990430 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25e2f1-8390-4aa5-ad67-44dcf3587ad1 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:08.992888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d3112-3429-4938-9514-96602157d430 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:09.008502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25e2f1-8390-4aa5-ad67-44dcf3587ad1 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:09.016593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1054/2097] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:08 2022] PUT /identity/v3/projects/2848d9fd529f486cbd00ffd395ae120a/users/1d12e3ba322845fc97f54765566d76fb/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:09.022615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d3112-3429-4938-9514-96602157d430 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:09.044567 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:09.117716 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cbc2c-f932-4934-a909-21c39874f193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:09.118428 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cbc2c-f932-4934-a909-21c39874f193 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:09.118875 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cbc2c-f932-4934-a909-21c39874f193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:09.119108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cbc2c-f932-4934-a909-21c39874f193 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:09.119829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1cbc2c-f932-4934-a909-21c39874f193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:09.121967 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1cbc2c-f932-4934-a909-21c39874f193 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:09.135973 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d3112-3429-4938-9514-96602157d430 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:09.141261 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281b108-fb47-49f8-9865-db7fe8960028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:09.141889 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281b108-fb47-49f8-9865-db7fe8960028 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:09.142177 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281b108-fb47-49f8-9865-db7fe8960028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:09.142454 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281b108-fb47-49f8-9865-db7fe8960028 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:09.145925 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281b108-fb47-49f8-9865-db7fe8960028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:32:09.146250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281b108-fb47-49f8-9865-db7fe8960028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:09.147864 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281b108-fb47-49f8-9865-db7fe8960028 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:09.166489 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1055/2098] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:32:09.167752 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5c6f7-c982-4b27-b0ab-16bcf76fc5e3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:09.168058 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5c6f7-c982-4b27-b0ab-16bcf76fc5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:09.168320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5c6f7-c982-4b27-b0ab-16bcf76fc5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:09.185876 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:09.190350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1044/2099] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:32:08 2022] POST /identity/v3/projects => generated 399 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:09.190350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cbc2c-f932-4934-a909-21c39874f193 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:09.203320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5ce5c6f7-c982-4b27-b0ab-16bcf76fc5e3 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:09.206849 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5ce5c6f7-c982-4b27-b0ab-16bcf76fc5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:09.289476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cbc2c-f932-4934-a909-21c39874f193 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:09.292321 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1056/2100] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:09.294090 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5c6f7-c982-4b27-b0ab-16bcf76fc5e3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:09.295750 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f403c5d-708f-4175-b789-e8491920400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:09.296377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f403c5d-708f-4175-b789-e8491920400d admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:09.296666 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f403c5d-708f-4175-b789-e8491920400d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:09.297574 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f403c5d-708f-4175-b789-e8491920400d admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:09.297758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f403c5d-708f-4175-b789-e8491920400d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:09.300010 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f403c5d-708f-4175-b789-e8491920400d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:09.306617 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5c6f7-c982-4b27-b0ab-16bcf76fc5e3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:09.311685 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d8602-c0b7-4e85-b3aa-da13639da129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:09.312307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d8602-c0b7-4e85-b3aa-da13639da129 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:09.312591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d8602-c0b7-4e85-b3aa-da13639da129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:09.312921 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d8602-c0b7-4e85-b3aa-da13639da129 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:09.313560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d8602-c0b7-4e85-b3aa-da13639da129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:09.316041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d8602-c0b7-4e85-b3aa-da13639da129 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:09.335034 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1045/2101] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:32:09 2022] POST /identity/v3/projects => generated 367 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:09.336477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f403c5d-708f-4175-b789-e8491920400d admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:09.338660 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8f403c5d-708f-4175-b789-e8491920400d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:09.342958 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1057/2102] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:32:09 2022] POST /identity/v3/users => generated 300 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:09.343673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d8602-c0b7-4e85-b3aa-da13639da129 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:09.353451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d8602-c0b7-4e85-b3aa-da13639da129 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:09.403116 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f403c5d-708f-4175-b789-e8491920400d admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:09.407452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e01dc-1876-43fb-8c1b-92ebd318dfe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:09.408266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e01dc-1876-43fb-8c1b-92ebd318dfe6 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:09.408714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e01dc-1876-43fb-8c1b-92ebd318dfe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:09.409112 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e01dc-1876-43fb-8c1b-92ebd318dfe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:09.421281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed000c-e049-4cb8-9cd7-f700ef047658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:09.421903 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed000c-e049-4cb8-9cd7-f700ef047658 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:09.422183 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed000c-e049-4cb8-9cd7-f700ef047658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:09.422458 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed000c-e049-4cb8-9cd7-f700ef047658 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:09.423312 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed000c-e049-4cb8-9cd7-f700ef047658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:09.425361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed000c-e049-4cb8-9cd7-f700ef047658 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:09.449127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1058/2103] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:32:09 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:09.453081 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed000c-e049-4cb8-9cd7-f700ef047658 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:09.464254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed000c-e049-4cb8-9cd7-f700ef047658 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:09.467466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:09.469279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb73c8-5f98-4236-a638-eb734e4ff2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:09.470082 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb73c8-5f98-4236-a638-eb734e4ff2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:09.470260 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb73c8-5f98-4236-a638-eb734e4ff2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:09.470541 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb73c8-5f98-4236-a638-eb734e4ff2b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:09.471244 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb73c8-5f98-4236-a638-eb734e4ff2b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:09.472951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb73c8-5f98-4236-a638-eb734e4ff2b0 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:09.489318 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1059/2104] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:09.489511 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e01dc-1876-43fb-8c1b-92ebd318dfe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:09.489596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb73c8-5f98-4236-a638-eb734e4ff2b0 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:09.489673 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e01dc-1876-43fb-8c1b-92ebd318dfe6 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:09.498997 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb73c8-5f98-4236-a638-eb734e4ff2b0 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:09.499377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1046/2105] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:09.500144 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e01dc-1876-43fb-8c1b-92ebd318dfe6 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:09.507402 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba1c59-e253-47ba-a2c9-aaa8104b26c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:09.508044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba1c59-e253-47ba-a2c9-aaa8104b26c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:09.508799 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba1c59-e253-47ba-a2c9-aaa8104b26c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:09.509197 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba1c59-e253-47ba-a2c9-aaa8104b26c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:09.510075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba1c59-e253-47ba-a2c9-aaa8104b26c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:09.511869 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e01dc-1876-43fb-8c1b-92ebd318dfe6 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:09.512208 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba1c59-e253-47ba-a2c9-aaa8104b26c7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:09.520074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df0428-b4b5-4f0f-81e3-148267c0fa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:09.521267 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df0428-b4b5-4f0f-81e3-148267c0fa64 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:09.521755 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df0428-b4b5-4f0f-81e3-148267c0fa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:09.522075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df0428-b4b5-4f0f-81e3-148267c0fa64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:09.523113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df0428-b4b5-4f0f-81e3-148267c0fa64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:09.526225 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df0428-b4b5-4f0f-81e3-148267c0fa64 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:09.529592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1060/2106] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:09.531508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba1c59-e253-47ba-a2c9-aaa8104b26c7 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:09.544929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba1c59-e253-47ba-a2c9-aaa8104b26c7 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:09.547847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1047/2107] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:09.553562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df0428-b4b5-4f0f-81e3-148267c0fa64 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:09.554745 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1debc10-eb90-4813-83a7-1492571a23af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:09.555520 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1debc10-eb90-4813-83a7-1492571a23af admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:09.555632 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1debc10-eb90-4813-83a7-1492571a23af admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:09.555897 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1debc10-eb90-4813-83a7-1492571a23af admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:09.556787 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1debc10-eb90-4813-83a7-1492571a23af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:09.559517 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1debc10-eb90-4813-83a7-1492571a23af admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:09.568521 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df0428-b4b5-4f0f-81e3-148267c0fa64 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:09.578324 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6f8b0-e7fb-4583-b649-a3eccbb2d2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:09.578491 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1061/2108] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:32:09.578577 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6f8b0-e7fb-4583-b649-a3eccbb2d2d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:09.578577 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6f8b0-e7fb-4583-b649-a3eccbb2d2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:09.578577 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6f8b0-e7fb-4583-b649-a3eccbb2d2d3 admin admin] PATH_INFO: `/v3/projects/b6470e63c7f94fcd996e7717f2952695/users/62ae706c5fdb489a990e33dbcdce9ee7/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:09.580829 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1debc10-eb90-4813-83a7-1492571a23af admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:09.610981 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6f8b0-e7fb-4583-b649-a3eccbb2d2d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6470e63c7f94fcd996e7717f2952695, user_id=62ae706c5fdb489a990e33dbcdce9ee7, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:09.615315 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6f8b0-e7fb-4583-b649-a3eccbb2d2d3 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:09.620186 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1debc10-eb90-4813-83a7-1492571a23af admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:09.635446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1048/2109] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:09 2022] PUT /identity/v3/projects/b6470e63c7f94fcd996e7717f2952695/users/62ae706c5fdb489a990e33dbcdce9ee7/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:09.645734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c11b1d-b792-47b0-9798-70f2dc866a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:09.646328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c11b1d-b792-47b0-9798-70f2dc866a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:09.646465 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c11b1d-b792-47b0-9798-70f2dc866a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:09.646814 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c11b1d-b792-47b0-9798-70f2dc866a4a admin admin] PATH_INFO: `/v3/projects/4ad57ec8071140fc819273f509166fdd/users/84ab52fd1cd54630a3bd1f897149e001/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:09.647717 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d9416-5a3e-45c4-8678-17b141b97d2f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:09.648022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d9416-5a3e-45c4-8678-17b141b97d2f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:09.648272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d9416-5a3e-45c4-8678-17b141b97d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:09.690968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9b1d9416-5a3e-45c4-8678-17b141b97d2f None None] MFA Rules not processed for user `62ae706c5fdb489a990e33dbcdce9ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:09.692120 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9b1d9416-5a3e-45c4-8678-17b141b97d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:09.694270 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c11b1d-b792-47b0-9798-70f2dc866a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ad57ec8071140fc819273f509166fdd, user_id=84ab52fd1cd54630a3bd1f897149e001, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:09.699747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c11b1d-b792-47b0-9798-70f2dc866a4a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:09.732746 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1062/2110] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:09 2022] PUT /identity/v3/projects/4ad57ec8071140fc819273f509166fdd/users/84ab52fd1cd54630a3bd1f897149e001/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:09.760891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20328ce2-c1f2-459c-aa42-6a2ae3b035d8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:09.760891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20328ce2-c1f2-459c-aa42-6a2ae3b035d8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:09.761506 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20328ce2-c1f2-459c-aa42-6a2ae3b035d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:09.789924 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1049/2111] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:09 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:32:09.800188 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d9416-5a3e-45c4-8678-17b141b97d2f None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:09.802134 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9b1d9416-5a3e-45c4-8678-17b141b97d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:09.858457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-20328ce2-c1f2-459c-aa42-6a2ae3b035d8 None None] MFA Rules not processed for user `84ab52fd1cd54630a3bd1f897149e001`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:09.859819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-20328ce2-c1f2-459c-aa42-6a2ae3b035d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:09.873216 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:09.896845 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d9416-5a3e-45c4-8678-17b141b97d2f None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:09.997804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90ebd9-eda2-471d-b590-ca791442f8bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:10.001095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90ebd9-eda2-471d-b590-ca791442f8bb service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:10.001622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90ebd9-eda2-471d-b590-ca791442f8bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:10.003549 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90ebd9-eda2-471d-b590-ca791442f8bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:10.024106 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1063/2112] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:10.024374 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:10.025301 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20328ce2-c1f2-459c-aa42-6a2ae3b035d8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:10.114952 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90ebd9-eda2-471d-b590-ca791442f8bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:10.121365 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c90ebd9-eda2-471d-b590-ca791442f8bb service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:10.133897 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20328ce2-c1f2-459c-aa42-6a2ae3b035d8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:10.139643 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678c3a8-ac5b-471a-a90a-addf68b40bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:10.140266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678c3a8-ac5b-471a-a90a-addf68b40bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:10.140553 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678c3a8-ac5b-471a-a90a-addf68b40bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:10.140885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678c3a8-ac5b-471a-a90a-addf68b40bc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:10.141520 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678c3a8-ac5b-471a-a90a-addf68b40bc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:10.144137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678c3a8-ac5b-471a-a90a-addf68b40bc2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:10.147105 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1050/2113] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:09 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:10.184826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1064/2114] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:32:10 2022] POST /identity/v3/projects => generated 365 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:10.186824 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90ebd9-eda2-471d-b590-ca791442f8bb service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:10.211912 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90ebd9-eda2-471d-b590-ca791442f8bb service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:10.322541 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa5541-55f8-42a2-b77e-2339b43c0d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:10.323184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa5541-55f8-42a2-b77e-2339b43c0d46 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:10.323471 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa5541-55f8-42a2-b77e-2339b43c0d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:10.323750 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa5541-55f8-42a2-b77e-2339b43c0d46 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:10.324406 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa5541-55f8-42a2-b77e-2339b43c0d46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:10.326393 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa5541-55f8-42a2-b77e-2339b43c0d46 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:10.364875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678c3a8-ac5b-471a-a90a-addf68b40bc2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:10.365439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1051/2115] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:32:10 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:10.386817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678c3a8-ac5b-471a-a90a-addf68b40bc2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:10.398142 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971aa3b-2904-4886-a1e0-934c8950cec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:10.402296 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971aa3b-2904-4886-a1e0-934c8950cec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:10.402529 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971aa3b-2904-4886-a1e0-934c8950cec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:10.402819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971aa3b-2904-4886-a1e0-934c8950cec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:10.403631 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971aa3b-2904-4886-a1e0-934c8950cec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:10.405153 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971aa3b-2904-4886-a1e0-934c8950cec1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:10.447206 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1065/2116] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:10.453029 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa5541-55f8-42a2-b77e-2339b43c0d46 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:10.478946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa5541-55f8-42a2-b77e-2339b43c0d46 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:10.489070 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ec7e3-6368-4dd2-96d6-cd0fc136f0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:10.489809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ec7e3-6368-4dd2-96d6-cd0fc136f0d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:10.490094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ec7e3-6368-4dd2-96d6-cd0fc136f0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:10.490372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ec7e3-6368-4dd2-96d6-cd0fc136f0d5 admin admin] PATH_INFO: `/v3/projects/4b226a39e59b4e5da34d45578238d93f/users/6972b0e986ab44f4bffaf332056a7afe/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:10.526668 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ec7e3-6368-4dd2-96d6-cd0fc136f0d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b226a39e59b4e5da34d45578238d93f, user_id=6972b0e986ab44f4bffaf332056a7afe, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:10.541662 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ec7e3-6368-4dd2-96d6-cd0fc136f0d5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:10.544281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730bcb7-0475-458f-bfee-993efd61e4b8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:10.544841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730bcb7-0475-458f-bfee-993efd61e4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:10.545320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730bcb7-0475-458f-bfee-993efd61e4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:10.565169 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1052/2117] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:10 2022] PUT /identity/v3/projects/4b226a39e59b4e5da34d45578238d93f/users/6972b0e986ab44f4bffaf332056a7afe/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:10.566523 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ec7e3-6368-4dd2-96d6-cd0fc136f0d5 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:10.587763 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a730bcb7-0475-458f-bfee-993efd61e4b8 None None] MFA Rules not processed for user `1d12e3ba322845fc97f54765566d76fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:10.589237 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a730bcb7-0475-458f-bfee-993efd61e4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:10.747737 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1066/2118] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:32:10.749609 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730bcb7-0475-458f-bfee-993efd61e4b8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:10.806810 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:10.811072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ec7e3-6368-4dd2-96d6-cd0fc136f0d5 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:10.829759 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbd393-e920-4dc6-821d-cad16eff63d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:10.830657 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbd393-e920-4dc6-821d-cad16eff63d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:10.830832 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbd393-e920-4dc6-821d-cad16eff63d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:10.831193 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbd393-e920-4dc6-821d-cad16eff63d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:10.834020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbd393-e920-4dc6-821d-cad16eff63d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:10.836035 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbd393-e920-4dc6-821d-cad16eff63d6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:10.865308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1053/2119] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:32:10.869151 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbd393-e920-4dc6-821d-cad16eff63d6 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:10.891676 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbd393-e920-4dc6-821d-cad16eff63d6 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:10.906515 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020dc22-6bde-45d4-985b-c01c07c49a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:10.907282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020dc22-6bde-45d4-985b-c01c07c49a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:10.907644 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020dc22-6bde-45d4-985b-c01c07c49a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:10.908002 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020dc22-6bde-45d4-985b-c01c07c49a0d admin admin] PATH_INFO: `/v3/projects/4b226a39e59b4e5da34d45578238d93f/users/6972b0e986ab44f4bffaf332056a7afe/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:10.911682 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020dc22-6bde-45d4-985b-c01c07c49a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b226a39e59b4e5da34d45578238d93f, user_id=6972b0e986ab44f4bffaf332056a7afe, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:10.916346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020dc22-6bde-45d4-985b-c01c07c49a0d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:10.926873 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:10.952615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1054/2120] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:10 2022] PUT /identity/v3/projects/4b226a39e59b4e5da34d45578238d93f/users/6972b0e986ab44f4bffaf332056a7afe/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:10.960196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730bcb7-0475-458f-bfee-993efd61e4b8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:10.966804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b195fd-8014-4f2d-aee9-7f1db91037a8 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:10.967562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b195fd-8014-4f2d-aee9-7f1db91037a8 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:10.968121 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b195fd-8014-4f2d-aee9-7f1db91037a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:11.030773 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a9b195fd-8014-4f2d-aee9-7f1db91037a8 None None] MFA Rules not processed for user `6972b0e986ab44f4bffaf332056a7afe`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:11.032466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a9b195fd-8014-4f2d-aee9-7f1db91037a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:11.199389 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1055/2121] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:32:11.201655 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bfa9b-fd9d-480a-a8fa-92059581b062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:11.202784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bfa9b-fd9d-480a-a8fa-92059581b062 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:11.203076 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bfa9b-fd9d-480a-a8fa-92059581b062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:11.203356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bfa9b-fd9d-480a-a8fa-92059581b062 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:11.204173 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bfa9b-fd9d-480a-a8fa-92059581b062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:11.206700 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bfa9b-fd9d-480a-a8fa-92059581b062 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:11.228458 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b195fd-8014-4f2d-aee9-7f1db91037a8 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:11.275616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1067/2122] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:32:10 2022] POST /identity/v3/projects => generated 373 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:11.280259 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bfa9b-fd9d-480a-a8fa-92059581b062 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:11.384532 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b195fd-8014-4f2d-aee9-7f1db91037a8 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:11.435426 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bfa9b-fd9d-480a-a8fa-92059581b062 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:11.451095 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa4337-823f-435e-8774-e707be2c955f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:11.451868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa4337-823f-435e-8774-e707be2c955f admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:11.454243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa4337-823f-435e-8774-e707be2c955f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:11.454714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa4337-823f-435e-8774-e707be2c955f admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:11.455871 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa4337-823f-435e-8774-e707be2c955f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:11.458949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa4337-823f-435e-8774-e707be2c955f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:11.494748 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fe963-19d6-4524-b9d5-529934bf4c10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:11.495388 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fe963-19d6-4524-b9d5-529934bf4c10 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:11.495713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fe963-19d6-4524-b9d5-529934bf4c10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:11.496782 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fe963-19d6-4524-b9d5-529934bf4c10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:11.513737 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1068/2123] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:32:11 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:11.514708 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa4337-823f-435e-8774-e707be2c955f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:11.525629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa4337-823f-435e-8774-e707be2c955f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:11.543166 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f4732-7c5d-4f63-aaea-8717950e9c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:11.545086 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f4732-7c5d-4f63-aaea-8717950e9c20 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:11.545621 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f4732-7c5d-4f63-aaea-8717950e9c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:11.546163 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f4732-7c5d-4f63-aaea-8717950e9c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:11.547165 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f4732-7c5d-4f63-aaea-8717950e9c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:11.551178 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f4732-7c5d-4f63-aaea-8717950e9c20 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:11.563766 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1069/2124] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:11.568987 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f4732-7c5d-4f63-aaea-8717950e9c20 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:11.574134 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:11.585208 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f4732-7c5d-4f63-aaea-8717950e9c20 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:11.591209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed10378-dd5b-4561-a1c8-c85acc7fdbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:11.592291 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed10378-dd5b-4561-a1c8-c85acc7fdbcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:11.592812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed10378-dd5b-4561-a1c8-c85acc7fdbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:11.593298 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed10378-dd5b-4561-a1c8-c85acc7fdbcc admin admin] PATH_INFO: `/v3/projects/c5b697588fa14b218dd880d152f36c80/users/a4d06584b7574fffb8760b4f9e12e80d/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:11.600626 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fe963-19d6-4524-b9d5-529934bf4c10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:11.603566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fe963-19d6-4524-b9d5-529934bf4c10 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:11.622282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1056/2125] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:11.639974 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed10378-dd5b-4561-a1c8-c85acc7fdbcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5b697588fa14b218dd880d152f36c80, user_id=a4d06584b7574fffb8760b4f9e12e80d, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:11.642888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed10378-dd5b-4561-a1c8-c85acc7fdbcc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:11.664061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:11.669973 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1070/2126] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:11 2022] PUT /identity/v3/projects/c5b697588fa14b218dd880d152f36c80/users/a4d06584b7574fffb8760b4f9e12e80d/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:32:11.675828 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fe963-19d6-4524-b9d5-529934bf4c10 service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:11.692090 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fe963-19d6-4524-b9d5-529934bf4c10 service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:11.755502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed10378-dd5b-4561-a1c8-c85acc7fdbcc admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:11.784303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958ce23-3e7f-4153-a39c-e49a42c64969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:11.786945 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958ce23-3e7f-4153-a39c-e49a42c64969 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:11.787498 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958ce23-3e7f-4153-a39c-e49a42c64969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:11.788014 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958ce23-3e7f-4153-a39c-e49a42c64969 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:11.789188 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958ce23-3e7f-4153-a39c-e49a42c64969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:11.791039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958ce23-3e7f-4153-a39c-e49a42c64969 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:11.813143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1057/2127] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:11.815046 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958ce23-3e7f-4153-a39c-e49a42c64969 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:11.843951 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958ce23-3e7f-4153-a39c-e49a42c64969 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:11.845781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed10378-dd5b-4561-a1c8-c85acc7fdbcc admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:11.850818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0c9e6-d73e-4c3a-912e-b7c3c402df9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:11.851706 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0c9e6-d73e-4c3a-912e-b7c3c402df9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:11.851992 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0c9e6-d73e-4c3a-912e-b7c3c402df9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:11.852269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0c9e6-d73e-4c3a-912e-b7c3c402df9a admin admin] PATH_INFO: `/v3/projects/c5b697588fa14b218dd880d152f36c80/users/a4d06584b7574fffb8760b4f9e12e80d/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:11.853912 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d268231-d4d6-40ff-8b7e-9ac865ae1833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:11.854593 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0c9e6-d73e-4c3a-912e-b7c3c402df9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5b697588fa14b218dd880d152f36c80, user_id=a4d06584b7574fffb8760b4f9e12e80d, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:11.855411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d268231-d4d6-40ff-8b7e-9ac865ae1833 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:11.855977 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d268231-d4d6-40ff-8b7e-9ac865ae1833 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:11.856519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d268231-d4d6-40ff-8b7e-9ac865ae1833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:11.860468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0c9e6-d73e-4c3a-912e-b7c3c402df9a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:11.880734 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1058/2128] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:11 2022] PUT /identity/v3/projects/c5b697588fa14b218dd880d152f36c80/users/a4d06584b7574fffb8760b4f9e12e80d/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:11.954747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d268231-d4d6-40ff-8b7e-9ac865ae1833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:11.957430 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d268231-d4d6-40ff-8b7e-9ac865ae1833 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:11.969594 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1071/2129] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:32:12.524162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0c9e6-d73e-4c3a-912e-b7c3c402df9a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:12.526359 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-25b0c9e6-d73e-4c3a-912e-b7c3c402df9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:12.721105 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0c9e6-d73e-4c3a-912e-b7c3c402df9a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:12.738899 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5004e-1a2e-4f2f-8c2e-cf25ae55e500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:12.739601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5004e-1a2e-4f2f-8c2e-cf25ae55e500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:12.739949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5004e-1a2e-4f2f-8c2e-cf25ae55e500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:12.740295 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5004e-1a2e-4f2f-8c2e-cf25ae55e500 admin admin] PATH_INFO: `/v3/users/9ffa3a725cf14fe09192222d2d5e7938` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:12.741651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5004e-1a2e-4f2f-8c2e-cf25ae55e500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ffa3a725cf14fe09192222d2d5e7938)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:12.743695 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5004e-1a2e-4f2f-8c2e-cf25ae55e500 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:12.837347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-fab5004e-1a2e-4f2f-8c2e-cf25ae55e500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ffa3a725cf14fe09192222d2d5e7938'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:12.838950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-fab5004e-1a2e-4f2f-8c2e-cf25ae55e500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ffa3a725cf14fe09192222d2d5e7938'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:12.854865 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-fab5004e-1a2e-4f2f-8c2e-cf25ae55e500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ffa3a725cf14fe09192222d2d5e7938'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:12.857188 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-fab5004e-1a2e-4f2f-8c2e-cf25ae55e500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ffa3a725cf14fe09192222d2d5e7938'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:12.878558 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-fab5004e-1a2e-4f2f-8c2e-cf25ae55e500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ffa3a725cf14fe09192222d2d5e7938'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:12.888980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:12.906799 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1059/2130] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:12 2022] DELETE /identity/v3/users/9ffa3a725cf14fe09192222d2d5e7938 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:12.912232 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3605dca-67da-4ba5-92f1-4c071f2539f9 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:12.913174 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3605dca-67da-4ba5-92f1-4c071f2539f9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:12.913633 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3605dca-67da-4ba5-92f1-4c071f2539f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:12.941292 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f3605dca-67da-4ba5-92f1-4c071f2539f9 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:12.942880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f3605dca-67da-4ba5-92f1-4c071f2539f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:13.055348 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1072/2131] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:13.064923 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5004e-1a2e-4f2f-8c2e-cf25ae55e500 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:13.066404 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-fab5004e-1a2e-4f2f-8c2e-cf25ae55e500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:13.162850 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5004e-1a2e-4f2f-8c2e-cf25ae55e500 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:13.168264 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c4c98-9076-45c9-a011-27557e63d427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:13.169195 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c4c98-9076-45c9-a011-27557e63d427 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:13.169652 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c4c98-9076-45c9-a011-27557e63d427 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:13.170309 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c4c98-9076-45c9-a011-27557e63d427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:13.189489 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c4c98-9076-45c9-a011-27557e63d427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:13.191515 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c4c98-9076-45c9-a011-27557e63d427 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:13.214543 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1060/2132] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:13.298045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902623c-6c97-4825-8c36-0daf2153d05f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:13.298369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902623c-6c97-4825-8c36-0daf2153d05f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:13.298615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902623c-6c97-4825-8c36-0daf2153d05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:13.346726 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f902623c-6c97-4825-8c36-0daf2153d05f None None] MFA Rules not processed for user `a4d06584b7574fffb8760b4f9e12e80d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:13.348808 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f902623c-6c97-4825-8c36-0daf2153d05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:13.438506 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:13.538997 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1073/2133] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:13.563809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc62f0-cadf-4597-8279-afe93b90d413 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:13.564153 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc62f0-cadf-4597-8279-afe93b90d413 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:13.564465 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc62f0-cadf-4597-8279-afe93b90d413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:13.590484 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d6cc62f0-cadf-4597-8279-afe93b90d413 None None] MFA Rules not processed for user `1d12e3ba322845fc97f54765566d76fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:13.595527 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d6cc62f0-cadf-4597-8279-afe93b90d413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:13.734869 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1061/2134] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:13.754383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902623c-6c97-4825-8c36-0daf2153d05f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:13.756294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f902623c-6c97-4825-8c36-0daf2153d05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:13.775358 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc62f0-cadf-4597-8279-afe93b90d413 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:13.777013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d6cc62f0-cadf-4597-8279-afe93b90d413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:13.838980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc62f0-cadf-4597-8279-afe93b90d413 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:13.850938 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355d887-b026-4f90-8aa8-6f23aa71ca72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:13.852525 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355d887-b026-4f90-8aa8-6f23aa71ca72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:13.853680 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355d887-b026-4f90-8aa8-6f23aa71ca72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:13.853979 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355d887-b026-4f90-8aa8-6f23aa71ca72 admin admin] PATH_INFO: `/v3/projects/ad11df05518642c2a17a95fccc691ab7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:13.858560 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355d887-b026-4f90-8aa8-6f23aa71ca72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad11df05518642c2a17a95fccc691ab7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:13.862822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355d887-b026-4f90-8aa8-6f23aa71ca72 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:13.983308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8355d887-b026-4f90-8aa8-6f23aa71ca72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad11df05518642c2a17a95fccc691ab7', 'request_id': 'req-8355d887-b026-4f90-8aa8-6f23aa71ca72'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:13.986043 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902623c-6c97-4825-8c36-0daf2153d05f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:14.010937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8355d887-b026-4f90-8aa8-6f23aa71ca72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad11df05518642c2a17a95fccc691ab7', 'request_id': 'req-8355d887-b026-4f90-8aa8-6f23aa71ca72'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:14.035713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8355d887-b026-4f90-8aa8-6f23aa71ca72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad11df05518642c2a17a95fccc691ab7', 'request_id': 'req-8355d887-b026-4f90-8aa8-6f23aa71ca72'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:14.074852 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8355d887-b026-4f90-8aa8-6f23aa71ca72 admin admin] The token cache is being invalidate because project ad11df05518642c2a17a95fccc691ab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:14.076287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8355d887-b026-4f90-8aa8-6f23aa71ca72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:14.077217 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8355d887-b026-4f90-8aa8-6f23aa71ca72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:14.085789 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1062/2135] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:13 2022] DELETE /identity/v3/projects/ad11df05518642c2a17a95fccc691ab7 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:14.086783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355d887-b026-4f90-8aa8-6f23aa71ca72 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:14.090303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8355d887-b026-4f90-8aa8-6f23aa71ca72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:14.148722 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2548c-7bf6-464b-a9cd-bca1bd10a513 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:14.150061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2548c-7bf6-464b-a9cd-bca1bd10a513 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:14.150424 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2548c-7bf6-464b-a9cd-bca1bd10a513 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:14.150771 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2548c-7bf6-464b-a9cd-bca1bd10a513 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:14.153542 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-52d2548c-7bf6-464b-a9cd-bca1bd10a513 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:14.163684 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:14.265358 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355d887-b026-4f90-8aa8-6f23aa71ca72 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:14.272632 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2548c-7bf6-464b-a9cd-bca1bd10a513 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:14.275347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2548c-7bf6-464b-a9cd-bca1bd10a513 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:14.278733 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71b030-22a5-4de7-94d3-f889ee33f324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:14.279444 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71b030-22a5-4de7-94d3-f889ee33f324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:14.279739 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71b030-22a5-4de7-94d3-f889ee33f324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:14.280016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71b030-22a5-4de7-94d3-f889ee33f324 admin admin] PATH_INFO: `/v3/users/a4d1e98338864119a82f864309d8fd5a` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:14.282424 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71b030-22a5-4de7-94d3-f889ee33f324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4d1e98338864119a82f864309d8fd5a)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:14.285477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71b030-22a5-4de7-94d3-f889ee33f324 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:14.295713 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1074/2136] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:14.405529 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bc71b030-22a5-4de7-94d3-f889ee33f324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4d1e98338864119a82f864309d8fd5a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:14.406362 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bc71b030-22a5-4de7-94d3-f889ee33f324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4d1e98338864119a82f864309d8fd5a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:14.415478 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bc71b030-22a5-4de7-94d3-f889ee33f324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4d1e98338864119a82f864309d8fd5a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:14.416332 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bc71b030-22a5-4de7-94d3-f889ee33f324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4d1e98338864119a82f864309d8fd5a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:14.428516 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bc71b030-22a5-4de7-94d3-f889ee33f324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4d1e98338864119a82f864309d8fd5a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:14.458825 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1063/2137] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:14 2022] DELETE /identity/v3/users/a4d1e98338864119a82f864309d8fd5a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:14.839636 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2548c-7bf6-464b-a9cd-bca1bd10a513 service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:14.860471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2548c-7bf6-464b-a9cd-bca1bd10a513 service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:14.884914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:14.939531 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51448d-8b33-4f0f-83ff-17a0792a0424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:14.941168 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51448d-8b33-4f0f-83ff-17a0792a0424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:14.941454 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51448d-8b33-4f0f-83ff-17a0792a0424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:14.941731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51448d-8b33-4f0f-83ff-17a0792a0424 admin admin] PATH_INFO: `/v3/projects/cffd6364d87445339a06644def679383` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:14.942906 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51448d-8b33-4f0f-83ff-17a0792a0424 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cffd6364d87445339a06644def679383)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:14.944867 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51448d-8b33-4f0f-83ff-17a0792a0424 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:14.997734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4f51448d-8b33-4f0f-83ff-17a0792a0424 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cffd6364d87445339a06644def679383', 'request_id': 'req-4f51448d-8b33-4f0f-83ff-17a0792a0424'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:15.009472 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4f51448d-8b33-4f0f-83ff-17a0792a0424 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cffd6364d87445339a06644def679383', 'request_id': 'req-4f51448d-8b33-4f0f-83ff-17a0792a0424'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:15.038750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4f51448d-8b33-4f0f-83ff-17a0792a0424 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cffd6364d87445339a06644def679383', 'request_id': 'req-4f51448d-8b33-4f0f-83ff-17a0792a0424'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:15.085858 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4f51448d-8b33-4f0f-83ff-17a0792a0424 admin admin] The token cache is being invalidate because project cffd6364d87445339a06644def679383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:15.086550 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4f51448d-8b33-4f0f-83ff-17a0792a0424 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:15.088945 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4f51448d-8b33-4f0f-83ff-17a0792a0424 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:15.090927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1075/2138] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:14 2022] DELETE /identity/v3/projects/cffd6364d87445339a06644def679383 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:15.095452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71b030-22a5-4de7-94d3-f889ee33f324 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:15.099379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-bc71b030-22a5-4de7-94d3-f889ee33f324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:15.122611 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71b030-22a5-4de7-94d3-f889ee33f324 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:15.303785 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3cd60-d848-421e-8cd6-c57d87d4b905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:15.305560 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3cd60-d848-421e-8cd6-c57d87d4b905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:15.305890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3cd60-d848-421e-8cd6-c57d87d4b905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:15.306267 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3cd60-d848-421e-8cd6-c57d87d4b905 admin admin] PATH_INFO: `/v3/users/ea9eb0b0b654476a9d8a4bbbf4fdaf6d` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:15.309804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3cd60-d848-421e-8cd6-c57d87d4b905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea9eb0b0b654476a9d8a4bbbf4fdaf6d)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:15.312529 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3cd60-d848-421e-8cd6-c57d87d4b905 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:15.401013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:15.438565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-36a3cd60-d848-421e-8cd6-c57d87d4b905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea9eb0b0b654476a9d8a4bbbf4fdaf6d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:15.443013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-36a3cd60-d848-421e-8cd6-c57d87d4b905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea9eb0b0b654476a9d8a4bbbf4fdaf6d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:15.481248 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-36a3cd60-d848-421e-8cd6-c57d87d4b905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea9eb0b0b654476a9d8a4bbbf4fdaf6d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:15.484297 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-36a3cd60-d848-421e-8cd6-c57d87d4b905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea9eb0b0b654476a9d8a4bbbf4fdaf6d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:15.506955 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-36a3cd60-d848-421e-8cd6-c57d87d4b905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea9eb0b0b654476a9d8a4bbbf4fdaf6d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:15.544614 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1064/2139] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:15 2022] DELETE /identity/v3/users/ea9eb0b0b654476a9d8a4bbbf4fdaf6d => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:16.264352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51448d-8b33-4f0f-83ff-17a0792a0424 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:16.265832 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4f51448d-8b33-4f0f-83ff-17a0792a0424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:16.294454 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51448d-8b33-4f0f-83ff-17a0792a0424 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:16.473172 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3cd60-d848-421e-8cd6-c57d87d4b905 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:16.474937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-36a3cd60-d848-421e-8cd6-c57d87d4b905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:16.478513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b871ac-981d-4b61-93ee-04ad537fc3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:16.486463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b871ac-981d-4b61-93ee-04ad537fc3a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:16.494619 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b871ac-981d-4b61-93ee-04ad537fc3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:16.495729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b871ac-981d-4b61-93ee-04ad537fc3a3 admin admin] PATH_INFO: `/v3/projects/49f33a147aaf4acfbe4460ef86a8f757` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:16.511244 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b871ac-981d-4b61-93ee-04ad537fc3a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49f33a147aaf4acfbe4460ef86a8f757)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:16.530740 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3cd60-d848-421e-8cd6-c57d87d4b905 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:16.536035 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b871ac-981d-4b61-93ee-04ad537fc3a3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:16.544222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca8b15-ca10-4a8c-bc78-3d4c98c35be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:16.544942 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca8b15-ca10-4a8c-bc78-3d4c98c35be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:16.545228 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca8b15-ca10-4a8c-bc78-3d4c98c35be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:16.545753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca8b15-ca10-4a8c-bc78-3d4c98c35be3 admin admin] PATH_INFO: `/v3/users/62ae706c5fdb489a990e33dbcdce9ee7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:16.547231 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca8b15-ca10-4a8c-bc78-3d4c98c35be3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62ae706c5fdb489a990e33dbcdce9ee7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:16.551129 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca8b15-ca10-4a8c-bc78-3d4c98c35be3 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:16.685720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e3ca8b15-ca10-4a8c-bc78-3d4c98c35be3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62ae706c5fdb489a990e33dbcdce9ee7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:16.686577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:16.689024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e3ca8b15-ca10-4a8c-bc78-3d4c98c35be3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62ae706c5fdb489a990e33dbcdce9ee7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:16.692402 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d8b871ac-981d-4b61-93ee-04ad537fc3a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49f33a147aaf4acfbe4460ef86a8f757', 'request_id': 'req-d8b871ac-981d-4b61-93ee-04ad537fc3a3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:16.715562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d8b871ac-981d-4b61-93ee-04ad537fc3a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49f33a147aaf4acfbe4460ef86a8f757', 'request_id': 'req-d8b871ac-981d-4b61-93ee-04ad537fc3a3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:16.720233 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e3ca8b15-ca10-4a8c-bc78-3d4c98c35be3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62ae706c5fdb489a990e33dbcdce9ee7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:16.724242 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e3ca8b15-ca10-4a8c-bc78-3d4c98c35be3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62ae706c5fdb489a990e33dbcdce9ee7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:16.730785 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d8b871ac-981d-4b61-93ee-04ad537fc3a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49f33a147aaf4acfbe4460ef86a8f757', 'request_id': 'req-d8b871ac-981d-4b61-93ee-04ad537fc3a3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:16.739653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e3ca8b15-ca10-4a8c-bc78-3d4c98c35be3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62ae706c5fdb489a990e33dbcdce9ee7'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:16.746976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d8b871ac-981d-4b61-93ee-04ad537fc3a3 admin admin] The token cache is being invalidate because project 49f33a147aaf4acfbe4460ef86a8f757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:16.747267 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d8b871ac-981d-4b61-93ee-04ad537fc3a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:16.758500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d8b871ac-981d-4b61-93ee-04ad537fc3a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:16.761516 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1076/2140] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:16 2022] DELETE /identity/v3/projects/49f33a147aaf4acfbe4460ef86a8f757 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:16.766316 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1065/2141] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:16 2022] DELETE /identity/v3/users/62ae706c5fdb489a990e33dbcdce9ee7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:32:16.768829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0222b-e3be-486a-9043-23558e02e8b7 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:16.769419 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0222b-e3be-486a-9043-23558e02e8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:16.769802 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0222b-e3be-486a-9043-23558e02e8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:16.771571 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135483c-c046-467a-a768-e26dfb33f1fb None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:16.772125 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135483c-c046-467a-a768-e26dfb33f1fb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:16.772570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135483c-c046-467a-a768-e26dfb33f1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:16.812922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9fc0222b-e3be-486a-9043-23558e02e8b7 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:16.815365 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9fc0222b-e3be-486a-9043-23558e02e8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:16.818057 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5135483c-c046-467a-a768-e26dfb33f1fb None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:16.820206 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5135483c-c046-467a-a768-e26dfb33f1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:16.922100 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1077/2142] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:16.942675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135483c-c046-467a-a768-e26dfb33f1fb None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:16.944198 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5135483c-c046-467a-a768-e26dfb33f1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:16.952858 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1066/2143] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:16.963992 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ff35c-f298-473c-bae0-c65144db6957 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:16.964298 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ff35c-f298-473c-bae0-c65144db6957 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:16.964559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ff35c-f298-473c-bae0-c65144db6957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:16.993157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-307ff35c-f298-473c-bae0-c65144db6957 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:16.994489 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-307ff35c-f298-473c-bae0-c65144db6957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:17.012102 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1067/2144] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:17.031517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ff35c-f298-473c-bae0-c65144db6957 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:17.049363 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ff35c-f298-473c-bae0-c65144db6957 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:17.061188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135483c-c046-467a-a768-e26dfb33f1fb None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:17.069676 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cccdd-5475-41af-8bc7-8cc338117ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:17.070315 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cccdd-5475-41af-8bc7-8cc338117ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:17.070783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cccdd-5475-41af-8bc7-8cc338117ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:17.071107 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cccdd-5475-41af-8bc7-8cc338117ec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:17.071790 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73042f-46b3-46e1-95c3-62b9ca5fdd63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:17.071994 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3cccdd-5475-41af-8bc7-8cc338117ec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:32:17.072315 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3cccdd-5475-41af-8bc7-8cc338117ec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:17.073922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73042f-46b3-46e1-95c3-62b9ca5fdd63 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:17.074262 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3cccdd-5475-41af-8bc7-8cc338117ec1 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:17.074640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73042f-46b3-46e1-95c3-62b9ca5fdd63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:17.075108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73042f-46b3-46e1-95c3-62b9ca5fdd63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:17.103021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73042f-46b3-46e1-95c3-62b9ca5fdd63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:17.104763 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73042f-46b3-46e1-95c3-62b9ca5fdd63 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:17.105492 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1068/2145] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:32:17.110445 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cccdd-5475-41af-8bc7-8cc338117ec1 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:17.117353 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1078/2146] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:17.124592 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cccdd-5475-41af-8bc7-8cc338117ec1 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:17.132110 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc016b0d-9b4f-4b8b-bbaa-2b911cd40e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:17.133217 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc016b0d-9b4f-4b8b-bbaa-2b911cd40e04 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:17.133798 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc016b0d-9b4f-4b8b-bbaa-2b911cd40e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:17.134176 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc016b0d-9b4f-4b8b-bbaa-2b911cd40e04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:17.135023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc016b0d-9b4f-4b8b-bbaa-2b911cd40e04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:17.137746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc016b0d-9b4f-4b8b-bbaa-2b911cd40e04 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:17.151646 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:17.191393 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1069/2147] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:32:17 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:17.196075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73042f-46b3-46e1-95c3-62b9ca5fdd63 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:17.209433 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766364d-3af4-4557-97bc-4dcf40914ff4 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:17.210272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766364d-3af4-4557-97bc-4dcf40914ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:17.211133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766364d-3af4-4557-97bc-4dcf40914ff4 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:17.213655 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73042f-46b3-46e1-95c3-62b9ca5fdd63 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:17.213917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1070/2148] 10.222.0.96 () {54 vars in 921 bytes} [Wed Aug 24 04:32:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:32:17.219553 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1db524-893f-4941-a831-fe73c942bd69 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:17.219842 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1db524-893f-4941-a831-fe73c942bd69 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:17.220128 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1db524-893f-4941-a831-fe73c942bd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:17.248224 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-7e1db524-893f-4941-a831-fe73c942bd69 None None] MFA Rules not processed for user `d1f7fe9af30947dbae1f2334b18f630d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:17.249526 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7e1db524-893f-4941-a831-fe73c942bd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:17.356803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1071/2149] 10.222.0.96 () {58 vars in 1018 bytes} [Wed Aug 24 04:32:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:32:17.357789 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1db524-893f-4941-a831-fe73c942bd69 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:17.359424 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7e1db524-893f-4941-a831-fe73c942bd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:17.368946 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68d955-5b36-4c95-921d-cbf65d9b786e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:17.370861 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68d955-5b36-4c95-921d-cbf65d9b786e admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:17.371197 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68d955-5b36-4c95-921d-cbf65d9b786e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:17.371481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68d955-5b36-4c95-921d-cbf65d9b786e admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:17.372170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68d955-5b36-4c95-921d-cbf65d9b786e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:17.376336 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68d955-5b36-4c95-921d-cbf65d9b786e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:17.378414 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1db524-893f-4941-a831-fe73c942bd69 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:17.384934 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd31178-a753-4e57-b073-63ab203b450e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:17.385850 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd31178-a753-4e57-b073-63ab203b450e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:17.386132 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd31178-a753-4e57-b073-63ab203b450e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:17.386816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd31178-a753-4e57-b073-63ab203b450e admin admin] PATH_INFO: `/v3/users/340f60f0efd54b1db12c6b08cb794a84` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:17.388121 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd31178-a753-4e57-b073-63ab203b450e admin admin] RBAC: Authorizing `identity:delete_user(user_id=340f60f0efd54b1db12c6b08cb794a84)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:17.391365 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd31178-a753-4e57-b073-63ab203b450e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:17.406114 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1079/2150] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:32:17 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:32:17.407260 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68d955-5b36-4c95-921d-cbf65d9b786e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:17.410149 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1b68d955-5b36-4c95-921d-cbf65d9b786e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:17.433964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68d955-5b36-4c95-921d-cbf65d9b786e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:17.444432 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7892e17-119c-4c62-bf83-cb1f213ca3f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f7fe9af30947dbae1f2334b18f630d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:17.445495 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7892e17-119c-4c62-bf83-cb1f213ca3f8 service placement] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:17.446579 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7892e17-119c-4c62-bf83-cb1f213ca3f8 service placement] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:17.447070 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7892e17-119c-4c62-bf83-cb1f213ca3f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:17.458846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:17.461775 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7892e17-119c-4c62-bf83-cb1f213ca3f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:17.463752 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7892e17-119c-4c62-bf83-cb1f213ca3f8 service placement] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:17.478936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1080/2151] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:17.479946 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7892e17-119c-4c62-bf83-cb1f213ca3f8 service placement] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:17.506124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7892e17-119c-4c62-bf83-cb1f213ca3f8 service placement] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:17.519937 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b949b1a-5a74-4d04-b2b4-aec980c27e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:17.520208 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ddd31178-a753-4e57-b073-63ab203b450e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '340f60f0efd54b1db12c6b08cb794a84'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:17.521720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ddd31178-a753-4e57-b073-63ab203b450e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '340f60f0efd54b1db12c6b08cb794a84'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:17.522524 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b949b1a-5a74-4d04-b2b4-aec980c27e6b admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:17.525167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b949b1a-5a74-4d04-b2b4-aec980c27e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:17.525167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b949b1a-5a74-4d04-b2b4-aec980c27e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:17.526471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b949b1a-5a74-4d04-b2b4-aec980c27e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:17.529912 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b949b1a-5a74-4d04-b2b4-aec980c27e6b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:17.562606 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ddd31178-a753-4e57-b073-63ab203b450e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '340f60f0efd54b1db12c6b08cb794a84'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:17.563820 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ddd31178-a753-4e57-b073-63ab203b450e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '340f60f0efd54b1db12c6b08cb794a84'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:17.575288 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1081/2152] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:17.579594 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b949b1a-5a74-4d04-b2b4-aec980c27e6b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:17.582145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ddd31178-a753-4e57-b073-63ab203b450e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '340f60f0efd54b1db12c6b08cb794a84'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:17.583167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3b949b1a-5a74-4d04-b2b4-aec980c27e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:17.607258 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b949b1a-5a74-4d04-b2b4-aec980c27e6b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:17.615358 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7c85a-f5f3-4d3e-9a85-96b3941dfb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:17.616520 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1072/2153] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:17 2022] DELETE /identity/v3/users/340f60f0efd54b1db12c6b08cb794a84 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:17.617009 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7c85a-f5f3-4d3e-9a85-96b3941dfb85 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:17.617494 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7c85a-f5f3-4d3e-9a85-96b3941dfb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:17.617948 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7c85a-f5f3-4d3e-9a85-96b3941dfb85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:17.619260 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7c85a-f5f3-4d3e-9a85-96b3941dfb85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:17.622400 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7c85a-f5f3-4d3e-9a85-96b3941dfb85 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:17.642137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1082/2154] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:17.646058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd31178-a753-4e57-b073-63ab203b450e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:17.735463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:17.741949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd31178-a753-4e57-b073-63ab203b450e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:17.749707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff914e-4af2-40de-81c8-c84c78d87836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:17.750709 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff914e-4af2-40de-81c8-c84c78d87836 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:17.751225 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff914e-4af2-40de-81c8-c84c78d87836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:17.751650 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff914e-4af2-40de-81c8-c84c78d87836 admin admin] PATH_INFO: `/v3/projects/bdfabd153274449389ab6b857a24b9ae/users/1c52f265add54f9c82d86170176e1e48/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:17.785451 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff914e-4af2-40de-81c8-c84c78d87836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdfabd153274449389ab6b857a24b9ae, user_id=1c52f265add54f9c82d86170176e1e48, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:17.794513 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff914e-4af2-40de-81c8-c84c78d87836 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:17.861400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1073/2155] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:17 2022] PUT /identity/v3/projects/bdfabd153274449389ab6b857a24b9ae/users/1c52f265add54f9c82d86170176e1e48/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:17.873713 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0619d-5db3-4064-84ee-5ab63c42cd55 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:17.874232 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0619d-5db3-4064-84ee-5ab63c42cd55 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:17.874636 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0619d-5db3-4064-84ee-5ab63c42cd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:17.875585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff914e-4af2-40de-81c8-c84c78d87836 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:17.877548 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6eff914e-4af2-40de-81c8-c84c78d87836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:17.939208 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f3e0619d-5db3-4064-84ee-5ab63c42cd55 None None] MFA Rules not processed for user `1c52f265add54f9c82d86170176e1e48`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:17.943321 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f3e0619d-5db3-4064-84ee-5ab63c42cd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:17.970450 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff914e-4af2-40de-81c8-c84c78d87836 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:17.975838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941814cd-aaf3-4c38-ab9e-31b49627dcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:17.976491 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941814cd-aaf3-4c38-ab9e-31b49627dcf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:17.976836 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941814cd-aaf3-4c38-ab9e-31b49627dcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:17.977114 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941814cd-aaf3-4c38-ab9e-31b49627dcf2 admin admin] PATH_INFO: `/v3/projects/b6470e63c7f94fcd996e7717f2952695` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:17.979275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941814cd-aaf3-4c38-ab9e-31b49627dcf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6470e63c7f94fcd996e7717f2952695)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:17.981256 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941814cd-aaf3-4c38-ab9e-31b49627dcf2 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:18.069687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-941814cd-aaf3-4c38-ab9e-31b49627dcf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6470e63c7f94fcd996e7717f2952695', 'request_id': 'req-941814cd-aaf3-4c38-ab9e-31b49627dcf2'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:18.092379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-941814cd-aaf3-4c38-ab9e-31b49627dcf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6470e63c7f94fcd996e7717f2952695', 'request_id': 'req-941814cd-aaf3-4c38-ab9e-31b49627dcf2'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:18.104771 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1083/2156] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:18.104771 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0619d-5db3-4064-84ee-5ab63c42cd55 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:18.105055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f3e0619d-5db3-4064-84ee-5ab63c42cd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:18.105305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-941814cd-aaf3-4c38-ab9e-31b49627dcf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6470e63c7f94fcd996e7717f2952695', 'request_id': 'req-941814cd-aaf3-4c38-ab9e-31b49627dcf2'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:18.124817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0619d-5db3-4064-84ee-5ab63c42cd55 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:18.126015 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-941814cd-aaf3-4c38-ab9e-31b49627dcf2 admin admin] The token cache is being invalidate because project b6470e63c7f94fcd996e7717f2952695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:18.126581 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-941814cd-aaf3-4c38-ab9e-31b49627dcf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:18.128480 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-941814cd-aaf3-4c38-ab9e-31b49627dcf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:18.132759 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1074/2157] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:17 2022] DELETE /identity/v3/projects/b6470e63c7f94fcd996e7717f2952695 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:32:18.134305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941814cd-aaf3-4c38-ab9e-31b49627dcf2 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:18.138455 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-941814cd-aaf3-4c38-ab9e-31b49627dcf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:18.200926 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca812e-1c9c-48ae-83b9-4d88aeaaedb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:18.201771 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca812e-1c9c-48ae-83b9-4d88aeaaedb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:18.202548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca812e-1c9c-48ae-83b9-4d88aeaaedb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:18.202737 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca812e-1c9c-48ae-83b9-4d88aeaaedb2 admin admin] PATH_INFO: `/v3/projects/2f6c3ac4d44848cb8f6cccbeb080e6d4` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:18.204254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca812e-1c9c-48ae-83b9-4d88aeaaedb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f6c3ac4d44848cb8f6cccbeb080e6d4)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:18.207810 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca812e-1c9c-48ae-83b9-4d88aeaaedb2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:18.231450 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941814cd-aaf3-4c38-ab9e-31b49627dcf2 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:18.236711 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865612f-00ed-44ba-8476-270a36bd6fcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:18.237448 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865612f-00ed-44ba-8476-270a36bd6fcc service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:18.237799 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865612f-00ed-44ba-8476-270a36bd6fcc service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:18.238620 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865612f-00ed-44ba-8476-270a36bd6fcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:18.241889 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7865612f-00ed-44ba-8476-270a36bd6fcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:18.292678 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:18.336571 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1eca812e-1c9c-48ae-83b9-4d88aeaaedb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f6c3ac4d44848cb8f6cccbeb080e6d4', 'request_id': 'req-1eca812e-1c9c-48ae-83b9-4d88aeaaedb2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:18.349492 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1eca812e-1c9c-48ae-83b9-4d88aeaaedb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f6c3ac4d44848cb8f6cccbeb080e6d4', 'request_id': 'req-1eca812e-1c9c-48ae-83b9-4d88aeaaedb2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:18.353059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865612f-00ed-44ba-8476-270a36bd6fcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:18.356213 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865612f-00ed-44ba-8476-270a36bd6fcc service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:18.359168 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1eca812e-1c9c-48ae-83b9-4d88aeaaedb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f6c3ac4d44848cb8f6cccbeb080e6d4', 'request_id': 'req-1eca812e-1c9c-48ae-83b9-4d88aeaaedb2'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:18.360872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:18.372429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1075/2158] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:18.374316 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4912e4-9b8d-451a-a4a9-a59bab6167ee None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:18.374754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4912e4-9b8d-451a-a4a9-a59bab6167ee None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:18.375414 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4912e4-9b8d-451a-a4a9-a59bab6167ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:18.385170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1eca812e-1c9c-48ae-83b9-4d88aeaaedb2 admin admin] The token cache is being invalidate because project 2f6c3ac4d44848cb8f6cccbeb080e6d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:18.386183 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1eca812e-1c9c-48ae-83b9-4d88aeaaedb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:18.387383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1eca812e-1c9c-48ae-83b9-4d88aeaaedb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:18.389449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1084/2159] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:18 2022] DELETE /identity/v3/projects/2f6c3ac4d44848cb8f6cccbeb080e6d4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:18.394966 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638654d0-3ddc-48b8-bba4-74806e9d3772 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:18.395487 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638654d0-3ddc-48b8-bba4-74806e9d3772 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:18.395924 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638654d0-3ddc-48b8-bba4-74806e9d3772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:18.403881 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-5a4912e4-9b8d-451a-a4a9-a59bab6167ee None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:18.405216 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5a4912e4-9b8d-451a-a4a9-a59bab6167ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:18.426842 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-638654d0-3ddc-48b8-bba4-74806e9d3772 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:18.429191 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-638654d0-3ddc-48b8-bba4-74806e9d3772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:18.515891 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1076/2160] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:18.517164 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4912e4-9b8d-451a-a4a9-a59bab6167ee None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:18.525764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5a4912e4-9b8d-451a-a4a9-a59bab6167ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:18.530972 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1085/2161] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:32:18.532393 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f104da-33a0-42ab-9ca8-fc5907952547 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:18.532813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f104da-33a0-42ab-9ca8-fc5907952547 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:18.533181 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f104da-33a0-42ab-9ca8-fc5907952547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:18.543363 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4912e4-9b8d-451a-a4a9-a59bab6167ee None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:18.549998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bd385-40d3-4f65-8044-0bfa0fb4d9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:18.551040 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bd385-40d3-4f65-8044-0bfa0fb4d9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:18.551465 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bd385-40d3-4f65-8044-0bfa0fb4d9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:18.551978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bd385-40d3-4f65-8044-0bfa0fb4d9f2 admin admin] PATH_INFO: `/v3/users/84ab52fd1cd54630a3bd1f897149e001` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:18.553645 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39bd385-40d3-4f65-8044-0bfa0fb4d9f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84ab52fd1cd54630a3bd1f897149e001)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:18.556090 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39bd385-40d3-4f65-8044-0bfa0fb4d9f2 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:18.568461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-52f104da-33a0-42ab-9ca8-fc5907952547 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:18.570185 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-52f104da-33a0-42ab-9ca8-fc5907952547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:18.590448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1086/2162] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:18.602186 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dc0db-e66e-4540-882c-32f12b6d8e48 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:18.602457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dc0db-e66e-4540-882c-32f12b6d8e48 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:18.602693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dc0db-e66e-4540-882c-32f12b6d8e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:18.641813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-340dc0db-e66e-4540-882c-32f12b6d8e48 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:18.643947 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-340dc0db-e66e-4540-882c-32f12b6d8e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:18.663580 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1087/2163] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:18.666337 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340dc0db-e66e-4540-882c-32f12b6d8e48 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:18.676631 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b39bd385-40d3-4f65-8044-0bfa0fb4d9f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84ab52fd1cd54630a3bd1f897149e001'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:18.677403 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b39bd385-40d3-4f65-8044-0bfa0fb4d9f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84ab52fd1cd54630a3bd1f897149e001'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:18.682860 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340dc0db-e66e-4540-882c-32f12b6d8e48 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:18.686096 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b39bd385-40d3-4f65-8044-0bfa0fb4d9f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84ab52fd1cd54630a3bd1f897149e001'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:18.686815 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b39bd385-40d3-4f65-8044-0bfa0fb4d9f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84ab52fd1cd54630a3bd1f897149e001'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:18.695526 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a5718-73a0-4ac1-939f-31219de51bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:18.696596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a5718-73a0-4ac1-939f-31219de51bcc admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:18.696808 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a5718-73a0-4ac1-939f-31219de51bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:18.697321 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a5718-73a0-4ac1-939f-31219de51bcc admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:18.698139 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a5718-73a0-4ac1-939f-31219de51bcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:32:18.698491 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a5718-73a0-4ac1-939f-31219de51bcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:18.698595 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b39bd385-40d3-4f65-8044-0bfa0fb4d9f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84ab52fd1cd54630a3bd1f897149e001'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:18.700431 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a5718-73a0-4ac1-939f-31219de51bcc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:18.720495 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1088/2164] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:32:18.723319 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a5718-73a0-4ac1-939f-31219de51bcc admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:18.725115 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1077/2165] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:18 2022] DELETE /identity/v3/users/84ab52fd1cd54630a3bd1f897149e001 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:18.727013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bd385-40d3-4f65-8044-0bfa0fb4d9f2 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:18.728620 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ea4a5718-73a0-4ac1-939f-31219de51bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:18.732062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b39bd385-40d3-4f65-8044-0bfa0fb4d9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:18.749213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a5718-73a0-4ac1-939f-31219de51bcc admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:18.810253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:18.855953 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bd385-40d3-4f65-8044-0bfa0fb4d9f2 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:18.865666 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3909d-abfd-4f6d-8f0a-5af2f7d3ed1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:18.866545 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3909d-abfd-4f6d-8f0a-5af2f7d3ed1a admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:18.867523 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3909d-abfd-4f6d-8f0a-5af2f7d3ed1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:18.868933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3909d-abfd-4f6d-8f0a-5af2f7d3ed1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:18.870959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1dd09-8d11-44a2-989f-daf4f4724048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:18.872894 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1dd09-8d11-44a2-989f-daf4f4724048 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:18.873031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1dd09-8d11-44a2-989f-daf4f4724048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:18.873222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3909d-abfd-4f6d-8f0a-5af2f7d3ed1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:18.875061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1dd09-8d11-44a2-989f-daf4f4724048 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:18.875729 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3909d-abfd-4f6d-8f0a-5af2f7d3ed1a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:18.875976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1dd09-8d11-44a2-989f-daf4f4724048 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:32:18.876244 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1dd09-8d11-44a2-989f-daf4f4724048 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:18.878859 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1dd09-8d11-44a2-989f-daf4f4724048 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:18.919696 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1089/2166] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:32:18.921196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a459ecc-9711-4c7f-b276-f2be723cd2c3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:18.921488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a459ecc-9711-4c7f-b276-f2be723cd2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:18.921767 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a459ecc-9711-4c7f-b276-f2be723cd2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:18.925736 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1078/2167] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:32:18 2022] POST /identity/v3/projects => generated 373 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:18.926922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3909d-abfd-4f6d-8f0a-5af2f7d3ed1a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:18.959457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5a459ecc-9711-4c7f-b276-f2be723cd2c3 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:18.961669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5a459ecc-9711-4c7f-b276-f2be723cd2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:19.021859 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3909d-abfd-4f6d-8f0a-5af2f7d3ed1a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:19.036115 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffe29b-7717-4b93-bf4a-5d2c1d912e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:19.036785 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffe29b-7717-4b93-bf4a-5d2c1d912e85 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:19.037247 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffe29b-7717-4b93-bf4a-5d2c1d912e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:19.037523 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffe29b-7717-4b93-bf4a-5d2c1d912e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:19.038165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffe29b-7717-4b93-bf4a-5d2c1d912e85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:19.040456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffe29b-7717-4b93-bf4a-5d2c1d912e85 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:19.056259 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1090/2168] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:19.057540 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a459ecc-9711-4c7f-b276-f2be723cd2c3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:19.064373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:19.074796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a459ecc-9711-4c7f-b276-f2be723cd2c3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:19.087848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb0837-f682-4daa-bff5-95208a67ffe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:19.089857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb0837-f682-4daa-bff5-95208a67ffe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:19.089857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb0837-f682-4daa-bff5-95208a67ffe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:19.090062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb0837-f682-4daa-bff5-95208a67ffe3 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:19.091117 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb0837-f682-4daa-bff5-95208a67ffe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:19.094087 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb0837-f682-4daa-bff5-95208a67ffe3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:19.098315 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1079/2169] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:32:18 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:19.099440 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffe29b-7717-4b93-bf4a-5d2c1d912e85 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:19.103665 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-edffe29b-7717-4b93-bf4a-5d2c1d912e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:19.140353 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1091/2170] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:32:19 2022] POST /identity/v3/users => generated 287 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:19.142125 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb0837-f682-4daa-bff5-95208a67ffe3 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:19.156072 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb0837-f682-4daa-bff5-95208a67ffe3 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:19.235840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffe29b-7717-4b93-bf4a-5d2c1d912e85 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:19.242453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413d97a-5df7-4e20-a3ff-4cd94abb3b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:19.244144 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413d97a-5df7-4e20-a3ff-4cd94abb3b90 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:19.244438 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413d97a-5df7-4e20-a3ff-4cd94abb3b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:19.244954 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413d97a-5df7-4e20-a3ff-4cd94abb3b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:19.286330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50894d4-84fb-4a53-8fd6-57d2037a514a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:19.287124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50894d4-84fb-4a53-8fd6-57d2037a514a admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:19.288597 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50894d4-84fb-4a53-8fd6-57d2037a514a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:19.289006 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50894d4-84fb-4a53-8fd6-57d2037a514a admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:19.289794 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50894d4-84fb-4a53-8fd6-57d2037a514a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:19.291788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50894d4-84fb-4a53-8fd6-57d2037a514a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:19.336764 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1092/2171] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:32:19 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:19.337779 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50894d4-84fb-4a53-8fd6-57d2037a514a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:19.378627 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413d97a-5df7-4e20-a3ff-4cd94abb3b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:19.381715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413d97a-5df7-4e20-a3ff-4cd94abb3b90 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:19.387886 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50894d4-84fb-4a53-8fd6-57d2037a514a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:19.390393 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:19.398148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b80b62-5921-4fd4-8f62-8bbcb5c912da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:19.399041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b80b62-5921-4fd4-8f62-8bbcb5c912da admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:19.399613 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b80b62-5921-4fd4-8f62-8bbcb5c912da admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:19.400485 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b80b62-5921-4fd4-8f62-8bbcb5c912da admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:19.401506 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b80b62-5921-4fd4-8f62-8bbcb5c912da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:19.403323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b80b62-5921-4fd4-8f62-8bbcb5c912da admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:19.405844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1080/2172] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:19.408019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413d97a-5df7-4e20-a3ff-4cd94abb3b90 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:19.424414 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1093/2173] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:19.425484 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b80b62-5921-4fd4-8f62-8bbcb5c912da admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:19.428733 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413d97a-5df7-4e20-a3ff-4cd94abb3b90 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:19.435623 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1177577-c368-464a-8fa6-3fae85420b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:19.436541 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1177577-c368-464a-8fa6-3fae85420b00 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:19.437033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1177577-c368-464a-8fa6-3fae85420b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:19.437206 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b80b62-5921-4fd4-8f62-8bbcb5c912da admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:19.437592 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1177577-c368-464a-8fa6-3fae85420b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:19.438411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1177577-c368-464a-8fa6-3fae85420b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:19.440680 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1177577-c368-464a-8fa6-3fae85420b00 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:19.443526 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e094b-a277-419f-b900-4b599b68cc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:19.444651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e094b-a277-419f-b900-4b599b68cc40 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:19.445086 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e094b-a277-419f-b900-4b599b68cc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:19.445703 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e094b-a277-419f-b900-4b599b68cc40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:19.446440 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e094b-a277-419f-b900-4b599b68cc40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:19.448145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e094b-a277-419f-b900-4b599b68cc40 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:19.464857 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1081/2174] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:19.465163 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1094/2175] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:19.470162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1177577-c368-464a-8fa6-3fae85420b00 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:19.472292 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e094b-a277-419f-b900-4b599b68cc40 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:19.481947 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1177577-c368-464a-8fa6-3fae85420b00 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:19.486374 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e094b-a277-419f-b900-4b599b68cc40 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:19.492593 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6a66c-407d-4aec-96a0-c387fd1a052c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:19.492593 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6a66c-407d-4aec-96a0-c387fd1a052c admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:19.492593 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6a66c-407d-4aec-96a0-c387fd1a052c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:19.492593 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6a66c-407d-4aec-96a0-c387fd1a052c admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:19.493064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6a66c-407d-4aec-96a0-c387fd1a052c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:19.493064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6a66c-407d-4aec-96a0-c387fd1a052c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:19.493233 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25c443-4b69-4aa6-982f-c864db94ac40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:19.493459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25c443-4b69-4aa6-982f-c864db94ac40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:19.493840 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25c443-4b69-4aa6-982f-c864db94ac40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:19.494280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25c443-4b69-4aa6-982f-c864db94ac40 admin admin] PATH_INFO: `/v3/projects/d270b000824749209b3b804d7c412f33/users/a4eb634ea0334064a29d5c2ddc9d16ac/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:19.504960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1082/2176] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:19.508915 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6a66c-407d-4aec-96a0-c387fd1a052c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:19.523201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25c443-4b69-4aa6-982f-c864db94ac40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d270b000824749209b3b804d7c412f33, user_id=a4eb634ea0334064a29d5c2ddc9d16ac, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:19.528465 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25c443-4b69-4aa6-982f-c864db94ac40 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:19.530058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6a66c-407d-4aec-96a0-c387fd1a052c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:19.541057 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e82cd5-f90f-4800-b746-0b6c5ac22674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:19.541999 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e82cd5-f90f-4800-b746-0b6c5ac22674 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:19.542433 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e82cd5-f90f-4800-b746-0b6c5ac22674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:19.542857 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e82cd5-f90f-4800-b746-0b6c5ac22674 admin admin] PATH_INFO: `/v3/projects/71a53a013d9b4829ac710ceda464fd6b/users/67bfd102d61945519b8480abb37f305a/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:19.547034 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1095/2177] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:19 2022] PUT /identity/v3/projects/d270b000824749209b3b804d7c412f33/users/a4eb634ea0334064a29d5c2ddc9d16ac/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:19.553448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da35344-c878-4a9b-86b9-34e2b8f828a1 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:19.553757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da35344-c878-4a9b-86b9-34e2b8f828a1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:19.554040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da35344-c878-4a9b-86b9-34e2b8f828a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:19.563543 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e82cd5-f90f-4800-b746-0b6c5ac22674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a53a013d9b4829ac710ceda464fd6b, user_id=67bfd102d61945519b8480abb37f305a, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:19.567987 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e82cd5-f90f-4800-b746-0b6c5ac22674 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:19.584627 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1083/2178] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:19 2022] PUT /identity/v3/projects/71a53a013d9b4829ac710ceda464fd6b/users/67bfd102d61945519b8480abb37f305a/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:19.594107 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083faebe-4701-41fd-8b60-462cb93c998d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:19.594397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083faebe-4701-41fd-8b60-462cb93c998d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:19.595433 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8da35344-c878-4a9b-86b9-34e2b8f828a1 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:19.597106 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083faebe-4701-41fd-8b60-462cb93c998d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:19.599010 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8da35344-c878-4a9b-86b9-34e2b8f828a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:19.639970 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-083faebe-4701-41fd-8b60-462cb93c998d None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:19.641641 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-083faebe-4701-41fd-8b60-462cb93c998d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:19.718373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1096/2179] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:32:19.743425 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da35344-c878-4a9b-86b9-34e2b8f828a1 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:19.752906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1084/2180] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:19.759954 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083faebe-4701-41fd-8b60-462cb93c998d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:19.764936 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-083faebe-4701-41fd-8b60-462cb93c998d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:19.796527 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:19.867626 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da35344-c878-4a9b-86b9-34e2b8f828a1 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:19.878828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fedffc-5edd-4193-9258-12dc3f4be21c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:19.878828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fedffc-5edd-4193-9258-12dc3f4be21c service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:19.879190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fedffc-5edd-4193-9258-12dc3f4be21c service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:19.879588 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fedffc-5edd-4193-9258-12dc3f4be21c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:19.895096 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083faebe-4701-41fd-8b60-462cb93c998d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:19.904148 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48cd5a-fad0-4721-9b22-e89463f85c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:19.905132 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48cd5a-fad0-4721-9b22-e89463f85c63 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:19.906076 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fedffc-5edd-4193-9258-12dc3f4be21c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:19.907651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fedffc-5edd-4193-9258-12dc3f4be21c service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:19.908086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48cd5a-fad0-4721-9b22-e89463f85c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:19.909064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48cd5a-fad0-4721-9b22-e89463f85c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:19.931001 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1097/2181] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:19.943543 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48cd5a-fad0-4721-9b22-e89463f85c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:19.945814 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48cd5a-fad0-4721-9b22-e89463f85c63 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:19.962821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1085/2182] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:32:20.154320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fedffc-5edd-4193-9258-12dc3f4be21c service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:20.158387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a1fedffc-5edd-4193-9258-12dc3f4be21c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:20.211238 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fedffc-5edd-4193-9258-12dc3f4be21c service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:20.211755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ff947-d4b1-41bd-a59b-f137d90f857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:20.212409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ff947-d4b1-41bd-a59b-f137d90f857c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:20.212711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ff947-d4b1-41bd-a59b-f137d90f857c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:20.213037 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ff947-d4b1-41bd-a59b-f137d90f857c admin admin] PATH_INFO: `/v3/projects/4ad57ec8071140fc819273f509166fdd` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:20.214290 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ff947-d4b1-41bd-a59b-f137d90f857c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ad57ec8071140fc819273f509166fdd)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:20.216928 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ff947-d4b1-41bd-a59b-f137d90f857c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:20.355060 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-944ff947-d4b1-41bd-a59b-f137d90f857c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ad57ec8071140fc819273f509166fdd', 'request_id': 'req-944ff947-d4b1-41bd-a59b-f137d90f857c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:20.373457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-944ff947-d4b1-41bd-a59b-f137d90f857c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ad57ec8071140fc819273f509166fdd', 'request_id': 'req-944ff947-d4b1-41bd-a59b-f137d90f857c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:20.382584 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-944ff947-d4b1-41bd-a59b-f137d90f857c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ad57ec8071140fc819273f509166fdd', 'request_id': 'req-944ff947-d4b1-41bd-a59b-f137d90f857c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:20.397729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-944ff947-d4b1-41bd-a59b-f137d90f857c admin admin] The token cache is being invalidate because project 4ad57ec8071140fc819273f509166fdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:20.398295 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-944ff947-d4b1-41bd-a59b-f137d90f857c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:20.399147 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-944ff947-d4b1-41bd-a59b-f137d90f857c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:20.401976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1098/2183] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:20 2022] DELETE /identity/v3/projects/4ad57ec8071140fc819273f509166fdd => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:20.407530 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48cd5a-fad0-4721-9b22-e89463f85c63 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:20.426892 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48cd5a-fad0-4721-9b22-e89463f85c63 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:20.493630 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ff947-d4b1-41bd-a59b-f137d90f857c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:20.495948 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-944ff947-d4b1-41bd-a59b-f137d90f857c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:20.552129 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:20.566102 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162c390-e58a-4bf1-8756-9066baea7871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:20.567784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162c390-e58a-4bf1-8756-9066baea7871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:20.568341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162c390-e58a-4bf1-8756-9066baea7871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:20.570339 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162c390-e58a-4bf1-8756-9066baea7871 admin admin] PATH_INFO: `/v3/users/6972b0e986ab44f4bffaf332056a7afe` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:20.572673 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162c390-e58a-4bf1-8756-9066baea7871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6972b0e986ab44f4bffaf332056a7afe)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:20.574773 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162c390-e58a-4bf1-8756-9066baea7871 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:20.645120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ff947-d4b1-41bd-a59b-f137d90f857c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:20.663815 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc5c29-72d0-4123-9129-570e17877025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:20.665310 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc5c29-72d0-4123-9129-570e17877025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:20.666646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc5c29-72d0-4123-9129-570e17877025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:20.668680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc5c29-72d0-4123-9129-570e17877025 admin admin] PATH_INFO: `/v3/users/4970946a1ad94282a5d895b293fe8b5a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:20.671097 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc5c29-72d0-4123-9129-570e17877025 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4970946a1ad94282a5d895b293fe8b5a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:20.676908 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc5c29-72d0-4123-9129-570e17877025 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:20.686842 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-6162c390-e58a-4bf1-8756-9066baea7871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6972b0e986ab44f4bffaf332056a7afe'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:20.688564 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-6162c390-e58a-4bf1-8756-9066baea7871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6972b0e986ab44f4bffaf332056a7afe'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:20.707695 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-6162c390-e58a-4bf1-8756-9066baea7871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6972b0e986ab44f4bffaf332056a7afe'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:20.708926 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-6162c390-e58a-4bf1-8756-9066baea7871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6972b0e986ab44f4bffaf332056a7afe'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:20.730659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-6162c390-e58a-4bf1-8756-9066baea7871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6972b0e986ab44f4bffaf332056a7afe'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:20.750067 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b3cc5c29-72d0-4123-9129-570e17877025 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4970946a1ad94282a5d895b293fe8b5a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:20.751437 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b3cc5c29-72d0-4123-9129-570e17877025 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4970946a1ad94282a5d895b293fe8b5a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:20.762840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1086/2184] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:20 2022] DELETE /identity/v3/users/6972b0e986ab44f4bffaf332056a7afe => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:20.769791 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b3cc5c29-72d0-4123-9129-570e17877025 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4970946a1ad94282a5d895b293fe8b5a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:20.770517 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b3cc5c29-72d0-4123-9129-570e17877025 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4970946a1ad94282a5d895b293fe8b5a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:20.773310 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:20.791246 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b3cc5c29-72d0-4123-9129-570e17877025 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4970946a1ad94282a5d895b293fe8b5a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:20.805432 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1099/2185] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:20 2022] DELETE /identity/v3/users/4970946a1ad94282a5d895b293fe8b5a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:20.810426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff383c3-78c5-4ef5-9039-2dec1fc9a254 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:20.810740 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff383c3-78c5-4ef5-9039-2dec1fc9a254 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:20.810997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff383c3-78c5-4ef5-9039-2dec1fc9a254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:20.839331 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9ff383c3-78c5-4ef5-9039-2dec1fc9a254 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:20.842969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9ff383c3-78c5-4ef5-9039-2dec1fc9a254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:20.944133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1087/2186] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:20.962102 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc5c29-72d0-4123-9129-570e17877025 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:20.964310 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b3cc5c29-72d0-4123-9129-570e17877025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:21.061908 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc5c29-72d0-4123-9129-570e17877025 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:21.067506 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd59c1a-737a-4f21-bb51-0503a0d8b317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:21.068463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd59c1a-737a-4f21-bb51-0503a0d8b317 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:21.068747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd59c1a-737a-4f21-bb51-0503a0d8b317 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:21.069149 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd59c1a-737a-4f21-bb51-0503a0d8b317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:21.085179 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd59c1a-737a-4f21-bb51-0503a0d8b317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:21.086858 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd59c1a-737a-4f21-bb51-0503a0d8b317 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:21.099646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1100/2187] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:21.714093 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff383c3-78c5-4ef5-9039-2dec1fc9a254 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:21.716408 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9ff383c3-78c5-4ef5-9039-2dec1fc9a254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:21.757789 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff383c3-78c5-4ef5-9039-2dec1fc9a254 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:21.772372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd33881-5333-4910-b264-ee6522f86f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:21.773071 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd33881-5333-4910-b264-ee6522f86f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:21.773342 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd33881-5333-4910-b264-ee6522f86f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:21.773792 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd33881-5333-4910-b264-ee6522f86f21 admin admin] PATH_INFO: `/v3/projects/4b226a39e59b4e5da34d45578238d93f` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:21.781332 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd33881-5333-4910-b264-ee6522f86f21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b226a39e59b4e5da34d45578238d93f)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:21.784398 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd33881-5333-4910-b264-ee6522f86f21 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:21.924826 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2cd33881-5333-4910-b264-ee6522f86f21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b226a39e59b4e5da34d45578238d93f', 'request_id': 'req-2cd33881-5333-4910-b264-ee6522f86f21'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:21.934185 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2cd33881-5333-4910-b264-ee6522f86f21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b226a39e59b4e5da34d45578238d93f', 'request_id': 'req-2cd33881-5333-4910-b264-ee6522f86f21'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:21.945736 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2cd33881-5333-4910-b264-ee6522f86f21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b226a39e59b4e5da34d45578238d93f', 'request_id': 'req-2cd33881-5333-4910-b264-ee6522f86f21'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:21.974280 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:21.991878 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2cd33881-5333-4910-b264-ee6522f86f21 admin admin] The token cache is being invalidate because project 4b226a39e59b4e5da34d45578238d93f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:21.992189 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2cd33881-5333-4910-b264-ee6522f86f21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:21.995653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2cd33881-5333-4910-b264-ee6522f86f21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:22.005019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1088/2188] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:21 2022] DELETE /identity/v3/projects/4b226a39e59b4e5da34d45578238d93f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:22.007615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b46c09-6c28-4051-aa99-80cb289f39fe None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:22.009099 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b46c09-6c28-4051-aa99-80cb289f39fe None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:22.009577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b46c09-6c28-4051-aa99-80cb289f39fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:22.038700 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-18b46c09-6c28-4051-aa99-80cb289f39fe None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:22.040315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-18b46c09-6c28-4051-aa99-80cb289f39fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:22.200851 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1101/2189] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:22.203073 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb5236-9476-42cc-b579-1e5a0ef21bf9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:22.203539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb5236-9476-42cc-b579-1e5a0ef21bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:22.204506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb5236-9476-42cc-b579-1e5a0ef21bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:22.254042 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d4eb5236-9476-42cc-b579-1e5a0ef21bf9 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:22.255421 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d4eb5236-9476-42cc-b579-1e5a0ef21bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:22.281905 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b46c09-6c28-4051-aa99-80cb289f39fe None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:22.288048 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1089/2190] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:22.295433 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b46c09-6c28-4051-aa99-80cb289f39fe None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:22.305646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98084a99-c3b0-494b-99b5-f0d1bc50095c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:22.306369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98084a99-c3b0-494b-99b5-f0d1bc50095c admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:22.306768 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98084a99-c3b0-494b-99b5-f0d1bc50095c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:22.307027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98084a99-c3b0-494b-99b5-f0d1bc50095c admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:22.307680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98084a99-c3b0-494b-99b5-f0d1bc50095c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:32:22.307984 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98084a99-c3b0-494b-99b5-f0d1bc50095c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:22.309808 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98084a99-c3b0-494b-99b5-f0d1bc50095c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:22.325941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1102/2191] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:32:22.330478 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb5236-9476-42cc-b579-1e5a0ef21bf9 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:22.342531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb5236-9476-42cc-b579-1e5a0ef21bf9 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:22.348330 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550c6cd-415b-4cb8-81e5-eaac5b9f1695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:22.350080 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550c6cd-415b-4cb8-81e5-eaac5b9f1695 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:22.350080 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550c6cd-415b-4cb8-81e5-eaac5b9f1695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:22.350080 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550c6cd-415b-4cb8-81e5-eaac5b9f1695 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:22.350318 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550c6cd-415b-4cb8-81e5-eaac5b9f1695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:22.352350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550c6cd-415b-4cb8-81e5-eaac5b9f1695 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:22.410465 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1090/2192] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:32:22 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:22.411635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98084a99-c3b0-494b-99b5-f0d1bc50095c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:22.412900 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550c6cd-415b-4cb8-81e5-eaac5b9f1695 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:22.413501 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-98084a99-c3b0-494b-99b5-f0d1bc50095c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:22.435519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98084a99-c3b0-494b-99b5-f0d1bc50095c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:22.532589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550c6cd-415b-4cb8-81e5-eaac5b9f1695 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:22.543131 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ae508-3e3e-4cc5-b4a4-98f7d8e490bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:22.546540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ae508-3e3e-4cc5-b4a4-98f7d8e490bd admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:22.547217 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ae508-3e3e-4cc5-b4a4-98f7d8e490bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:22.547878 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ae508-3e3e-4cc5-b4a4-98f7d8e490bd admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:22.548838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ae508-3e3e-4cc5-b4a4-98f7d8e490bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:22.552480 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ae508-3e3e-4cc5-b4a4-98f7d8e490bd admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:22.582084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4bd29-14f8-48f3-8ccf-51bb83b1a15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:22.585376 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4bd29-14f8-48f3-8ccf-51bb83b1a15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:22.587582 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4bd29-14f8-48f3-8ccf-51bb83b1a15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:22.587953 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4bd29-14f8-48f3-8ccf-51bb83b1a15e admin admin] PATH_INFO: `/v3/projects/a7a59487ad6a49d5b186d4a579c29bde` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:22.591050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4bd29-14f8-48f3-8ccf-51bb83b1a15e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a59487ad6a49d5b186d4a579c29bde)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:22.601571 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4bd29-14f8-48f3-8ccf-51bb83b1a15e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:22.608183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1091/2193] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:32:22 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:22.611413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ae508-3e3e-4cc5-b4a4-98f7d8e490bd admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:22.654246 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:22.678736 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ae508-3e3e-4cc5-b4a4-98f7d8e490bd admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:22.694827 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0789ceb-cfeb-4ffb-8308-a1bd5fda4efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:22.695911 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0789ceb-cfeb-4ffb-8308-a1bd5fda4efe admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:22.698328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0789ceb-cfeb-4ffb-8308-a1bd5fda4efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:22.699764 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0789ceb-cfeb-4ffb-8308-a1bd5fda4efe admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:22.700845 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0789ceb-cfeb-4ffb-8308-a1bd5fda4efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:22.703745 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0789ceb-cfeb-4ffb-8308-a1bd5fda4efe admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:22.734327 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1092/2194] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:22.739831 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0789ceb-cfeb-4ffb-8308-a1bd5fda4efe admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:22.762079 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0789ceb-cfeb-4ffb-8308-a1bd5fda4efe admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:22.769891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4cd4bd29-14f8-48f3-8ccf-51bb83b1a15e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a59487ad6a49d5b186d4a579c29bde', 'request_id': 'req-4cd4bd29-14f8-48f3-8ccf-51bb83b1a15e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:22.788421 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4cd4bd29-14f8-48f3-8ccf-51bb83b1a15e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a59487ad6a49d5b186d4a579c29bde', 'request_id': 'req-4cd4bd29-14f8-48f3-8ccf-51bb83b1a15e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:22.796753 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4cd4bd29-14f8-48f3-8ccf-51bb83b1a15e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a59487ad6a49d5b186d4a579c29bde', 'request_id': 'req-4cd4bd29-14f8-48f3-8ccf-51bb83b1a15e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:22.824117 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4cd4bd29-14f8-48f3-8ccf-51bb83b1a15e admin admin] The token cache is being invalidate because project a7a59487ad6a49d5b186d4a579c29bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:22.847607 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4cd4bd29-14f8-48f3-8ccf-51bb83b1a15e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:22.849715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4cd4bd29-14f8-48f3-8ccf-51bb83b1a15e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:22.857230 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1103/2195] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:22 2022] DELETE /identity/v3/projects/a7a59487ad6a49d5b186d4a579c29bde => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:22.858867 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e1cbf-ee6a-4099-860a-f211423d55cc None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:22.859154 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e1cbf-ee6a-4099-860a-f211423d55cc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:22.859437 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e1cbf-ee6a-4099-860a-f211423d55cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:22.905431 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3c9e1cbf-ee6a-4099-860a-f211423d55cc None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:22.907722 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3c9e1cbf-ee6a-4099-860a-f211423d55cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:22.927161 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c7d7e-bd2b-467d-b6d8-3f57b538b341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:22.927805 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c7d7e-bd2b-467d-b6d8-3f57b538b341 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:22.928092 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c7d7e-bd2b-467d-b6d8-3f57b538b341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:22.930980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c7d7e-bd2b-467d-b6d8-3f57b538b341 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:22.931854 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c7d7e-bd2b-467d-b6d8-3f57b538b341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:22.934011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c7d7e-bd2b-467d-b6d8-3f57b538b341 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:22.962252 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1093/2196] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:22.966853 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c7d7e-bd2b-467d-b6d8-3f57b538b341 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:22.970820 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b52c7d7e-bd2b-467d-b6d8-3f57b538b341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:23.008560 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c7d7e-bd2b-467d-b6d8-3f57b538b341 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:23.015648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903d2ec-88b0-42a2-80c2-d944148466c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:23.016962 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903d2ec-88b0-42a2-80c2-d944148466c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:23.017360 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903d2ec-88b0-42a2-80c2-d944148466c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:23.017853 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903d2ec-88b0-42a2-80c2-d944148466c6 admin admin] PATH_INFO: `/v3/projects/ae3f9e3009bb40f195829c5c7fe2a26f/users/503371b593e44baca174b20e86e81bee/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:23.038865 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903d2ec-88b0-42a2-80c2-d944148466c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3f9e3009bb40f195829c5c7fe2a26f, user_id=503371b593e44baca174b20e86e81bee, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:23.044747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903d2ec-88b0-42a2-80c2-d944148466c6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:23.048303 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1104/2197] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:23.059037 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee805e9a-4ba4-4105-8ff4-17427c516b70 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:23.060249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee805e9a-4ba4-4105-8ff4-17427c516b70 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:23.060641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee805e9a-4ba4-4105-8ff4-17427c516b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:23.091686 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1094/2198] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:22 2022] PUT /identity/v3/projects/ae3f9e3009bb40f195829c5c7fe2a26f/users/503371b593e44baca174b20e86e81bee/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:23.103180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-ee805e9a-4ba4-4105-8ff4-17427c516b70 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:23.105203 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ee805e9a-4ba4-4105-8ff4-17427c516b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:23.105870 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182c70f-ff5c-4b75-a353-f8c25c0f36cf None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:23.110997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182c70f-ff5c-4b75-a353-f8c25c0f36cf None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:23.112145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182c70f-ff5c-4b75-a353-f8c25c0f36cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:23.161796 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6182c70f-ff5c-4b75-a353-f8c25c0f36cf None None] MFA Rules not processed for user `503371b593e44baca174b20e86e81bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:23.162974 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6182c70f-ff5c-4b75-a353-f8c25c0f36cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:23.185360 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:23.230777 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1105/2199] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:23.238101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee805e9a-4ba4-4105-8ff4-17427c516b70 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:23.256079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee805e9a-4ba4-4105-8ff4-17427c516b70 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:23.263463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8918010-cc75-4b70-baed-b0a8eaa76a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:23.266127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8918010-cc75-4b70-baed-b0a8eaa76a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:23.267045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8918010-cc75-4b70-baed-b0a8eaa76a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:23.267607 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8918010-cc75-4b70-baed-b0a8eaa76a1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:23.269655 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8918010-cc75-4b70-baed-b0a8eaa76a1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:32:23.270162 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8918010-cc75-4b70-baed-b0a8eaa76a1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:23.274755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8918010-cc75-4b70-baed-b0a8eaa76a1f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:23.296726 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1106/2200] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:32:23.299063 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1095/2201] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:23.302498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8918010-cc75-4b70-baed-b0a8eaa76a1f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:23.304473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182c70f-ff5c-4b75-a353-f8c25c0f36cf None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:23.327683 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8918010-cc75-4b70-baed-b0a8eaa76a1f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:23.328855 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182c70f-ff5c-4b75-a353-f8c25c0f36cf None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:23.339307 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ac84f-309b-4ea5-ac80-e7c26ea8927b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:23.339928 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ac84f-309b-4ea5-ac80-e7c26ea8927b admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:23.340211 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ac84f-309b-4ea5-ac80-e7c26ea8927b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:23.340483 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ac84f-309b-4ea5-ac80-e7c26ea8927b admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:23.341642 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ac84f-309b-4ea5-ac80-e7c26ea8927b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:23.343368 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ef98b-1a73-4cb0-be0d-9841afa93b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:23.344003 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ef98b-1a73-4cb0-be0d-9841afa93b9f admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:23.344279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ef98b-1a73-4cb0-be0d-9841afa93b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:23.344780 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ef98b-1a73-4cb0-be0d-9841afa93b9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:23.347832 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ef98b-1a73-4cb0-be0d-9841afa93b9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:23.349856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ef98b-1a73-4cb0-be0d-9841afa93b9f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:23.355474 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ac84f-309b-4ea5-ac80-e7c26ea8927b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:23.426698 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1096/2202] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:32:23 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:23.426899 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:23.428075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ac84f-309b-4ea5-ac80-e7c26ea8927b admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:23.435336 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1107/2203] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:32:23 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:23.440448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ef98b-1a73-4cb0-be0d-9841afa93b9f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:23.610364 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ef98b-1a73-4cb0-be0d-9841afa93b9f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:23.618697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca56626-08eb-469a-b2da-ba288a733e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:23.632614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca56626-08eb-469a-b2da-ba288a733e6c admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:23.633055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca56626-08eb-469a-b2da-ba288a733e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:23.633397 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca56626-08eb-469a-b2da-ba288a733e6c admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:23.646517 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca56626-08eb-469a-b2da-ba288a733e6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:23.650194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca56626-08eb-469a-b2da-ba288a733e6c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:23.679412 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ac84f-309b-4ea5-ac80-e7c26ea8927b admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:23.698855 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e2868-b924-4598-b3ce-a9a7b4a9201c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:23.703726 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e2868-b924-4598-b3ce-a9a7b4a9201c admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:23.704864 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e2868-b924-4598-b3ce-a9a7b4a9201c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:23.706564 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e2868-b924-4598-b3ce-a9a7b4a9201c admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:23.709512 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e2868-b924-4598-b3ce-a9a7b4a9201c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:23.715208 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e2868-b924-4598-b3ce-a9a7b4a9201c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:23.778367 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1097/2204] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:32:23 2022] POST /identity/v3/users => generated 284 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:23.784157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e2868-b924-4598-b3ce-a9a7b4a9201c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:23.784294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1108/2205] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:32:23 2022] POST /identity/v3/users => generated 297 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:23.787387 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca56626-08eb-469a-b2da-ba288a733e6c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:23.808004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca56626-08eb-469a-b2da-ba288a733e6c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:23.828675 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e2868-b924-4598-b3ce-a9a7b4a9201c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:23.848907 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb7fb6-909e-4cc3-8b53-850c94a7e4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:23.853006 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb7fb6-909e-4cc3-8b53-850c94a7e4bf admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:23.854078 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb7fb6-909e-4cc3-8b53-850c94a7e4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:23.854078 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb7fb6-909e-4cc3-8b53-850c94a7e4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:23.857055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb7fb6-909e-4cc3-8b53-850c94a7e4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:23.859592 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb7fb6-909e-4cc3-8b53-850c94a7e4bf admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:23.880741 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29a8a9-5514-4f27-8ecd-0e91d9bcaa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:23.881235 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29a8a9-5514-4f27-8ecd-0e91d9bcaa61 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:23.881438 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29a8a9-5514-4f27-8ecd-0e91d9bcaa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:23.881716 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29a8a9-5514-4f27-8ecd-0e91d9bcaa61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:23.882395 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29a8a9-5514-4f27-8ecd-0e91d9bcaa61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:23.884109 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29a8a9-5514-4f27-8ecd-0e91d9bcaa61 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:23.885740 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1098/2206] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:23.889817 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb7fb6-909e-4cc3-8b53-850c94a7e4bf admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:23.919273 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1109/2207] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:23.925742 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29a8a9-5514-4f27-8ecd-0e91d9bcaa61 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:23.930596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb7fb6-909e-4cc3-8b53-850c94a7e4bf admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:23.951389 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29a8a9-5514-4f27-8ecd-0e91d9bcaa61 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:23.957952 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce04cb-5c29-43c9-b340-22b2beed23be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:23.958620 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce04cb-5c29-43c9-b340-22b2beed23be admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:23.958907 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce04cb-5c29-43c9-b340-22b2beed23be admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:23.959185 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce04cb-5c29-43c9-b340-22b2beed23be admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:23.960170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce04cb-5c29-43c9-b340-22b2beed23be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:23.962521 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce04cb-5c29-43c9-b340-22b2beed23be admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:23.965573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6cee1-4728-4c3a-bbfb-bc0ad61719e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:23.966641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6cee1-4728-4c3a-bbfb-bc0ad61719e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:23.972186 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6cee1-4728-4c3a-bbfb-bc0ad61719e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:23.972186 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6cee1-4728-4c3a-bbfb-bc0ad61719e8 admin admin] PATH_INFO: `/v3/projects/942f7f50f4ef428d853c3e0773d5895b/users/32ce2c40515c40b5aa443f5a73a71eb5/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:24.015643 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6cee1-4728-4c3a-bbfb-bc0ad61719e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=942f7f50f4ef428d853c3e0773d5895b, user_id=32ce2c40515c40b5aa443f5a73a71eb5, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:24.019220 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6cee1-4728-4c3a-bbfb-bc0ad61719e8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:24.053472 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1110/2208] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:23 2022] PUT /identity/v3/projects/942f7f50f4ef428d853c3e0773d5895b/users/32ce2c40515c40b5aa443f5a73a71eb5/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:24.064928 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1099/2209] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:24.066662 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce04cb-5c29-43c9-b340-22b2beed23be admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:24.066784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6cee1-4728-4c3a-bbfb-bc0ad61719e8 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:24.102872 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce04cb-5c29-43c9-b340-22b2beed23be admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:24.234580 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6cee1-4728-4c3a-bbfb-bc0ad61719e8 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:24.246239 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f94d5-3f99-4a0e-921f-df2a88f9462c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:24.246888 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:24.247439 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f94d5-3f99-4a0e-921f-df2a88f9462c admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:24.247731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f94d5-3f99-4a0e-921f-df2a88f9462c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:24.248011 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f94d5-3f99-4a0e-921f-df2a88f9462c admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:24.249184 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f94d5-3f99-4a0e-921f-df2a88f9462c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:24.251294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f94d5-3f99-4a0e-921f-df2a88f9462c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:24.275609 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de457b-6d9a-4600-8b52-8957e6701229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:24.280360 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de457b-6d9a-4600-8b52-8957e6701229 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:24.280661 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de457b-6d9a-4600-8b52-8957e6701229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:24.281604 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de457b-6d9a-4600-8b52-8957e6701229 admin admin] PATH_INFO: `/v3/projects/2d6c6d1413f54195af952161945239b2/users/d86a34f543d54897abe5d81f096aeb95/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:24.304925 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1111/2210] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:24.306354 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f94d5-3f99-4a0e-921f-df2a88f9462c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:24.323275 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f94d5-3f99-4a0e-921f-df2a88f9462c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:24.327269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de457b-6d9a-4600-8b52-8957e6701229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d6c6d1413f54195af952161945239b2, user_id=d86a34f543d54897abe5d81f096aeb95, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:24.332142 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de457b-6d9a-4600-8b52-8957e6701229 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:24.342511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72431a1b-d412-4847-8ee5-6c19b1f6dd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:24.343511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72431a1b-d412-4847-8ee5-6c19b1f6dd2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:24.344267 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72431a1b-d412-4847-8ee5-6c19b1f6dd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:24.346912 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72431a1b-d412-4847-8ee5-6c19b1f6dd2f admin admin] PATH_INFO: `/v3/projects/942f7f50f4ef428d853c3e0773d5895b/users/32ce2c40515c40b5aa443f5a73a71eb5/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:24.352318 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72431a1b-d412-4847-8ee5-6c19b1f6dd2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=942f7f50f4ef428d853c3e0773d5895b, user_id=32ce2c40515c40b5aa443f5a73a71eb5, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:24.358620 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72431a1b-d412-4847-8ee5-6c19b1f6dd2f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:24.361757 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1100/2211] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:24 2022] PUT /identity/v3/projects/2d6c6d1413f54195af952161945239b2/users/d86a34f543d54897abe5d81f096aeb95/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:24.375703 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c32ef-949f-4b8c-b07a-0b161a280001 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:24.375994 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c32ef-949f-4b8c-b07a-0b161a280001 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:24.376275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c32ef-949f-4b8c-b07a-0b161a280001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:24.386357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1112/2212] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:24 2022] PUT /identity/v3/projects/942f7f50f4ef428d853c3e0773d5895b/users/32ce2c40515c40b5aa443f5a73a71eb5/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:24.390816 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1863a5-bda5-4106-a30e-ab8062aac84c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:24.391313 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1863a5-bda5-4106-a30e-ab8062aac84c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:24.391821 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1863a5-bda5-4106-a30e-ab8062aac84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:24.425225 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9a1863a5-bda5-4106-a30e-ab8062aac84c None None] MFA Rules not processed for user `32ce2c40515c40b5aa443f5a73a71eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:24.426739 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9a1863a5-bda5-4106-a30e-ab8062aac84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:24.437958 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-332c32ef-949f-4b8c-b07a-0b161a280001 None None] MFA Rules not processed for user `d86a34f543d54897abe5d81f096aeb95`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:24.439234 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-332c32ef-949f-4b8c-b07a-0b161a280001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:24.460723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:24.556587 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1113/2213] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:24.566436 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1863a5-bda5-4106-a30e-ab8062aac84c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:24.567929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9a1863a5-bda5-4106-a30e-ab8062aac84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:24.596311 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1101/2214] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:32:24.606371 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c32ef-949f-4b8c-b07a-0b161a280001 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:24.608327 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-332c32ef-949f-4b8c-b07a-0b161a280001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:24.731612 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1863a5-bda5-4106-a30e-ab8062aac84c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:24.756997 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ea59a-80bf-4c1f-85f0-88e01b5a3a72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:24.758449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ea59a-80bf-4c1f-85f0-88e01b5a3a72 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:24.758900 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ea59a-80bf-4c1f-85f0-88e01b5a3a72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:24.759420 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ea59a-80bf-4c1f-85f0-88e01b5a3a72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:24.786400 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ea59a-80bf-4c1f-85f0-88e01b5a3a72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:24.788454 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ea59a-80bf-4c1f-85f0-88e01b5a3a72 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:24.807591 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c32ef-949f-4b8c-b07a-0b161a280001 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:24.812128 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6a459-0238-4e63-92e8-361d94c2c98b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6106a46199b74f649cd29a0d02610049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:24.812924 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6a459-0238-4e63-92e8-361d94c2c98b service glance] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:24.813271 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6a459-0238-4e63-92e8-361d94c2c98b service glance] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:24.813615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6a459-0238-4e63-92e8-361d94c2c98b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:24.814348 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1114/2215] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:32:24.823430 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ea59a-80bf-4c1f-85f0-88e01b5a3a72 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:24.826096 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e04ea59a-80bf-4c1f-85f0-88e01b5a3a72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:24.852370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6a459-0238-4e63-92e8-361d94c2c98b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:24.854399 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6a459-0238-4e63-92e8-361d94c2c98b service glance] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:24.878678 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1102/2216] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:24.955207 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6a459-0238-4e63-92e8-361d94c2c98b service glance] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:24.957130 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d5f6a459-0238-4e63-92e8-361d94c2c98b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:24.983865 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6a459-0238-4e63-92e8-361d94c2c98b service glance] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:24.995626 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb84e34-8273-4aaa-abd1-358a2c1c5a55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:24.996486 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb84e34-8273-4aaa-abd1-358a2c1c5a55 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:24.996809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb84e34-8273-4aaa-abd1-358a2c1c5a55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:24.997092 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb84e34-8273-4aaa-abd1-358a2c1c5a55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:25.008667 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ea59a-80bf-4c1f-85f0-88e01b5a3a72 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:25.026489 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fe412-be07-4f38-bd0e-c0134ca39295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:25.027193 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fe412-be07-4f38-bd0e-c0134ca39295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:25.027487 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fe412-be07-4f38-bd0e-c0134ca39295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:25.027774 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fe412-be07-4f38-bd0e-c0134ca39295 admin admin] PATH_INFO: `/v3/users/1c52f265add54f9c82d86170176e1e48` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:25.032321 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fe412-be07-4f38-bd0e-c0134ca39295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c52f265add54f9c82d86170176e1e48)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:25.034306 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fe412-be07-4f38-bd0e-c0134ca39295 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:25.169414 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:25.175769 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4f4fe412-be07-4f38-bd0e-c0134ca39295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c52f265add54f9c82d86170176e1e48'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:25.178728 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4f4fe412-be07-4f38-bd0e-c0134ca39295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c52f265add54f9c82d86170176e1e48'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:25.195988 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4f4fe412-be07-4f38-bd0e-c0134ca39295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c52f265add54f9c82d86170176e1e48'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:25.196675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4f4fe412-be07-4f38-bd0e-c0134ca39295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c52f265add54f9c82d86170176e1e48'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:25.204732 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb84e34-8273-4aaa-abd1-358a2c1c5a55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:25.209223 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb84e34-8273-4aaa-abd1-358a2c1c5a55 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:25.234994 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:25.258092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4f4fe412-be07-4f38-bd0e-c0134ca39295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c52f265add54f9c82d86170176e1e48'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:25.261882 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1103/2217] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:32:25.318137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1115/2218] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:24 2022] DELETE /identity/v3/users/1c52f265add54f9c82d86170176e1e48 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:25.323381 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0edb70-2bdc-4a52-a412-1af933e02992 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:25.323731 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0edb70-2bdc-4a52-a412-1af933e02992 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:25.324015 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0edb70-2bdc-4a52-a412-1af933e02992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:25.389546 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6e0edb70-2bdc-4a52-a412-1af933e02992 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:25.396127 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6e0edb70-2bdc-4a52-a412-1af933e02992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:25.630619 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1104/2219] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:25.677302 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fe412-be07-4f38-bd0e-c0134ca39295 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:25.679415 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4f4fe412-be07-4f38-bd0e-c0134ca39295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:25.935946 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fe412-be07-4f38-bd0e-c0134ca39295 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:25.961253 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90babd76-138f-4f03-8161-f8bf3500e708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:25.962946 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90babd76-138f-4f03-8161-f8bf3500e708 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:25.963358 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90babd76-138f-4f03-8161-f8bf3500e708 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:25.963752 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90babd76-138f-4f03-8161-f8bf3500e708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:26.003707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90babd76-138f-4f03-8161-f8bf3500e708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:26.008238 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90babd76-138f-4f03-8161-f8bf3500e708 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:26.047679 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1116/2220] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:26.069897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0edb70-2bdc-4a52-a412-1af933e02992 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:26.072134 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6e0edb70-2bdc-4a52-a412-1af933e02992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:26.098182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0edb70-2bdc-4a52-a412-1af933e02992 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:26.105851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a69d62-ffd2-4b39-9e4f-74fdf1b7cb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:26.106625 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a69d62-ffd2-4b39-9e4f-74fdf1b7cb48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:26.107318 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a69d62-ffd2-4b39-9e4f-74fdf1b7cb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:26.107861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a69d62-ffd2-4b39-9e4f-74fdf1b7cb48 admin admin] PATH_INFO: `/v3/users/503371b593e44baca174b20e86e81bee` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:26.109969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a69d62-ffd2-4b39-9e4f-74fdf1b7cb48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=503371b593e44baca174b20e86e81bee)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:26.114525 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a69d62-ffd2-4b39-9e4f-74fdf1b7cb48 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:26.241098 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-18a69d62-ffd2-4b39-9e4f-74fdf1b7cb48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '503371b593e44baca174b20e86e81bee'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:26.242106 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-18a69d62-ffd2-4b39-9e4f-74fdf1b7cb48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '503371b593e44baca174b20e86e81bee'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:26.257510 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-18a69d62-ffd2-4b39-9e4f-74fdf1b7cb48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '503371b593e44baca174b20e86e81bee'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:26.258580 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-18a69d62-ffd2-4b39-9e4f-74fdf1b7cb48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '503371b593e44baca174b20e86e81bee'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:26.274852 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-18a69d62-ffd2-4b39-9e4f-74fdf1b7cb48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '503371b593e44baca174b20e86e81bee'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:26.347806 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1105/2221] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:26 2022] DELETE /identity/v3/users/503371b593e44baca174b20e86e81bee => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:26.352874 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0c966-a822-4b6a-b927-a691b7e6b4c2 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:26.353385 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0c966-a822-4b6a-b927-a691b7e6b4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:26.353463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0c966-a822-4b6a-b927-a691b7e6b4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:26.394276 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-68f0c966-a822-4b6a-b927-a691b7e6b4c2 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:26.395522 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-68f0c966-a822-4b6a-b927-a691b7e6b4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:26.527962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1117/2222] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:26.568007 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a69d62-ffd2-4b39-9e4f-74fdf1b7cb48 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:26.569679 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-18a69d62-ffd2-4b39-9e4f-74fdf1b7cb48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:26.754882 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a69d62-ffd2-4b39-9e4f-74fdf1b7cb48 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:26.760866 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743507d1-8076-4ff7-9350-105aac47f464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:26.761900 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743507d1-8076-4ff7-9350-105aac47f464 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:26.762385 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743507d1-8076-4ff7-9350-105aac47f464 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:26.762922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743507d1-8076-4ff7-9350-105aac47f464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:26.790980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743507d1-8076-4ff7-9350-105aac47f464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:26.793568 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743507d1-8076-4ff7-9350-105aac47f464 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:26.819482 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1106/2223] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:27.140834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0c966-a822-4b6a-b927-a691b7e6b4c2 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:27.145747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-68f0c966-a822-4b6a-b927-a691b7e6b4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:27.169860 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0c966-a822-4b6a-b927-a691b7e6b4c2 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:27.198569 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eba96d-78ff-4dc1-a450-6a4e3ccdf14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:27.201292 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eba96d-78ff-4dc1-a450-6a4e3ccdf14e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:27.201292 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eba96d-78ff-4dc1-a450-6a4e3ccdf14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:27.202534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eba96d-78ff-4dc1-a450-6a4e3ccdf14e admin admin] PATH_INFO: `/v3/projects/bdfabd153274449389ab6b857a24b9ae` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:27.206850 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eba96d-78ff-4dc1-a450-6a4e3ccdf14e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdfabd153274449389ab6b857a24b9ae)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:27.214744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eba96d-78ff-4dc1-a450-6a4e3ccdf14e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:27.370767 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c1eba96d-78ff-4dc1-a450-6a4e3ccdf14e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdfabd153274449389ab6b857a24b9ae', 'request_id': 'req-c1eba96d-78ff-4dc1-a450-6a4e3ccdf14e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:27.405662 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c1eba96d-78ff-4dc1-a450-6a4e3ccdf14e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdfabd153274449389ab6b857a24b9ae', 'request_id': 'req-c1eba96d-78ff-4dc1-a450-6a4e3ccdf14e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:27.433762 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c1eba96d-78ff-4dc1-a450-6a4e3ccdf14e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdfabd153274449389ab6b857a24b9ae', 'request_id': 'req-c1eba96d-78ff-4dc1-a450-6a4e3ccdf14e'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:27.461443 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c1eba96d-78ff-4dc1-a450-6a4e3ccdf14e admin admin] The token cache is being invalidate because project bdfabd153274449389ab6b857a24b9ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:27.461745 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c1eba96d-78ff-4dc1-a450-6a4e3ccdf14e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:27.464158 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c1eba96d-78ff-4dc1-a450-6a4e3ccdf14e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:27.468933 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1118/2224] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:27 2022] DELETE /identity/v3/projects/bdfabd153274449389ab6b857a24b9ae => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:27.474326 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d87ca4-f8dd-4416-aff2-ef5f328f43b6 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:27.475039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d87ca4-f8dd-4416-aff2-ef5f328f43b6 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:27.475039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d87ca4-f8dd-4416-aff2-ef5f328f43b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:27.493206 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:27.563517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-91d87ca4-f8dd-4416-aff2-ef5f328f43b6 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:27.568361 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-91d87ca4-f8dd-4416-aff2-ef5f328f43b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:27.771279 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1107/2225] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:27.779669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9c70a-29ed-4b05-8b2c-10ccb6d23601 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:27.780202 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9c70a-29ed-4b05-8b2c-10ccb6d23601 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:27.780483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9c70a-29ed-4b05-8b2c-10ccb6d23601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:27.840264 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-faf9c70a-29ed-4b05-8b2c-10ccb6d23601 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:27.843607 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-faf9c70a-29ed-4b05-8b2c-10ccb6d23601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:27.871970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1119/2226] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:27.873360 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d87ca4-f8dd-4416-aff2-ef5f328f43b6 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:27.893613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d87ca4-f8dd-4416-aff2-ef5f328f43b6 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:27.909096 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a453545-593c-481d-8c91-24c3cae6eb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:27.911635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a453545-593c-481d-8c91-24c3cae6eb67 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:27.912269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a453545-593c-481d-8c91-24c3cae6eb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:27.912663 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a453545-593c-481d-8c91-24c3cae6eb67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:27.914638 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a453545-593c-481d-8c91-24c3cae6eb67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:32:27.915393 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a453545-593c-481d-8c91-24c3cae6eb67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:27.929161 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a453545-593c-481d-8c91-24c3cae6eb67 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:27.950023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1108/2227] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:32:27.954342 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9c70a-29ed-4b05-8b2c-10ccb6d23601 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:27.966189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:27.981793 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9c70a-29ed-4b05-8b2c-10ccb6d23601 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:27.996972 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88727fb4-a1ab-4f87-b24b-7bf86804eba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:27.997607 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88727fb4-a1ab-4f87-b24b-7bf86804eba3 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:27.998654 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88727fb4-a1ab-4f87-b24b-7bf86804eba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:27.999198 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88727fb4-a1ab-4f87-b24b-7bf86804eba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:28.000847 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88727fb4-a1ab-4f87-b24b-7bf86804eba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:28.006625 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88727fb4-a1ab-4f87-b24b-7bf86804eba3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:28.021681 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a453545-593c-481d-8c91-24c3cae6eb67 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:28.025068 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0a453545-593c-481d-8c91-24c3cae6eb67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:28.059054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a453545-593c-481d-8c91-24c3cae6eb67 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:28.074495 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cfc44-3f4a-4558-9da0-fb0a8ec8a192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:28.074878 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cfc44-3f4a-4558-9da0-fb0a8ec8a192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:28.075269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cfc44-3f4a-4558-9da0-fb0a8ec8a192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:28.075681 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cfc44-3f4a-4558-9da0-fb0a8ec8a192 admin admin] PATH_INFO: `/v3/projects/ae3f9e3009bb40f195829c5c7fe2a26f` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:28.077267 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86cfc44-3f4a-4558-9da0-fb0a8ec8a192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae3f9e3009bb40f195829c5c7fe2a26f)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:28.079545 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86cfc44-3f4a-4558-9da0-fb0a8ec8a192 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:28.095789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1120/2228] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:32:27 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:28.097242 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88727fb4-a1ab-4f87-b24b-7bf86804eba3 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:28.177826 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e86cfc44-3f4a-4558-9da0-fb0a8ec8a192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae3f9e3009bb40f195829c5c7fe2a26f', 'request_id': 'req-e86cfc44-3f4a-4558-9da0-fb0a8ec8a192'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:28.184837 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e86cfc44-3f4a-4558-9da0-fb0a8ec8a192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae3f9e3009bb40f195829c5c7fe2a26f', 'request_id': 'req-e86cfc44-3f4a-4558-9da0-fb0a8ec8a192'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:28.194420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e86cfc44-3f4a-4558-9da0-fb0a8ec8a192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae3f9e3009bb40f195829c5c7fe2a26f', 'request_id': 'req-e86cfc44-3f4a-4558-9da0-fb0a8ec8a192'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:28.223001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e86cfc44-3f4a-4558-9da0-fb0a8ec8a192 admin admin] The token cache is being invalidate because project ae3f9e3009bb40f195829c5c7fe2a26f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:28.223306 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e86cfc44-3f4a-4558-9da0-fb0a8ec8a192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:28.228802 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e86cfc44-3f4a-4558-9da0-fb0a8ec8a192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:28.235602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1109/2229] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:28 2022] DELETE /identity/v3/projects/ae3f9e3009bb40f195829c5c7fe2a26f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:28.239328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cfc44-3f4a-4558-9da0-fb0a8ec8a192 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:28.259000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e86cfc44-3f4a-4558-9da0-fb0a8ec8a192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:28.282552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88727fb4-a1ab-4f87-b24b-7bf86804eba3 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:28.414894 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cfc44-3f4a-4558-9da0-fb0a8ec8a192 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:28.424230 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7279a-c3fe-4010-9e23-64f2e814f2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:28.424922 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7279a-c3fe-4010-9e23-64f2e814f2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:28.425209 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7279a-c3fe-4010-9e23-64f2e814f2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:28.425489 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7279a-c3fe-4010-9e23-64f2e814f2d9 admin admin] PATH_INFO: `/v3/users/32ce2c40515c40b5aa443f5a73a71eb5` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:28.428798 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7279a-c3fe-4010-9e23-64f2e814f2d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32ce2c40515c40b5aa443f5a73a71eb5)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:28.430799 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7279a-c3fe-4010-9e23-64f2e814f2d9 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:28.434415 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72542a1c-08cd-48b9-96ad-a0afc39b3840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:28.435860 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72542a1c-08cd-48b9-96ad-a0afc39b3840 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:28.436346 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72542a1c-08cd-48b9-96ad-a0afc39b3840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:28.437800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72542a1c-08cd-48b9-96ad-a0afc39b3840 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:28.438809 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72542a1c-08cd-48b9-96ad-a0afc39b3840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:28.443326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72542a1c-08cd-48b9-96ad-a0afc39b3840 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:28.481065 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:28.537938 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1121/2230] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:32:28 2022] POST /identity/v3/users => generated 287 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:28.540938 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72542a1c-08cd-48b9-96ad-a0afc39b3840 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:28.543576 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-72542a1c-08cd-48b9-96ad-a0afc39b3840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:28.586336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-18c7279a-c3fe-4010-9e23-64f2e814f2d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32ce2c40515c40b5aa443f5a73a71eb5'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:28.589294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-18c7279a-c3fe-4010-9e23-64f2e814f2d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32ce2c40515c40b5aa443f5a73a71eb5'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:28.589745 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72542a1c-08cd-48b9-96ad-a0afc39b3840 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:28.603519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33eb87-75c3-42e8-a369-bbafe8157f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:28.604193 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33eb87-75c3-42e8-a369-bbafe8157f66 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:28.604487 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33eb87-75c3-42e8-a369-bbafe8157f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:28.604790 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33eb87-75c3-42e8-a369-bbafe8157f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:28.605488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33eb87-75c3-42e8-a369-bbafe8157f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:28.607203 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33eb87-75c3-42e8-a369-bbafe8157f66 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:28.618674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-18c7279a-c3fe-4010-9e23-64f2e814f2d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32ce2c40515c40b5aa443f5a73a71eb5'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:28.619408 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-18c7279a-c3fe-4010-9e23-64f2e814f2d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32ce2c40515c40b5aa443f5a73a71eb5'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:28.639046 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1122/2231] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:28.644276 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33eb87-75c3-42e8-a369-bbafe8157f66 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:28.647222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8f33eb87-75c3-42e8-a369-bbafe8157f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:28.659198 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-18c7279a-c3fe-4010-9e23-64f2e814f2d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32ce2c40515c40b5aa443f5a73a71eb5'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:28.687346 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33eb87-75c3-42e8-a369-bbafe8157f66 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:28.703917 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49815baf-6471-4d5b-95fa-63f588b9f28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:28.706002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49815baf-6471-4d5b-95fa-63f588b9f28f admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:28.706422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49815baf-6471-4d5b-95fa-63f588b9f28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:28.706704 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49815baf-6471-4d5b-95fa-63f588b9f28f admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:28.707688 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1110/2232] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:28 2022] DELETE /identity/v3/users/32ce2c40515c40b5aa443f5a73a71eb5 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:28.708157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49815baf-6471-4d5b-95fa-63f588b9f28f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:28.711110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49815baf-6471-4d5b-95fa-63f588b9f28f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:28.740179 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1123/2233] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:32:28.742088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7279a-c3fe-4010-9e23-64f2e814f2d9 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:28.890748 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7279a-c3fe-4010-9e23-64f2e814f2d9 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:28.906914 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d196e6-79a7-427e-942d-3d7e51b3d675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:28.907622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d196e6-79a7-427e-942d-3d7e51b3d675 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:28.907998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d196e6-79a7-427e-942d-3d7e51b3d675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:28.911062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d196e6-79a7-427e-942d-3d7e51b3d675 admin admin] PATH_INFO: `/v3/projects/f20b78390c0a4c828854ca3f7eae5a21/users/05307f40edbd471d929b2e9645f09163/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:28.951341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d196e6-79a7-427e-942d-3d7e51b3d675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f20b78390c0a4c828854ca3f7eae5a21, user_id=05307f40edbd471d929b2e9645f09163, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:28.954863 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d196e6-79a7-427e-942d-3d7e51b3d675 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:28.990795 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1111/2234] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:28 2022] PUT /identity/v3/projects/f20b78390c0a4c828854ca3f7eae5a21/users/05307f40edbd471d929b2e9645f09163/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:29.005483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a0e12-930f-4447-9a0f-16fd6411d310 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:29.005992 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a0e12-930f-4447-9a0f-16fd6411d310 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:29.006375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a0e12-930f-4447-9a0f-16fd6411d310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:29.056994 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3d1a0e12-930f-4447-9a0f-16fd6411d310 None None] MFA Rules not processed for user `05307f40edbd471d929b2e9645f09163`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:29.067334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3d1a0e12-930f-4447-9a0f-16fd6411d310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:29.169282 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:29.200361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1124/2235] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:32:29.204872 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d196e6-79a7-427e-942d-3d7e51b3d675 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:29.218267 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ea168-fa75-4ac1-872d-2dac7fab2dc7 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:29.218782 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ea168-fa75-4ac1-872d-2dac7fab2dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:29.219223 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ea168-fa75-4ac1-872d-2dac7fab2dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:29.350450 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d196e6-79a7-427e-942d-3d7e51b3d675 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:29.350939 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a50ea168-fa75-4ac1-872d-2dac7fab2dc7 None None] MFA Rules not processed for user `a4eb634ea0334064a29d5c2ddc9d16ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:29.352504 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a50ea168-fa75-4ac1-872d-2dac7fab2dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:29.370533 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373418b2-876a-4605-9a2b-21f7d6ff9576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:29.388470 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373418b2-876a-4605-9a2b-21f7d6ff9576 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:29.388810 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373418b2-876a-4605-9a2b-21f7d6ff9576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:29.394102 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373418b2-876a-4605-9a2b-21f7d6ff9576 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:29.394102 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373418b2-876a-4605-9a2b-21f7d6ff9576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:29.399812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373418b2-876a-4605-9a2b-21f7d6ff9576 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:29.473072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1112/2236] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:32:29 2022] POST /identity/v3/projects => generated 373 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:29.474963 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373418b2-876a-4605-9a2b-21f7d6ff9576 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:29.481149 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-373418b2-876a-4605-9a2b-21f7d6ff9576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:29.494937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:29.507291 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1125/2237] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:29.512096 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ea168-fa75-4ac1-872d-2dac7fab2dc7 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:29.541382 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ea168-fa75-4ac1-872d-2dac7fab2dc7 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:29.659758 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373418b2-876a-4605-9a2b-21f7d6ff9576 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:29.665832 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0b420-fe9e-4f4b-8f2a-5b0b7e078707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:29.666810 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ba257-6f0a-468d-8aa8-6c49b73290c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:29.667167 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0b420-fe9e-4f4b-8f2a-5b0b7e078707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:29.667445 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ba257-6f0a-468d-8aa8-6c49b73290c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:29.667845 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ba257-6f0a-468d-8aa8-6c49b73290c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:29.668070 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0b420-fe9e-4f4b-8f2a-5b0b7e078707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:29.668171 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ba257-6f0a-468d-8aa8-6c49b73290c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:29.668640 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0b420-fe9e-4f4b-8f2a-5b0b7e078707 admin admin] PATH_INFO: `/v3/projects/942f7f50f4ef428d853c3e0773d5895b` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:29.668778 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ba257-6f0a-468d-8aa8-6c49b73290c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:29.670289 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0b420-fe9e-4f4b-8f2a-5b0b7e078707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=942f7f50f4ef428d853c3e0773d5895b)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:29.672739 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ba257-6f0a-468d-8aa8-6c49b73290c3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:29.672898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0b420-fe9e-4f4b-8f2a-5b0b7e078707 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:29.735671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1126/2238] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:32:29 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:29.737332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ba257-6f0a-468d-8aa8-6c49b73290c3 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:29.741427 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6f8ba257-6f0a-468d-8aa8-6c49b73290c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:29.824470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ba257-6f0a-468d-8aa8-6c49b73290c3 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:29.835406 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-aef0b420-fe9e-4f4b-8f2a-5b0b7e078707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '942f7f50f4ef428d853c3e0773d5895b', 'request_id': 'req-aef0b420-fe9e-4f4b-8f2a-5b0b7e078707'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:29.863952 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-aef0b420-fe9e-4f4b-8f2a-5b0b7e078707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '942f7f50f4ef428d853c3e0773d5895b', 'request_id': 'req-aef0b420-fe9e-4f4b-8f2a-5b0b7e078707'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:29.888460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-aef0b420-fe9e-4f4b-8f2a-5b0b7e078707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '942f7f50f4ef428d853c3e0773d5895b', 'request_id': 'req-aef0b420-fe9e-4f4b-8f2a-5b0b7e078707'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:29.919968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-aef0b420-fe9e-4f4b-8f2a-5b0b7e078707 admin admin] The token cache is being invalidate because project 942f7f50f4ef428d853c3e0773d5895b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:29.921477 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-aef0b420-fe9e-4f4b-8f2a-5b0b7e078707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:29.922649 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-aef0b420-fe9e-4f4b-8f2a-5b0b7e078707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:29.931748 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1113/2239] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:29 2022] DELETE /identity/v3/projects/942f7f50f4ef428d853c3e0773d5895b => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:29.932813 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0b420-fe9e-4f4b-8f2a-5b0b7e078707 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:29.934442 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-aef0b420-fe9e-4f4b-8f2a-5b0b7e078707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:29.973873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae6633-09b1-4916-b414-b99f96309602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:29.974517 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae6633-09b1-4916-b414-b99f96309602 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:29.974797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae6633-09b1-4916-b414-b99f96309602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:29.975066 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae6633-09b1-4916-b414-b99f96309602 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:29.978246 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae6633-09b1-4916-b414-b99f96309602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:29.983003 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae6633-09b1-4916-b414-b99f96309602 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:30.017218 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:30.058979 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1127/2240] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:32:29 2022] POST /identity/v3/projects => generated 371 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:30.060326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd350c-4e41-4066-ab75-ddde0a1b562d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:30.060616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd350c-4e41-4066-ab75-ddde0a1b562d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:30.060951 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd350c-4e41-4066-ab75-ddde0a1b562d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:30.091289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-86dd350c-4e41-4066-ab75-ddde0a1b562d None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:30.092583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-86dd350c-4e41-4066-ab75-ddde0a1b562d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:30.096824 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0b420-fe9e-4f4b-8f2a-5b0b7e078707 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:30.196933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:30.233267 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00661b66-bbe5-43b6-85ac-c36a1a838887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:30.233912 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00661b66-bbe5-43b6-85ac-c36a1a838887 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:30.234197 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00661b66-bbe5-43b6-85ac-c36a1a838887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:30.234475 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00661b66-bbe5-43b6-85ac-c36a1a838887 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:30.235152 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00661b66-bbe5-43b6-85ac-c36a1a838887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:30.239610 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00661b66-bbe5-43b6-85ac-c36a1a838887 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:30.259792 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1114/2241] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:30.260843 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00661b66-bbe5-43b6-85ac-c36a1a838887 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:30.263962 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-00661b66-bbe5-43b6-85ac-c36a1a838887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:30.271204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1128/2242] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:30.272331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd350c-4e41-4066-ab75-ddde0a1b562d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:30.295771 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00661b66-bbe5-43b6-85ac-c36a1a838887 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:30.306837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd350c-4e41-4066-ab75-ddde0a1b562d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:30.310470 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac620411-0293-4e3d-a2a4-cef1bd3098e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:30.312397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac620411-0293-4e3d-a2a4-cef1bd3098e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:30.312587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac620411-0293-4e3d-a2a4-cef1bd3098e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:30.314996 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac620411-0293-4e3d-a2a4-cef1bd3098e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:30.317023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac620411-0293-4e3d-a2a4-cef1bd3098e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:30.321211 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb14190-3540-43fd-9ccb-cfb4ea1c10bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:30.324314 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb14190-3540-43fd-9ccb-cfb4ea1c10bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:30.324726 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb14190-3540-43fd-9ccb-cfb4ea1c10bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:30.325050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb14190-3540-43fd-9ccb-cfb4ea1c10bb admin admin] PATH_INFO: `/v3/projects/2b8a962550f64e5a95409a14dd288f6e/users/90d6e9d356f94cf69d5fa2e6fb37ef16/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:30.331689 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac620411-0293-4e3d-a2a4-cef1bd3098e8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:30.366422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb14190-3540-43fd-9ccb-cfb4ea1c10bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b8a962550f64e5a95409a14dd288f6e, user_id=90d6e9d356f94cf69d5fa2e6fb37ef16, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:30.370695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb14190-3540-43fd-9ccb-cfb4ea1c10bb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:30.382908 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1115/2243] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:32:30 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:30.388266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4eba99-b383-4d68-a2f8-158efdb9c8d7 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:30.388499 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4eba99-b383-4d68-a2f8-158efdb9c8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:30.388812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4eba99-b383-4d68-a2f8-158efdb9c8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:30.416955 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1129/2244] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:30 2022] PUT /identity/v3/projects/2b8a962550f64e5a95409a14dd288f6e/users/90d6e9d356f94cf69d5fa2e6fb37ef16/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:30.418127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb14190-3540-43fd-9ccb-cfb4ea1c10bb admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:30.461953 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-1a4eba99-b383-4d68-a2f8-158efdb9c8d7 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:30.463162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1a4eba99-b383-4d68-a2f8-158efdb9c8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:30.553012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1116/2245] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:30.554516 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4eba99-b383-4d68-a2f8-158efdb9c8d7 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:30.554633 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb14190-3540-43fd-9ccb-cfb4ea1c10bb admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:30.568219 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4eba99-b383-4d68-a2f8-158efdb9c8d7 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:30.581790 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf439aa-1da8-4e65-9492-1b1b4c48b94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:30.582171 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19e6c0-ca55-4a69-9df7-25e42de3d785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:30.582426 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf439aa-1da8-4e65-9492-1b1b4c48b94f admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:30.582753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19e6c0-ca55-4a69-9df7-25e42de3d785 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:30.583045 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19e6c0-ca55-4a69-9df7-25e42de3d785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:30.583378 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19e6c0-ca55-4a69-9df7-25e42de3d785 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:30.584083 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19e6c0-ca55-4a69-9df7-25e42de3d785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:30.585657 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf439aa-1da8-4e65-9492-1b1b4c48b94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:30.585978 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf439aa-1da8-4e65-9492-1b1b4c48b94f admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:30.586671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf439aa-1da8-4e65-9492-1b1b4c48b94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:30.590012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19e6c0-ca55-4a69-9df7-25e42de3d785 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:30.592168 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf439aa-1da8-4e65-9492-1b1b4c48b94f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:30.605298 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1117/2246] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:30.606458 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ad40a-0483-4e5f-881a-925b83f66908 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:30.606747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ad40a-0483-4e5f-881a-925b83f66908 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:30.607038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ad40a-0483-4e5f-881a-925b83f66908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:30.610188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1130/2247] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:30.610188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf439aa-1da8-4e65-9492-1b1b4c48b94f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:30.628505 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf439aa-1da8-4e65-9492-1b1b4c48b94f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:30.636923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ff0c4-355f-46b4-b2a7-1106e83ac587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:30.637566 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ff0c4-355f-46b4-b2a7-1106e83ac587 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:30.637863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ff0c4-355f-46b4-b2a7-1106e83ac587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:30.638134 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ff0c4-355f-46b4-b2a7-1106e83ac587 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:30.638858 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ff0c4-355f-46b4-b2a7-1106e83ac587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:32:30.639124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ff0c4-355f-46b4-b2a7-1106e83ac587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:30.641021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ff0c4-355f-46b4-b2a7-1106e83ac587 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:30.666770 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d87ad40a-0483-4e5f-881a-925b83f66908 None None] MFA Rules not processed for user `67bfd102d61945519b8480abb37f305a`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:30.667342 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1131/2248] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:32:30.668261 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ff0c4-355f-46b4-b2a7-1106e83ac587 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:30.669210 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d87ad40a-0483-4e5f-881a-925b83f66908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:30.691094 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ff0c4-355f-46b4-b2a7-1106e83ac587 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:30.697169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2503c-0be9-4122-8792-5714a120f0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:30.697944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2503c-0be9-4122-8792-5714a120f0cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:30.698146 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2503c-0be9-4122-8792-5714a120f0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:30.698429 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2503c-0be9-4122-8792-5714a120f0cd admin admin] PATH_INFO: `/v3/projects/2b8a962550f64e5a95409a14dd288f6e/users/90d6e9d356f94cf69d5fa2e6fb37ef16/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:30.702410 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2503c-0be9-4122-8792-5714a120f0cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b8a962550f64e5a95409a14dd288f6e, user_id=90d6e9d356f94cf69d5fa2e6fb37ef16, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:30.706489 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2503c-0be9-4122-8792-5714a120f0cd admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:30.722859 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1132/2249] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:30 2022] PUT /identity/v3/projects/2b8a962550f64e5a95409a14dd288f6e/users/90d6e9d356f94cf69d5fa2e6fb37ef16/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:30.723498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2503c-0be9-4122-8792-5714a120f0cd admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:30.796134 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1118/2250] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:30.797674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ad40a-0483-4e5f-881a-925b83f66908 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:30.824878 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ad40a-0483-4e5f-881a-925b83f66908 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:30.836660 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:30.871284 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2503c-0be9-4122-8792-5714a120f0cd admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:30.879983 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11c6d6-c2fe-4c84-979e-6b0e4232d256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:30.880831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11c6d6-c2fe-4c84-979e-6b0e4232d256 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:30.881216 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11c6d6-c2fe-4c84-979e-6b0e4232d256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:30.881653 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11c6d6-c2fe-4c84-979e-6b0e4232d256 admin admin] PATH_INFO: `/v3/projects/d3ce362c36804500afd2cc344cc7edca/users/33bb6f22057f47c1810d352c337fd9df/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:30.926022 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11c6d6-c2fe-4c84-979e-6b0e4232d256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ce362c36804500afd2cc344cc7edca, user_id=33bb6f22057f47c1810d352c337fd9df, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:30.931124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11c6d6-c2fe-4c84-979e-6b0e4232d256 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:30.942809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:30.967072 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1133/2251] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:30 2022] PUT /identity/v3/projects/d3ce362c36804500afd2cc344cc7edca/users/33bb6f22057f47c1810d352c337fd9df/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:30.973844 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdea320-f9be-41dc-b605-949011ed91bb None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:30.974070 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdea320-f9be-41dc-b605-949011ed91bb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:30.974570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdea320-f9be-41dc-b605-949011ed91bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:31.016372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddd680-be88-41a8-967f-a84055e604b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:31.016372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddd680-be88-41a8-967f-a84055e604b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:31.016732 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddd680-be88-41a8-967f-a84055e604b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:31.017027 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddd680-be88-41a8-967f-a84055e604b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:31.018351 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddd680-be88-41a8-967f-a84055e604b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:31.021307 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddd680-be88-41a8-967f-a84055e604b2 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:31.061893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-dfdea320-f9be-41dc-b605-949011ed91bb None None] MFA Rules not processed for user `90d6e9d356f94cf69d5fa2e6fb37ef16`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:31.065803 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-dfdea320-f9be-41dc-b605-949011ed91bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:31.114559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1119/2252] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:32:30 2022] POST /identity/v3/projects => generated 385 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:31.115470 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddd680-be88-41a8-967f-a84055e604b2 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:31.120216 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6dddd680-be88-41a8-967f-a84055e604b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:31.227420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddd680-be88-41a8-967f-a84055e604b2 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:31.235239 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530281e-73b4-46d7-82c3-d42f33d589dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:31.235884 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530281e-73b4-46d7-82c3-d42f33d589dd service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:31.236171 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530281e-73b4-46d7-82c3-d42f33d589dd service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:31.237019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530281e-73b4-46d7-82c3-d42f33d589dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:31.290325 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1134/2253] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:31.293770 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdea320-f9be-41dc-b605-949011ed91bb None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:31.497167 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530281e-73b4-46d7-82c3-d42f33d589dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:31.504612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530281e-73b4-46d7-82c3-d42f33d589dd service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:31.542842 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1120/2254] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:31.545473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530281e-73b4-46d7-82c3-d42f33d589dd service nova] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:31.568861 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdea320-f9be-41dc-b605-949011ed91bb None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:31.682124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:31.714264 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6112780-b36d-418b-addc-fd7ee5c80b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:31.715621 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530281e-73b4-46d7-82c3-d42f33d589dd service nova] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:31.716680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6112780-b36d-418b-addc-fd7ee5c80b23 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:31.717099 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6112780-b36d-418b-addc-fd7ee5c80b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:31.717473 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6112780-b36d-418b-addc-fd7ee5c80b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:31.718835 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6112780-b36d-418b-addc-fd7ee5c80b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:31.723754 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6112780-b36d-418b-addc-fd7ee5c80b23 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:31.730887 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8efd5-60ec-4f76-b230-8893474fabab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:31.732033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8efd5-60ec-4f76-b230-8893474fabab admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:31.732817 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8efd5-60ec-4f76-b230-8893474fabab admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:31.734781 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8efd5-60ec-4f76-b230-8893474fabab admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:31.737327 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8efd5-60ec-4f76-b230-8893474fabab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:31.760569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8efd5-60ec-4f76-b230-8893474fabab admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:31.775892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1135/2255] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:31.780126 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6112780-b36d-418b-addc-fd7ee5c80b23 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:31.785513 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:31.786692 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b6112780-b36d-418b-addc-fd7ee5c80b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:31.824127 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1121/2256] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:32:31 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:31.824127 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8efd5-60ec-4f76-b230-8893474fabab admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:31.856724 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8efd5-60ec-4f76-b230-8893474fabab admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:31.862100 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8552538-2c7a-46be-afde-802f80d55ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:31.862805 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8552538-2c7a-46be-afde-802f80d55ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:31.863090 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8552538-2c7a-46be-afde-802f80d55ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:31.863371 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8552538-2c7a-46be-afde-802f80d55ec9 admin admin] PATH_INFO: `/v3/projects/d3ce362c36804500afd2cc344cc7edca/users/33bb6f22057f47c1810d352c337fd9df/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:31.866069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8552538-2c7a-46be-afde-802f80d55ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ce362c36804500afd2cc344cc7edca, user_id=33bb6f22057f47c1810d352c337fd9df, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:31.869230 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8552538-2c7a-46be-afde-802f80d55ec9 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:31.887428 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1122/2257] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:31 2022] PUT /identity/v3/projects/d3ce362c36804500afd2cc344cc7edca/users/33bb6f22057f47c1810d352c337fd9df/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:31.887428 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8552538-2c7a-46be-afde-802f80d55ec9 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:31.961279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6112780-b36d-418b-addc-fd7ee5c80b23 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:32.028020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8552538-2c7a-46be-afde-802f80d55ec9 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:32.043607 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea92b9a-4108-4503-92e0-f20176874461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:32.044250 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea92b9a-4108-4503-92e0-f20176874461 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:32.044532 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea92b9a-4108-4503-92e0-f20176874461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:32.045178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea92b9a-4108-4503-92e0-f20176874461 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:32.045507 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea92b9a-4108-4503-92e0-f20176874461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:32.047193 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea92b9a-4108-4503-92e0-f20176874461 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:32.075468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1123/2258] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:32.078981 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea92b9a-4108-4503-92e0-f20176874461 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:32.101077 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea92b9a-4108-4503-92e0-f20176874461 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:32.117903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ab6fb-f514-4bb4-bbf1-b86399e2c0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:32.118555 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ab6fb-f514-4bb4-bbf1-b86399e2c0fc admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:32.118917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ab6fb-f514-4bb4-bbf1-b86399e2c0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:32.119206 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ab6fb-f514-4bb4-bbf1-b86399e2c0fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:32.120851 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdadb34a-4725-48a2-ab30-f5a222fef03c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:32.124274 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadb34a-4725-48a2-ab30-f5a222fef03c service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:32.124274 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadb34a-4725-48a2-ab30-f5a222fef03c service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:32.124274 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadb34a-4725-48a2-ab30-f5a222fef03c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:32.124549 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ab6fb-f514-4bb4-bbf1-b86399e2c0fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:32.128091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ab6fb-f514-4bb4-bbf1-b86399e2c0fc admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:32.129034 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cdadb34a-4725-48a2-ab30-f5a222fef03c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:32.166290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1124/2259] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:32.172259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ab6fb-f514-4bb4-bbf1-b86399e2c0fc admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:32.194069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ab6fb-f514-4bb4-bbf1-b86399e2c0fc admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:32.201337 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308d0d9-4d4b-47f8-adb8-da8b61019a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:32.202035 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308d0d9-4d4b-47f8-adb8-da8b61019a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:32.202370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308d0d9-4d4b-47f8-adb8-da8b61019a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:32.202657 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308d0d9-4d4b-47f8-adb8-da8b61019a42 admin admin] PATH_INFO: `/v3/projects/0729f9ef095647e498e4af536b209fc9/users/c4ec8f337cd04c0d93a79e7e614f6f2b/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:32.227612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308d0d9-4d4b-47f8-adb8-da8b61019a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0729f9ef095647e498e4af536b209fc9, user_id=c4ec8f337cd04c0d93a79e7e614f6f2b, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:32.241790 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308d0d9-4d4b-47f8-adb8-da8b61019a42 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:32.260029 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1125/2260] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:32 2022] PUT /identity/v3/projects/0729f9ef095647e498e4af536b209fc9/users/c4ec8f337cd04c0d93a79e7e614f6f2b/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:32:32.272111 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864ef3b-aedb-475f-9148-90ec3c8419a7 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:32.272507 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864ef3b-aedb-475f-9148-90ec3c8419a7 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:32.272925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864ef3b-aedb-475f-9148-90ec3c8419a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:32.327661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdadb34a-4725-48a2-ab30-f5a222fef03c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:32.329336 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdadb34a-4725-48a2-ab30-f5a222fef03c service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:32.381976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1136/2261] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:32.385807 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-8864ef3b-aedb-475f-9148-90ec3c8419a7 None None] MFA Rules not processed for user `c4ec8f337cd04c0d93a79e7e614f6f2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:32.387123 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8864ef3b-aedb-475f-9148-90ec3c8419a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:32.591037 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1126/2262] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:32:32.676269 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdadb34a-4725-48a2-ab30-f5a222fef03c service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:32.685337 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cdadb34a-4725-48a2-ab30-f5a222fef03c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:32.706907 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdadb34a-4725-48a2-ab30-f5a222fef03c service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:32.887867 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c23699-9c5a-4ab9-a01a-db67c1644f5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:32.888976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c23699-9c5a-4ab9-a01a-db67c1644f5f service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:32.889478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c23699-9c5a-4ab9-a01a-db67c1644f5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:32.889923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c23699-9c5a-4ab9-a01a-db67c1644f5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:32.912638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c23699-9c5a-4ab9-a01a-db67c1644f5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:32.914668 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c23699-9c5a-4ab9-a01a-db67c1644f5f service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:32.940843 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1137/2263] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:33.005661 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864ef3b-aedb-475f-9148-90ec3c8419a7 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:33.129123 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:33.237840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864ef3b-aedb-475f-9148-90ec3c8419a7 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:33.267013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8251d-d744-4aa6-87d4-b69733bd698e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:33.269436 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8251d-d744-4aa6-87d4-b69733bd698e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:33.270201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8251d-d744-4aa6-87d4-b69733bd698e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:33.270784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8251d-d744-4aa6-87d4-b69733bd698e admin admin] PATH_INFO: `/v3/users/c4ec8f337cd04c0d93a79e7e614f6f2b` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:33.273456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8251d-d744-4aa6-87d4-b69733bd698e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ec8f337cd04c0d93a79e7e614f6f2b)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:33.276469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8251d-d744-4aa6-87d4-b69733bd698e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:33.368884 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a4a8251d-d744-4aa6-87d4-b69733bd698e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ec8f337cd04c0d93a79e7e614f6f2b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:33.370187 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a4a8251d-d744-4aa6-87d4-b69733bd698e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ec8f337cd04c0d93a79e7e614f6f2b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:33.386576 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a4a8251d-d744-4aa6-87d4-b69733bd698e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ec8f337cd04c0d93a79e7e614f6f2b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:33.387612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a4a8251d-d744-4aa6-87d4-b69733bd698e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ec8f337cd04c0d93a79e7e614f6f2b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:33.403155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a4a8251d-d744-4aa6-87d4-b69733bd698e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ec8f337cd04c0d93a79e7e614f6f2b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:33.446687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1127/2264] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:33 2022] DELETE /identity/v3/users/c4ec8f337cd04c0d93a79e7e614f6f2b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:33.451426 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb081e-6b3e-4f83-af0a-b2fcd257da1b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:33.452103 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb081e-6b3e-4f83-af0a-b2fcd257da1b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:33.452536 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb081e-6b3e-4f83-af0a-b2fcd257da1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:33.465171 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:33.492393 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a4cb081e-6b3e-4f83-af0a-b2fcd257da1b None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:33.494045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a4cb081e-6b3e-4f83-af0a-b2fcd257da1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:33.646720 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1138/2265] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:33.657512 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8251d-d744-4aa6-87d4-b69733bd698e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:33.660208 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a4a8251d-d744-4aa6-87d4-b69733bd698e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:33.807040 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8251d-d744-4aa6-87d4-b69733bd698e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:33.811260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13bd88-54ba-4f7a-88dc-31404092ccca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:33.812647 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13bd88-54ba-4f7a-88dc-31404092ccca service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:33.812918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13bd88-54ba-4f7a-88dc-31404092ccca service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:33.813195 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13bd88-54ba-4f7a-88dc-31404092ccca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:33.880291 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13bd88-54ba-4f7a-88dc-31404092ccca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:33.886049 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13bd88-54ba-4f7a-88dc-31404092ccca service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:33.933388 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1128/2266] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:34.373691 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb081e-6b3e-4f83-af0a-b2fcd257da1b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:34.375178 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a4cb081e-6b3e-4f83-af0a-b2fcd257da1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:34.431123 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb081e-6b3e-4f83-af0a-b2fcd257da1b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:34.453013 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c85275-c9ba-4c89-83c0-115ed164457a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:34.459604 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c85275-c9ba-4c89-83c0-115ed164457a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:34.462856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c85275-c9ba-4c89-83c0-115ed164457a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:34.465091 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c85275-c9ba-4c89-83c0-115ed164457a admin admin] PATH_INFO: `/v3/projects/0729f9ef095647e498e4af536b209fc9` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:34.466557 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c85275-c9ba-4c89-83c0-115ed164457a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0729f9ef095647e498e4af536b209fc9)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:34.483761 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c85275-c9ba-4c89-83c0-115ed164457a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:34.635070 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d7c85275-c9ba-4c89-83c0-115ed164457a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0729f9ef095647e498e4af536b209fc9', 'request_id': 'req-d7c85275-c9ba-4c89-83c0-115ed164457a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:34.662679 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d7c85275-c9ba-4c89-83c0-115ed164457a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0729f9ef095647e498e4af536b209fc9', 'request_id': 'req-d7c85275-c9ba-4c89-83c0-115ed164457a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:34.677465 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d7c85275-c9ba-4c89-83c0-115ed164457a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0729f9ef095647e498e4af536b209fc9', 'request_id': 'req-d7c85275-c9ba-4c89-83c0-115ed164457a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:34.729033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d7c85275-c9ba-4c89-83c0-115ed164457a admin admin] The token cache is being invalidate because project 0729f9ef095647e498e4af536b209fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:34.730972 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d7c85275-c9ba-4c89-83c0-115ed164457a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:34.733085 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-d7c85275-c9ba-4c89-83c0-115ed164457a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:34.740186 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1139/2267] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:34 2022] DELETE /identity/v3/projects/0729f9ef095647e498e4af536b209fc9 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:34.745666 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81a595-ff03-416b-9e52-a1c8692b60c7 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:34.746551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81a595-ff03-416b-9e52-a1c8692b60c7 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:34.747210 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81a595-ff03-416b-9e52-a1c8692b60c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:34.777448 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ab81a595-ff03-416b-9e52-a1c8692b60c7 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:34.779030 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ab81a595-ff03-416b-9e52-a1c8692b60c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:34.924771 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:34.994971 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1129/2268] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:34.995209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affbd46-6cf0-4192-bb43-ffa4837a4e8d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:34.995509 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affbd46-6cf0-4192-bb43-ffa4837a4e8d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:34.995799 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affbd46-6cf0-4192-bb43-ffa4837a4e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:35.042593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0affbd46-6cf0-4192-bb43-ffa4837a4e8d None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:35.044011 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0affbd46-6cf0-4192-bb43-ffa4837a4e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:35.073756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1140/2269] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:32:35.078658 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81a595-ff03-416b-9e52-a1c8692b60c7 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:35.094389 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81a595-ff03-416b-9e52-a1c8692b60c7 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:35.109654 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c2f53-54d0-49de-ad81-83a0bee38407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:35.110587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c2f53-54d0-49de-ad81-83a0bee38407 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:35.110964 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c2f53-54d0-49de-ad81-83a0bee38407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:35.112326 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c2f53-54d0-49de-ad81-83a0bee38407 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:35.112906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c2f53-54d0-49de-ad81-83a0bee38407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:32:35.113305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c2f53-54d0-49de-ad81-83a0bee38407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:35.116224 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c2f53-54d0-49de-ad81-83a0bee38407 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:35.129895 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1130/2270] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:32:35.134640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affbd46-6cf0-4192-bb43-ffa4837a4e8d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:35.148124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affbd46-6cf0-4192-bb43-ffa4837a4e8d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:35.159348 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52f959-2e37-48bf-8ca0-62c55b1d485b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:35.160160 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52f959-2e37-48bf-8ca0-62c55b1d485b admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:35.160560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52f959-2e37-48bf-8ca0-62c55b1d485b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:35.160964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52f959-2e37-48bf-8ca0-62c55b1d485b admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:35.161722 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52f959-2e37-48bf-8ca0-62c55b1d485b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:35.167311 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52f959-2e37-48bf-8ca0-62c55b1d485b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:35.241087 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c2f53-54d0-49de-ad81-83a0bee38407 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:35.246559 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1141/2271] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:32:35 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:32:35.259411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c2f53-54d0-49de-ad81-83a0bee38407 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:35.403060 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7576010-847c-4443-823c-512d3a14ee64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:35.404173 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7576010-847c-4443-823c-512d3a14ee64 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:35.404656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7576010-847c-4443-823c-512d3a14ee64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:35.405745 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7576010-847c-4443-823c-512d3a14ee64 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:35.408160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7576010-847c-4443-823c-512d3a14ee64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:35.416615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7576010-847c-4443-823c-512d3a14ee64 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:35.454866 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1131/2272] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:32:35 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:32:35.459578 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52f959-2e37-48bf-8ca0-62c55b1d485b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:35.472414 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52f959-2e37-48bf-8ca0-62c55b1d485b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:35.480171 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ed3dc-3a16-4a3d-b6c1-a56d1ea43905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:35.481026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ed3dc-3a16-4a3d-b6c1-a56d1ea43905 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:35.481493 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ed3dc-3a16-4a3d-b6c1-a56d1ea43905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:35.481923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ed3dc-3a16-4a3d-b6c1-a56d1ea43905 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:35.482742 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ed3dc-3a16-4a3d-b6c1-a56d1ea43905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:35.485225 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ed3dc-3a16-4a3d-b6c1-a56d1ea43905 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:35.500656 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1142/2273] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:35.501506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7576010-847c-4443-823c-512d3a14ee64 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:35.514542 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7576010-847c-4443-823c-512d3a14ee64 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:35.521863 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cac019-3744-4e92-ac46-43f3b2b95c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:35.522765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cac019-3744-4e92-ac46-43f3b2b95c1f admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:35.523338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cac019-3744-4e92-ac46-43f3b2b95c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:35.523973 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cac019-3744-4e92-ac46-43f3b2b95c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:35.524845 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cac019-3744-4e92-ac46-43f3b2b95c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:35.526644 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cac019-3744-4e92-ac46-43f3b2b95c1f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:35.545157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ed3dc-3a16-4a3d-b6c1-a56d1ea43905 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:35.557049 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1132/2274] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:32:35.559218 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ed3dc-3a16-4a3d-b6c1-a56d1ea43905 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:35.566890 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d05e55-eb7c-4756-8767-a3de59b3f192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:35.567877 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d05e55-eb7c-4756-8767-a3de59b3f192 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:35.568317 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d05e55-eb7c-4756-8767-a3de59b3f192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:35.568826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d05e55-eb7c-4756-8767-a3de59b3f192 admin admin] PATH_INFO: `/v3/projects/7d20e987a86d4b168b6615f0542aafbb/users/d8b9fc4976a84d0db395a85afbc4dc9e/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:35.589519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d05e55-eb7c-4756-8767-a3de59b3f192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d20e987a86d4b168b6615f0542aafbb, user_id=d8b9fc4976a84d0db395a85afbc4dc9e, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:35.594601 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d05e55-eb7c-4756-8767-a3de59b3f192 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:35.627711 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268cf5c-3c7d-43f5-bfee-23878fedd46a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:35.628022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268cf5c-3c7d-43f5-bfee-23878fedd46a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:35.628373 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268cf5c-3c7d-43f5-bfee-23878fedd46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:35.631312 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1143/2275] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:32:35 2022] PUT /identity/v3/projects/7d20e987a86d4b168b6615f0542aafbb/users/d8b9fc4976a84d0db395a85afbc4dc9e/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:35.638864 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27854dbd-9dcf-4858-8ac3-1939eb18f6ad None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:35.639423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27854dbd-9dcf-4858-8ac3-1939eb18f6ad None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:35.640616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27854dbd-9dcf-4858-8ac3-1939eb18f6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:35.670180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-27854dbd-9dcf-4858-8ac3-1939eb18f6ad None None] MFA Rules not processed for user `67bfd102d61945519b8480abb37f305a`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:35.671745 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-27854dbd-9dcf-4858-8ac3-1939eb18f6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:35.699073 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-3268cf5c-3c7d-43f5-bfee-23878fedd46a None None] MFA Rules not processed for user `d8b9fc4976a84d0db395a85afbc4dc9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:35.700502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3268cf5c-3c7d-43f5-bfee-23878fedd46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:35.729315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:35.877517 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1144/2276] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:35.889347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1133/2277] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:35.910031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27854dbd-9dcf-4858-8ac3-1939eb18f6ad None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:35.917248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-27854dbd-9dcf-4858-8ac3-1939eb18f6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:35.918537 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268cf5c-3c7d-43f5-bfee-23878fedd46a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:35.920444 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3268cf5c-3c7d-43f5-bfee-23878fedd46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:36.038926 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27854dbd-9dcf-4858-8ac3-1939eb18f6ad None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:36.043459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e25f70-ae3d-40d1-977c-a617b60fcdc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:36.044264 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e25f70-ae3d-40d1-977c-a617b60fcdc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:36.044557 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e25f70-ae3d-40d1-977c-a617b60fcdc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:36.044894 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e25f70-ae3d-40d1-977c-a617b60fcdc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:36.068348 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e25f70-ae3d-40d1-977c-a617b60fcdc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:36.068348 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e25f70-ae3d-40d1-977c-a617b60fcdc1 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:36.078899 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1145/2278] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:36.138169 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:36.190291 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268cf5c-3c7d-43f5-bfee-23878fedd46a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:36.205703 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce340358-5d31-4ea0-bc97-2b064a244d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:36.206669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce340358-5d31-4ea0-bc97-2b064a244d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:36.207049 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce340358-5d31-4ea0-bc97-2b064a244d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:36.207567 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce340358-5d31-4ea0-bc97-2b064a244d4c admin admin] PATH_INFO: `/v3/users/05307f40edbd471d929b2e9645f09163` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:36.209687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce340358-5d31-4ea0-bc97-2b064a244d4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=05307f40edbd471d929b2e9645f09163)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:36.211852 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce340358-5d31-4ea0-bc97-2b064a244d4c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:36.341324 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ce340358-5d31-4ea0-bc97-2b064a244d4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05307f40edbd471d929b2e9645f09163'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:36.346006 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ce340358-5d31-4ea0-bc97-2b064a244d4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05307f40edbd471d929b2e9645f09163'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:36.373159 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ce340358-5d31-4ea0-bc97-2b064a244d4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05307f40edbd471d929b2e9645f09163'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:36.373693 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ce340358-5d31-4ea0-bc97-2b064a244d4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05307f40edbd471d929b2e9645f09163'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:36.393627 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ce340358-5d31-4ea0-bc97-2b064a244d4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05307f40edbd471d929b2e9645f09163'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:36.456095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1134/2279] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:35 2022] DELETE /identity/v3/users/05307f40edbd471d929b2e9645f09163 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:36.462001 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3c674-fb32-41ff-84af-3e4abec28b53 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:36.462909 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3c674-fb32-41ff-84af-3e4abec28b53 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:36.463350 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3c674-fb32-41ff-84af-3e4abec28b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:36.562613 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-61b3c674-fb32-41ff-84af-3e4abec28b53 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:36.575819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-61b3c674-fb32-41ff-84af-3e4abec28b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:36.855757 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1146/2280] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:36.953216 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce340358-5d31-4ea0-bc97-2b064a244d4c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:36.954899 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ce340358-5d31-4ea0-bc97-2b064a244d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:37.216216 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3c674-fb32-41ff-84af-3e4abec28b53 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:37.219599 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-61b3c674-fb32-41ff-84af-3e4abec28b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:37.231037 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce340358-5d31-4ea0-bc97-2b064a244d4c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:37.251594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe63762-34c0-4664-a1e4-16023c54e135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:37.252395 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe63762-34c0-4664-a1e4-16023c54e135 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:37.252680 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe63762-34c0-4664-a1e4-16023c54e135 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:37.253047 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe63762-34c0-4664-a1e4-16023c54e135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:37.305628 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe63762-34c0-4664-a1e4-16023c54e135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:37.307143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe63762-34c0-4664-a1e4-16023c54e135 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:37.331166 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1135/2281] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:37.398134 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3c674-fb32-41ff-84af-3e4abec28b53 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:37.402774 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba505d-0e59-43e8-9cc5-5f9fc695f16e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:37.403603 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba505d-0e59-43e8-9cc5-5f9fc695f16e service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:37.403888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba505d-0e59-43e8-9cc5-5f9fc695f16e service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:37.404784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba505d-0e59-43e8-9cc5-5f9fc695f16e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:37.406413 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-dfba505d-0e59-43e8-9cc5-5f9fc695f16e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:37.467945 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:37.563195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba505d-0e59-43e8-9cc5-5f9fc695f16e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:37.565029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba505d-0e59-43e8-9cc5-5f9fc695f16e service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:37.578433 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1147/2282] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:32:38.183823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3f986-401b-4efa-9fa2-90ab760df965 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:38.184291 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3f986-401b-4efa-9fa2-90ab760df965 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:38.184641 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3f986-401b-4efa-9fa2-90ab760df965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:38.275464 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-46c3f986-401b-4efa-9fa2-90ab760df965 None None] MFA Rules not processed for user `d8b9fc4976a84d0db395a85afbc4dc9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:38.280620 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-46c3f986-401b-4efa-9fa2-90ab760df965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:38.530734 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1136/2283] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:39.143798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba505d-0e59-43e8-9cc5-5f9fc695f16e service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:39.146492 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-dfba505d-0e59-43e8-9cc5-5f9fc695f16e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:39.221861 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba505d-0e59-43e8-9cc5-5f9fc695f16e service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:39.228235 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db044aaf-1c49-4e6f-926f-7563339c6a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:39.229147 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db044aaf-1c49-4e6f-926f-7563339c6a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:39.229726 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db044aaf-1c49-4e6f-926f-7563339c6a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:39.230153 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db044aaf-1c49-4e6f-926f-7563339c6a0a admin admin] PATH_INFO: `/v3/projects/f20b78390c0a4c828854ca3f7eae5a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:39.231606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db044aaf-1c49-4e6f-926f-7563339c6a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f20b78390c0a4c828854ca3f7eae5a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:39.243869 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db044aaf-1c49-4e6f-926f-7563339c6a0a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:39.373327 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-db044aaf-1c49-4e6f-926f-7563339c6a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f20b78390c0a4c828854ca3f7eae5a21', 'request_id': 'req-db044aaf-1c49-4e6f-926f-7563339c6a0a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:39.390118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-db044aaf-1c49-4e6f-926f-7563339c6a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f20b78390c0a4c828854ca3f7eae5a21', 'request_id': 'req-db044aaf-1c49-4e6f-926f-7563339c6a0a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:39.401487 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-db044aaf-1c49-4e6f-926f-7563339c6a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f20b78390c0a4c828854ca3f7eae5a21', 'request_id': 'req-db044aaf-1c49-4e6f-926f-7563339c6a0a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:39.443456 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-db044aaf-1c49-4e6f-926f-7563339c6a0a admin admin] The token cache is being invalidate because project f20b78390c0a4c828854ca3f7eae5a21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:39.443828 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-db044aaf-1c49-4e6f-926f-7563339c6a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:39.444532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-db044aaf-1c49-4e6f-926f-7563339c6a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:39.446541 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1148/2284] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:39 2022] DELETE /identity/v3/projects/f20b78390c0a4c828854ca3f7eae5a21 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:39.452319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3f986-401b-4efa-9fa2-90ab760df965 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:39.493723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3f986-401b-4efa-9fa2-90ab760df965 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:39.576379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:39.765985 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e3d60-da02-4420-8682-0d4f7f03dc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:39.766705 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e3d60-da02-4420-8682-0d4f7f03dc14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:39.766998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e3d60-da02-4420-8682-0d4f7f03dc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:39.767284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e3d60-da02-4420-8682-0d4f7f03dc14 admin admin] PATH_INFO: `/v3/users/90d6e9d356f94cf69d5fa2e6fb37ef16` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:39.770951 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e3d60-da02-4420-8682-0d4f7f03dc14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90d6e9d356f94cf69d5fa2e6fb37ef16)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:39.773173 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e3d60-da02-4420-8682-0d4f7f03dc14 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:39.870428 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-831e3d60-da02-4420-8682-0d4f7f03dc14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90d6e9d356f94cf69d5fa2e6fb37ef16'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:39.871370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-831e3d60-da02-4420-8682-0d4f7f03dc14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90d6e9d356f94cf69d5fa2e6fb37ef16'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:39.881981 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-831e3d60-da02-4420-8682-0d4f7f03dc14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90d6e9d356f94cf69d5fa2e6fb37ef16'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:39.883234 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-831e3d60-da02-4420-8682-0d4f7f03dc14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90d6e9d356f94cf69d5fa2e6fb37ef16'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:39.895546 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-831e3d60-da02-4420-8682-0d4f7f03dc14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90d6e9d356f94cf69d5fa2e6fb37ef16'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:39.946860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1137/2285] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:39 2022] DELETE /identity/v3/users/90d6e9d356f94cf69d5fa2e6fb37ef16 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:40.678264 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db044aaf-1c49-4e6f-926f-7563339c6a0a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:40.680368 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-db044aaf-1c49-4e6f-926f-7563339c6a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:40.700190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db044aaf-1c49-4e6f-926f-7563339c6a0a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:40.827973 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e6a76-89f3-4ea7-8e24-232b1dae0528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:40.828829 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e6a76-89f3-4ea7-8e24-232b1dae0528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:40.829373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e6a76-89f3-4ea7-8e24-232b1dae0528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:40.830722 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e6a76-89f3-4ea7-8e24-232b1dae0528 admin admin] PATH_INFO: `/v3/projects/2b8a962550f64e5a95409a14dd288f6e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:40.838560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e6a76-89f3-4ea7-8e24-232b1dae0528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b8a962550f64e5a95409a14dd288f6e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:40.841621 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e6a76-89f3-4ea7-8e24-232b1dae0528 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:40.943426 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:40.953942 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c66e6a76-89f3-4ea7-8e24-232b1dae0528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b8a962550f64e5a95409a14dd288f6e', 'request_id': 'req-c66e6a76-89f3-4ea7-8e24-232b1dae0528'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:40.967511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c66e6a76-89f3-4ea7-8e24-232b1dae0528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b8a962550f64e5a95409a14dd288f6e', 'request_id': 'req-c66e6a76-89f3-4ea7-8e24-232b1dae0528'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:40.980262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c66e6a76-89f3-4ea7-8e24-232b1dae0528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b8a962550f64e5a95409a14dd288f6e', 'request_id': 'req-c66e6a76-89f3-4ea7-8e24-232b1dae0528'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:40.998124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c66e6a76-89f3-4ea7-8e24-232b1dae0528 admin admin] The token cache is being invalidate because project 2b8a962550f64e5a95409a14dd288f6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:40.998399 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c66e6a76-89f3-4ea7-8e24-232b1dae0528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:40.999975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c66e6a76-89f3-4ea7-8e24-232b1dae0528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:41.014947 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1149/2286] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:40 2022] DELETE /identity/v3/projects/2b8a962550f64e5a95409a14dd288f6e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:32:41.638480 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cbcf9-7929-4b1b-ad78-59fdda665306 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:41.639026 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cbcf9-7929-4b1b-ad78-59fdda665306 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:41.639219 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cbcf9-7929-4b1b-ad78-59fdda665306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:41.687257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ff7cbcf9-7929-4b1b-ad78-59fdda665306 None None] MFA Rules not processed for user `33bb6f22057f47c1810d352c337fd9df`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:41.688577 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ff7cbcf9-7929-4b1b-ad78-59fdda665306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:41.805785 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1138/2287] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:41.816889 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e6a76-89f3-4ea7-8e24-232b1dae0528 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:41.818090 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c66e6a76-89f3-4ea7-8e24-232b1dae0528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:41.998868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e6a76-89f3-4ea7-8e24-232b1dae0528 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:42.007600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b14bf3-58b7-420c-bc06-5249bf1c5515 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:42.008253 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b14bf3-58b7-420c-bc06-5249bf1c5515 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:42.008539 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b14bf3-58b7-420c-bc06-5249bf1c5515 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:42.008857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b14bf3-58b7-420c-bc06-5249bf1c5515 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:42.010734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-41b14bf3-58b7-420c-bc06-5249bf1c5515 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:42.100377 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b14bf3-58b7-420c-bc06-5249bf1c5515 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:42.102540 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b14bf3-58b7-420c-bc06-5249bf1c5515 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:42.131963 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1150/2288] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:32:44.590062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8916c1b-8e0f-4ee0-918f-4d3b56fbcd5b None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:44.591152 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8916c1b-8e0f-4ee0-918f-4d3b56fbcd5b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:44.591440 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8916c1b-8e0f-4ee0-918f-4d3b56fbcd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:44.619727 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-b8916c1b-8e0f-4ee0-918f-4d3b56fbcd5b None None] MFA Rules not processed for user `a4eb634ea0334064a29d5c2ddc9d16ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:44.621291 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b8916c1b-8e0f-4ee0-918f-4d3b56fbcd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:44.630788 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1139/2289] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:52.120464 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=4,keystone:SELECT=63,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:54.607881 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:32:56.299879 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b14bf3-58b7-420c-bc06-5249bf1c5515 service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:56.301316 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-41b14bf3-58b7-420c-bc06-5249bf1c5515 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:56.369791 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b14bf3-58b7-420c-bc06-5249bf1c5515 service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:56.374324 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f0802-7212-43d7-ad77-e3cf6d19c129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:56.374961 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f0802-7212-43d7-ad77-e3cf6d19c129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:56.375249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f0802-7212-43d7-ad77-e3cf6d19c129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:56.375530 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f0802-7212-43d7-ad77-e3cf6d19c129 admin admin] PATH_INFO: `/v3/users/d86a34f543d54897abe5d81f096aeb95` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:56.377237 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f0802-7212-43d7-ad77-e3cf6d19c129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d86a34f543d54897abe5d81f096aeb95)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:56.379186 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f0802-7212-43d7-ad77-e3cf6d19c129 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:56.435456 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c96f0802-7212-43d7-ad77-e3cf6d19c129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd86a34f543d54897abe5d81f096aeb95'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:56.436129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c96f0802-7212-43d7-ad77-e3cf6d19c129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd86a34f543d54897abe5d81f096aeb95'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:56.453915 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c96f0802-7212-43d7-ad77-e3cf6d19c129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd86a34f543d54897abe5d81f096aeb95'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:56.454622 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c96f0802-7212-43d7-ad77-e3cf6d19c129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd86a34f543d54897abe5d81f096aeb95'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:56.472379 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c96f0802-7212-43d7-ad77-e3cf6d19c129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd86a34f543d54897abe5d81f096aeb95'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:56.487169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1151/2290] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:32:56 2022] DELETE /identity/v3/users/d86a34f543d54897abe5d81f096aeb95 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:32:56.491854 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48db4f-7664-4dd8-92d9-8f7038ef09be None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:56.492339 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48db4f-7664-4dd8-92d9-8f7038ef09be None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:56.492418 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48db4f-7664-4dd8-92d9-8f7038ef09be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:56.515765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-df48db4f-7664-4dd8-92d9-8f7038ef09be None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:32:56.518099 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-df48db4f-7664-4dd8-92d9-8f7038ef09be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:56.597011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1140/2291] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:32:56.607583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f0802-7212-43d7-ad77-e3cf6d19c129 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:56.609312 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c96f0802-7212-43d7-ad77-e3cf6d19c129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:56.670089 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f0802-7212-43d7-ad77-e3cf6d19c129 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:56.674676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b705f91-0eb6-4c9a-8cb6-05c0f174dbf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:56.675296 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b705f91-0eb6-4c9a-8cb6-05c0f174dbf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:56.675576 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b705f91-0eb6-4c9a-8cb6-05c0f174dbf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:56.675850 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b705f91-0eb6-4c9a-8cb6-05c0f174dbf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:56.686645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b705f91-0eb6-4c9a-8cb6-05c0f174dbf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:56.688124 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b705f91-0eb6-4c9a-8cb6-05c0f174dbf2 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:56.698147 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1152/2292] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:32:57.114157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48db4f-7664-4dd8-92d9-8f7038ef09be None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:32:57.115387 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-df48db4f-7664-4dd8-92d9-8f7038ef09be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:32:57.130200 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48db4f-7664-4dd8-92d9-8f7038ef09be None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:32:57.135455 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87c313-b03f-4cf1-b699-ec627036101c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:32:57.136394 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87c313-b03f-4cf1-b699-ec627036101c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:32:57.136672 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87c313-b03f-4cf1-b699-ec627036101c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:32:57.136996 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87c313-b03f-4cf1-b699-ec627036101c admin admin] PATH_INFO: `/v3/projects/2d6c6d1413f54195af952161945239b2` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:32:57.138279 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87c313-b03f-4cf1-b699-ec627036101c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d6c6d1413f54195af952161945239b2)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:32:57.140316 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87c313-b03f-4cf1-b699-ec627036101c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:32:57.201616 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ee87c313-b03f-4cf1-b699-ec627036101c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d6c6d1413f54195af952161945239b2', 'request_id': 'req-ee87c313-b03f-4cf1-b699-ec627036101c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:57.209814 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ee87c313-b03f-4cf1-b699-ec627036101c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d6c6d1413f54195af952161945239b2', 'request_id': 'req-ee87c313-b03f-4cf1-b699-ec627036101c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:57.218674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ee87c313-b03f-4cf1-b699-ec627036101c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d6c6d1413f54195af952161945239b2', 'request_id': 'req-ee87c313-b03f-4cf1-b699-ec627036101c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:57.237999 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ee87c313-b03f-4cf1-b699-ec627036101c admin admin] The token cache is being invalidate because project 2d6c6d1413f54195af952161945239b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:32:57.238296 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ee87c313-b03f-4cf1-b699-ec627036101c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:57.239002 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ee87c313-b03f-4cf1-b699-ec627036101c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:32:57.245306 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1141/2293] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:32:57 2022] DELETE /identity/v3/projects/2d6c6d1413f54195af952161945239b2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:33:01.477736 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8879e-bd38-4aa6-9bdd-902b477e6db4 None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:01.478268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8879e-bd38-4aa6-9bdd-902b477e6db4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:01.478695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8879e-bd38-4aa6-9bdd-902b477e6db4 None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:01.481209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1153/2294] 10.222.0.96 () {54 vars in 921 bytes} [Wed Aug 24 04:33:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:33:01.493707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8cc34-e9a7-45d1-aa03-23dcd5e6d80e None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:01.494215 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8cc34-e9a7-45d1-aa03-23dcd5e6d80e None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:01.494215 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8cc34-e9a7-45d1-aa03-23dcd5e6d80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:01.533787 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-92e8cc34-e9a7-45d1-aa03-23dcd5e6d80e None None] MFA Rules not processed for user `d1f7fe9af30947dbae1f2334b18f630d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:01.538116 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-92e8cc34-e9a7-45d1-aa03-23dcd5e6d80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:01.683358 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1142/2295] 10.222.0.96 () {58 vars in 1018 bytes} [Wed Aug 24 04:33:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:01.707618 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8879e-bd38-4aa6-9bdd-902b477e6db4 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:01.709749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-56a8879e-bd38-4aa6-9bdd-902b477e6db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:01.741966 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8879e-bd38-4aa6-9bdd-902b477e6db4 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:01.754885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13628e55-5154-43b9-b78f-55ac5784b0e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f7fe9af30947dbae1f2334b18f630d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:01.756254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13628e55-5154-43b9-b78f-55ac5784b0e8 service placement] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:01.757026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13628e55-5154-43b9-b78f-55ac5784b0e8 service placement] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:01.757565 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13628e55-5154-43b9-b78f-55ac5784b0e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:01.769176 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13628e55-5154-43b9-b78f-55ac5784b0e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:01.771837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13628e55-5154-43b9-b78f-55ac5784b0e8 service placement] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:01.794808 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1154/2296] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:33:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:33:02.571392 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8cc34-e9a7-45d1-aa03-23dcd5e6d80e None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:02.573050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-92e8cc34-e9a7-45d1-aa03-23dcd5e6d80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:02.619597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:02.674385 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8cc34-e9a7-45d1-aa03-23dcd5e6d80e None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:02.679425 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19859335-2df8-4859-9fb4-970eeffa48d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:02.680330 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19859335-2df8-4859-9fb4-970eeffa48d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:02.680534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19859335-2df8-4859-9fb4-970eeffa48d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:02.680828 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19859335-2df8-4859-9fb4-970eeffa48d5 admin admin] PATH_INFO: `/v3/users/1d12e3ba322845fc97f54765566d76fb` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:02.682000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19859335-2df8-4859-9fb4-970eeffa48d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d12e3ba322845fc97f54765566d76fb)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:02.683957 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19859335-2df8-4859-9fb4-970eeffa48d5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:02.754617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-19859335-2df8-4859-9fb4-970eeffa48d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d12e3ba322845fc97f54765566d76fb'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:02.755342 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-19859335-2df8-4859-9fb4-970eeffa48d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d12e3ba322845fc97f54765566d76fb'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:02.765154 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-19859335-2df8-4859-9fb4-970eeffa48d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d12e3ba322845fc97f54765566d76fb'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:02.765858 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-19859335-2df8-4859-9fb4-970eeffa48d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d12e3ba322845fc97f54765566d76fb'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:02.775680 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-19859335-2df8-4859-9fb4-970eeffa48d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d12e3ba322845fc97f54765566d76fb'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:02.795715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1143/2297] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:33:02 2022] DELETE /identity/v3/users/1d12e3ba322845fc97f54765566d76fb => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:33:03.077166 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13628e55-5154-43b9-b78f-55ac5784b0e8 service placement] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:03.104178 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13628e55-5154-43b9-b78f-55ac5784b0e8 service placement] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:03.119228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:03.200797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cc330-0927-4107-bd7e-06ffb3f87e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:03.201699 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cc330-0927-4107-bd7e-06ffb3f87e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:03.202129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cc330-0927-4107-bd7e-06ffb3f87e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:03.202577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cc330-0927-4107-bd7e-06ffb3f87e51 admin admin] PATH_INFO: `/v3/projects/2848d9fd529f486cbd00ffd395ae120a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:03.203963 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cc330-0927-4107-bd7e-06ffb3f87e51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2848d9fd529f486cbd00ffd395ae120a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:03.207569 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cc330-0927-4107-bd7e-06ffb3f87e51 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:03.286953 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4e8cc330-0927-4107-bd7e-06ffb3f87e51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2848d9fd529f486cbd00ffd395ae120a', 'request_id': 'req-4e8cc330-0927-4107-bd7e-06ffb3f87e51'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:03.310680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4e8cc330-0927-4107-bd7e-06ffb3f87e51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2848d9fd529f486cbd00ffd395ae120a', 'request_id': 'req-4e8cc330-0927-4107-bd7e-06ffb3f87e51'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:03.318934 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4e8cc330-0927-4107-bd7e-06ffb3f87e51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2848d9fd529f486cbd00ffd395ae120a', 'request_id': 'req-4e8cc330-0927-4107-bd7e-06ffb3f87e51'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:03.337730 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4e8cc330-0927-4107-bd7e-06ffb3f87e51 admin admin] The token cache is being invalidate because project 2848d9fd529f486cbd00ffd395ae120a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:33:03.337968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4e8cc330-0927-4107-bd7e-06ffb3f87e51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:03.338877 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-4e8cc330-0927-4107-bd7e-06ffb3f87e51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:03.340493 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1155/2298] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:33:03 2022] DELETE /identity/v3/projects/2848d9fd529f486cbd00ffd395ae120a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:33:03.344218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19859335-2df8-4859-9fb4-970eeffa48d5 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:03.346299 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-19859335-2df8-4859-9fb4-970eeffa48d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:03.360355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19859335-2df8-4859-9fb4-970eeffa48d5 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:03.440224 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4c4aa-5abe-4ea6-9c25-ba9c09e46e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:03.440997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4c4aa-5abe-4ea6-9c25-ba9c09e46e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:03.441282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4c4aa-5abe-4ea6-9c25-ba9c09e46e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:03.441559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4c4aa-5abe-4ea6-9c25-ba9c09e46e2d admin admin] PATH_INFO: `/v3/users/a4d06584b7574fffb8760b4f9e12e80d` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:03.442782 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4c4aa-5abe-4ea6-9c25-ba9c09e46e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4d06584b7574fffb8760b4f9e12e80d)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:03.445006 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4c4aa-5abe-4ea6-9c25-ba9c09e46e2d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:03.494945 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:03.509289 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2bc4c4aa-5abe-4ea6-9c25-ba9c09e46e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4d06584b7574fffb8760b4f9e12e80d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:03.510199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2bc4c4aa-5abe-4ea6-9c25-ba9c09e46e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4d06584b7574fffb8760b4f9e12e80d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:03.519148 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2bc4c4aa-5abe-4ea6-9c25-ba9c09e46e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4d06584b7574fffb8760b4f9e12e80d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:03.519839 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2bc4c4aa-5abe-4ea6-9c25-ba9c09e46e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4d06584b7574fffb8760b4f9e12e80d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:03.527620 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2bc4c4aa-5abe-4ea6-9c25-ba9c09e46e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4d06584b7574fffb8760b4f9e12e80d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:03.551913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1144/2299] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:33:03 2022] DELETE /identity/v3/users/a4d06584b7574fffb8760b4f9e12e80d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:33:03.763241 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cc330-0927-4107-bd7e-06ffb3f87e51 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:03.765310 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4e8cc330-0927-4107-bd7e-06ffb3f87e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:03.795470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cc330-0927-4107-bd7e-06ffb3f87e51 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:03.869422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57884f2-c172-4ce1-85a1-4e4dfe0dcae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:03.870267 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57884f2-c172-4ce1-85a1-4e4dfe0dcae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:03.870753 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57884f2-c172-4ce1-85a1-4e4dfe0dcae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:03.871131 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57884f2-c172-4ce1-85a1-4e4dfe0dcae4 admin admin] PATH_INFO: `/v3/projects/c5b697588fa14b218dd880d152f36c80` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:03.872714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57884f2-c172-4ce1-85a1-4e4dfe0dcae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5b697588fa14b218dd880d152f36c80)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:03.876183 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57884f2-c172-4ce1-85a1-4e4dfe0dcae4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:03.946925 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:03.963012 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b57884f2-c172-4ce1-85a1-4e4dfe0dcae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5b697588fa14b218dd880d152f36c80', 'request_id': 'req-b57884f2-c172-4ce1-85a1-4e4dfe0dcae4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:03.991211 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b57884f2-c172-4ce1-85a1-4e4dfe0dcae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5b697588fa14b218dd880d152f36c80', 'request_id': 'req-b57884f2-c172-4ce1-85a1-4e4dfe0dcae4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:04.007712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b57884f2-c172-4ce1-85a1-4e4dfe0dcae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5b697588fa14b218dd880d152f36c80', 'request_id': 'req-b57884f2-c172-4ce1-85a1-4e4dfe0dcae4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:04.023263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b57884f2-c172-4ce1-85a1-4e4dfe0dcae4 admin admin] The token cache is being invalidate because project c5b697588fa14b218dd880d152f36c80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:33:04.023559 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b57884f2-c172-4ce1-85a1-4e4dfe0dcae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:04.024245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b57884f2-c172-4ce1-85a1-4e4dfe0dcae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:04.026048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1156/2300] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:33:03 2022] DELETE /identity/v3/projects/c5b697588fa14b218dd880d152f36c80 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:33:04.031132 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6decc-be93-4ddd-a57c-cea600e9dc59 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:04.032404 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6decc-be93-4ddd-a57c-cea600e9dc59 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:04.033647 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6decc-be93-4ddd-a57c-cea600e9dc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:04.063386 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-7ab6decc-be93-4ddd-a57c-cea600e9dc59 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:04.066681 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7ab6decc-be93-4ddd-a57c-cea600e9dc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:04.146807 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1145/2301] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:33:04.156300 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1414194-18a7-4286-840e-84f8c861c2c2 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:04.156984 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1414194-18a7-4286-840e-84f8c861c2c2 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:04.157161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1414194-18a7-4286-840e-84f8c861c2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:04.181878 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-b1414194-18a7-4286-840e-84f8c861c2c2 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:04.183188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b1414194-18a7-4286-840e-84f8c861c2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:04.189057 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5f9ca-714e-432a-8c03-04b50d65a841 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:04.190072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5f9ca-714e-432a-8c03-04b50d65a841 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:04.190556 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5f9ca-714e-432a-8c03-04b50d65a841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:04.196573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1157/2302] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:04.197564 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1414194-18a7-4286-840e-84f8c861c2c2 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:04.208349 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1414194-18a7-4286-840e-84f8c861c2c2 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:04.212891 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-0aa5f9ca-714e-432a-8c03-04b50d65a841 None None] MFA Rules not processed for user `e9ffc48d1f6d49f49d00d1c2e762b987`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:04.214074 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac54185-6792-411b-9c1b-590e292302aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:04.214678 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0aa5f9ca-714e-432a-8c03-04b50d65a841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:04.214801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac54185-6792-411b-9c1b-590e292302aa admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:04.214991 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac54185-6792-411b-9c1b-590e292302aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:04.215253 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac54185-6792-411b-9c1b-590e292302aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:04.216149 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac54185-6792-411b-9c1b-590e292302aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:04.216882 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac54185-6792-411b-9c1b-590e292302aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:04.219337 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac54185-6792-411b-9c1b-590e292302aa admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:04.250524 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1158/2303] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:04.252706 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac54185-6792-411b-9c1b-590e292302aa admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:04.267557 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac54185-6792-411b-9c1b-590e292302aa admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:04.276861 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9c4f5-9847-4053-9ab4-c71f5b8c8450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:04.278834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9c4f5-9847-4053-9ab4-c71f5b8c8450 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:04.279393 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9c4f5-9847-4053-9ab4-c71f5b8c8450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:04.280055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9c4f5-9847-4053-9ab4-c71f5b8c8450 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:04.280794 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9c4f5-9847-4053-9ab4-c71f5b8c8450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:04.283213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9c4f5-9847-4053-9ab4-c71f5b8c8450 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:04.319319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1146/2304] 10.222.0.96 () {58 vars in 1009 bytes} [Wed Aug 24 04:33:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:04.332903 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1159/2305] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:33:04 2022] POST /identity/v3/projects => generated 361 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:33:04.337035 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5f9ca-714e-432a-8c03-04b50d65a841 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:04.351713 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5f9ca-714e-432a-8c03-04b50d65a841 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:04.376207 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9c4f5-9847-4053-9ab4-c71f5b8c8450 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:04.378489 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a7f9c4f5-9847-4053-9ab4-c71f5b8c8450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:04.443578 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac63959-4fda-4d47-a6c4-90d0e4a1826c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:04.444793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac63959-4fda-4d47-a6c4-90d0e4a1826c admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:04.445290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac63959-4fda-4d47-a6c4-90d0e4a1826c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:04.445705 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac63959-4fda-4d47-a6c4-90d0e4a1826c admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:04.446488 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac63959-4fda-4d47-a6c4-90d0e4a1826c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:04.449180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac63959-4fda-4d47-a6c4-90d0e4a1826c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:04.465581 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:04.471472 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9c4f5-9847-4053-9ab4-c71f5b8c8450 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:04.485781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb8e17c-334f-43c6-8d67-c9697053ffc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953d2dbd5e7d435f9148fd043b4ce7a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:04.487823 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8e17c-334f-43c6-8d67-c9697053ffc5 service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:04.488110 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1147/2306] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:33:04 2022] POST /identity/v3/users => generated 281 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:33:04.489069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac63959-4fda-4d47-a6c4-90d0e4a1826c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:04.489184 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8e17c-334f-43c6-8d67-c9697053ffc5 service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:04.489596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb8e17c-334f-43c6-8d67-c9697053ffc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:04.499903 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac63959-4fda-4d47-a6c4-90d0e4a1826c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:04.505487 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142e0c4-a281-43bb-a307-475048f582f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:04.506049 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142e0c4-a281-43bb-a307-475048f582f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:04.506342 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142e0c4-a281-43bb-a307-475048f582f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:04.507247 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142e0c4-a281-43bb-a307-475048f582f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:04.507513 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142e0c4-a281-43bb-a307-475048f582f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:04.510947 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142e0c4-a281-43bb-a307-475048f582f6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:04.527593 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1148/2307] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:33:04.533519 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142e0c4-a281-43bb-a307-475048f582f6 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:04.555151 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142e0c4-a281-43bb-a307-475048f582f6 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:04.567257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccaf87-c244-48e0-ae91-04430fdba404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:04.569428 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccaf87-c244-48e0-ae91-04430fdba404 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:04.570920 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccaf87-c244-48e0-ae91-04430fdba404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:04.571974 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccaf87-c244-48e0-ae91-04430fdba404 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:04.573119 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccaf87-c244-48e0-ae91-04430fdba404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:04.577290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccaf87-c244-48e0-ae91-04430fdba404 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:04.600745 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1149/2308] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:33:04.602266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccaf87-c244-48e0-ae91-04430fdba404 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:04.608210 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8e17c-334f-43c6-8d67-c9697053ffc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:04.610429 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb8e17c-334f-43c6-8d67-c9697053ffc5 service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:04.619182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccaf87-c244-48e0-ae91-04430fdba404 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:04.628200 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d81fd-0e2f-4ea2-800f-f0a91af8982c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:04.629152 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d81fd-0e2f-4ea2-800f-f0a91af8982c admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:04.629975 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d81fd-0e2f-4ea2-800f-f0a91af8982c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:04.629975 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d81fd-0e2f-4ea2-800f-f0a91af8982c admin admin] PATH_INFO: `/v3/projects/5f72fb28f7f84a01b06ffa3b4ef5b468/users/b584ef89736540a09a32305cbcd87c6a/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:04.641369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1160/2309] 10.222.0.96 () {60 vars in 1384 bytes} [Wed Aug 24 04:33:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 04:33:04.657308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d81fd-0e2f-4ea2-800f-f0a91af8982c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f72fb28f7f84a01b06ffa3b4ef5b468, user_id=b584ef89736540a09a32305cbcd87c6a, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:04.661312 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d81fd-0e2f-4ea2-800f-f0a91af8982c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:04.692598 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1150/2310] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:33:04 2022] PUT /identity/v3/projects/5f72fb28f7f84a01b06ffa3b4ef5b468/users/b584ef89736540a09a32305cbcd87c6a/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:33:04.707118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d36ece-9579-4479-9c10-d5f32ebed206 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:04.707551 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d36ece-9579-4479-9c10-d5f32ebed206 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:04.707925 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d36ece-9579-4479-9c10-d5f32ebed206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:04.765797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-70d36ece-9579-4479-9c10-d5f32ebed206 None None] MFA Rules not processed for user `b584ef89736540a09a32305cbcd87c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:04.768113 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-70d36ece-9579-4479-9c10-d5f32ebed206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:04.796145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:04.886486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1161/2311] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:04.957792 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d81fd-0e2f-4ea2-800f-f0a91af8982c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:04.960762 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7f8d81fd-0e2f-4ea2-800f-f0a91af8982c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:05.066272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d81fd-0e2f-4ea2-800f-f0a91af8982c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:05.070748 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad600b-907a-4abb-959d-8a6b9ec4e4cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:05.071452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad600b-907a-4abb-959d-8a6b9ec4e4cc service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:05.071859 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad600b-907a-4abb-959d-8a6b9ec4e4cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:05.072191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad600b-907a-4abb-959d-8a6b9ec4e4cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:05.085266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad600b-907a-4abb-959d-8a6b9ec4e4cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:05.087744 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad600b-907a-4abb-959d-8a6b9ec4e4cc service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:05.117647 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1151/2312] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:33:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:33:05.117775 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d36ece-9579-4479-9c10-d5f32ebed206 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:05.222433 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d36ece-9579-4479-9c10-d5f32ebed206 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:05.241612 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c792d-3d30-480d-979f-b8ffad4f973c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:05.243592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c792d-3d30-480d-979f-b8ffad4f973c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:05.244133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c792d-3d30-480d-979f-b8ffad4f973c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:05.244568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c792d-3d30-480d-979f-b8ffad4f973c admin admin] PATH_INFO: `/v3/users/b584ef89736540a09a32305cbcd87c6a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:05.246639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c792d-3d30-480d-979f-b8ffad4f973c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b584ef89736540a09a32305cbcd87c6a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:05.252488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c792d-3d30-480d-979f-b8ffad4f973c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:05.333923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-015c792d-3d30-480d-979f-b8ffad4f973c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b584ef89736540a09a32305cbcd87c6a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:05.334811 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-015c792d-3d30-480d-979f-b8ffad4f973c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b584ef89736540a09a32305cbcd87c6a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:05.347384 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-015c792d-3d30-480d-979f-b8ffad4f973c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b584ef89736540a09a32305cbcd87c6a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:05.352354 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-015c792d-3d30-480d-979f-b8ffad4f973c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b584ef89736540a09a32305cbcd87c6a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:05.381420 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-015c792d-3d30-480d-979f-b8ffad4f973c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b584ef89736540a09a32305cbcd87c6a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:05.401165 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1162/2313] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:33:05 2022] DELETE /identity/v3/users/b584ef89736540a09a32305cbcd87c6a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:33:05.405773 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309eae4-7e0c-42e2-8b4e-cbed8282f1b1 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:05.406063 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309eae4-7e0c-42e2-8b4e-cbed8282f1b1 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:05.406344 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309eae4-7e0c-42e2-8b4e-cbed8282f1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:05.449180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-7309eae4-7e0c-42e2-8b4e-cbed8282f1b1 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:05.450674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7309eae4-7e0c-42e2-8b4e-cbed8282f1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:05.499323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7dc78c-9ba6-4c1a-9f01-c2c91125b00f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:05.499881 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7dc78c-9ba6-4c1a-9f01-c2c91125b00f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:05.500312 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7dc78c-9ba6-4c1a-9f01-c2c91125b00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:05.529641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-3f7dc78c-9ba6-4c1a-9f01-c2c91125b00f None None] MFA Rules not processed for user `e9ffc48d1f6d49f49d00d1c2e762b987`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:05.531282 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3f7dc78c-9ba6-4c1a-9f01-c2c91125b00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:05.571874 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1152/2314] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:05.583089 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309eae4-7e0c-42e2-8b4e-cbed8282f1b1 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:05.584787 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7309eae4-7e0c-42e2-8b4e-cbed8282f1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:05.591754 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:05.632315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1163/2315] 10.222.0.96 () {58 vars in 967 bytes} [Wed Aug 24 04:33:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:33:05.647981 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7dc78c-9ba6-4c1a-9f01-c2c91125b00f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:05.649724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3f7dc78c-9ba6-4c1a-9f01-c2c91125b00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:05.701401 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309eae4-7e0c-42e2-8b4e-cbed8282f1b1 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:05.714141 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a834c-75f2-4cd4-acf6-9acc581ac2a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:05.714790 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a834c-75f2-4cd4-acf6-9acc581ac2a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:05.715078 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a834c-75f2-4cd4-acf6-9acc581ac2a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:05.715355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a834c-75f2-4cd4-acf6-9acc581ac2a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:05.729748 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:05.739297 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a834c-75f2-4cd4-acf6-9acc581ac2a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:05.743744 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a834c-75f2-4cd4-acf6-9acc581ac2a8 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:05.767844 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7dc78c-9ba6-4c1a-9f01-c2c91125b00f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:05.774224 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1153/2316] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:33:05.779053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66567153-707f-471c-b4a3-29fbe6e05a2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953d2dbd5e7d435f9148fd043b4ce7a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:05.779824 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66567153-707f-471c-b4a3-29fbe6e05a2d service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:05.780203 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66567153-707f-471c-b4a3-29fbe6e05a2d service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:05.780584 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66567153-707f-471c-b4a3-29fbe6e05a2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:05.793285 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66567153-707f-471c-b4a3-29fbe6e05a2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:05.795349 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66567153-707f-471c-b4a3-29fbe6e05a2d service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:05.807297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1164/2317] 10.222.0.96 () {60 vars in 1384 bytes} [Wed Aug 24 04:33:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 04:33:06.280497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66567153-707f-471c-b4a3-29fbe6e05a2d service swift] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:06.281422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbe308-2b9e-403d-8e38-046f7db0bed3 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:06.281796 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbe308-2b9e-403d-8e38-046f7db0bed3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:06.282007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-66567153-707f-471c-b4a3-29fbe6e05a2d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:06.282230 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcbe308-2b9e-403d-8e38-046f7db0bed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:06.303415 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66567153-707f-471c-b4a3-29fbe6e05a2d service swift] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:06.309465 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c0d79-121a-4b7b-966f-683b318da9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:06.310120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c0d79-121a-4b7b-966f-683b318da9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:06.310408 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c0d79-121a-4b7b-966f-683b318da9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:06.310693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c0d79-121a-4b7b-966f-683b318da9bb admin admin] PATH_INFO: `/v3/projects/5f72fb28f7f84a01b06ffa3b4ef5b468` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:06.312132 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c0d79-121a-4b7b-966f-683b318da9bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f72fb28f7f84a01b06ffa3b4ef5b468)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:06.315598 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c0d79-121a-4b7b-966f-683b318da9bb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:06.320487 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-efcbe308-2b9e-403d-8e38-046f7db0bed3 None None] MFA Rules not processed for user `e9ffc48d1f6d49f49d00d1c2e762b987`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:06.321951 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-efcbe308-2b9e-403d-8e38-046f7db0bed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:06.331289 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1154/2318] 10.222.0.96 () {58 vars in 1009 bytes} [Wed Aug 24 04:33:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:06.344135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcbe308-2b9e-403d-8e38-046f7db0bed3 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:06.359186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcbe308-2b9e-403d-8e38-046f7db0bed3 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:06.375258 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ab1f6-0f5f-4678-a76c-72872d6ee7e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953d2dbd5e7d435f9148fd043b4ce7a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:06.376006 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ab1f6-0f5f-4678-a76c-72872d6ee7e6 service swift] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:06.376297 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ab1f6-0f5f-4678-a76c-72872d6ee7e6 service swift] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:06.376631 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ab1f6-0f5f-4678-a76c-72872d6ee7e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:06.386421 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-770c0d79-121a-4b7b-966f-683b318da9bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f72fb28f7f84a01b06ffa3b4ef5b468', 'request_id': 'req-770c0d79-121a-4b7b-966f-683b318da9bb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:06.402782 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ab1f6-0f5f-4678-a76c-72872d6ee7e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:06.404646 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ab1f6-0f5f-4678-a76c-72872d6ee7e6 service swift] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:06.406615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-770c0d79-121a-4b7b-966f-683b318da9bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f72fb28f7f84a01b06ffa3b4ef5b468', 'request_id': 'req-770c0d79-121a-4b7b-966f-683b318da9bb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:06.415452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1155/2319] 10.222.0.96 () {60 vars in 1384 bytes} [Wed Aug 24 04:33:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 04:33:06.426992 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-770c0d79-121a-4b7b-966f-683b318da9bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f72fb28f7f84a01b06ffa3b4ef5b468', 'request_id': 'req-770c0d79-121a-4b7b-966f-683b318da9bb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:06.449530 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-770c0d79-121a-4b7b-966f-683b318da9bb admin admin] The token cache is being invalidate because project 5f72fb28f7f84a01b06ffa3b4ef5b468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:33:06.449835 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-770c0d79-121a-4b7b-966f-683b318da9bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:06.450508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-770c0d79-121a-4b7b-966f-683b318da9bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:06.452128 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1165/2320] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:33:06 2022] DELETE /identity/v3/projects/5f72fb28f7f84a01b06ffa3b4ef5b468 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:33:06.458333 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2c124-ea72-4744-ab8d-628b8e9d216d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:06.458782 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2c124-ea72-4744-ab8d-628b8e9d216d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:06.459195 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2c124-ea72-4744-ab8d-628b8e9d216d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:06.481190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-5cb2c124-ea72-4744-ab8d-628b8e9d216d None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:06.482394 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5cb2c124-ea72-4744-ab8d-628b8e9d216d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:06.557038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1156/2321] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:06.565290 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab59fe5-82b4-41f4-b376-3418bbebd5d0 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:06.565585 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab59fe5-82b4-41f4-b376-3418bbebd5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:06.565873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab59fe5-82b4-41f4-b376-3418bbebd5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:06.590256 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4ab59fe5-82b4-41f4-b376-3418bbebd5d0 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:06.591553 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4ab59fe5-82b4-41f4-b376-3418bbebd5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:06.604510 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1166/2322] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:06.608751 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2c124-ea72-4744-ab8d-628b8e9d216d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:06.626444 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2c124-ea72-4744-ab8d-628b8e9d216d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:06.632582 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1af936-26f8-4512-8728-cdc546e3ddb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:06.633393 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1af936-26f8-4512-8728-cdc546e3ddb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:06.633747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1af936-26f8-4512-8728-cdc546e3ddb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:06.634022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1af936-26f8-4512-8728-cdc546e3ddb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:06.634683 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1af936-26f8-4512-8728-cdc546e3ddb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:06.634990 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1af936-26f8-4512-8728-cdc546e3ddb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:06.636586 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1af936-26f8-4512-8728-cdc546e3ddb3 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:06.649980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1157/2323] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:33:06.654342 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab59fe5-82b4-41f4-b376-3418bbebd5d0 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:06.668663 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab59fe5-82b4-41f4-b376-3418bbebd5d0 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:06.678508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abf33b-c4ed-4f73-b798-02214f93cd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:06.679000 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abf33b-c4ed-4f73-b798-02214f93cd03 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:06.679280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abf33b-c4ed-4f73-b798-02214f93cd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:06.679557 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abf33b-c4ed-4f73-b798-02214f93cd03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:06.680201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abf33b-c4ed-4f73-b798-02214f93cd03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:06.682286 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abf33b-c4ed-4f73-b798-02214f93cd03 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:06.746781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1167/2324] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:33:06 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:33:06.750658 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1af936-26f8-4512-8728-cdc546e3ddb3 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:06.773776 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1af936-26f8-4512-8728-cdc546e3ddb3 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:06.831941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627245b5-eb42-4634-9e3b-4bba3daa3de4 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:06.831941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627245b5-eb42-4634-9e3b-4bba3daa3de4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:06.832168 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627245b5-eb42-4634-9e3b-4bba3daa3de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:06.862172 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-627245b5-eb42-4634-9e3b-4bba3daa3de4 None None] MFA Rules not processed for user `e9ffc48d1f6d49f49d00d1c2e762b987`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:06.863399 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-627245b5-eb42-4634-9e3b-4bba3daa3de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:06.874516 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb0ed7-b627-4824-9ee2-4863f9fb6d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:06.875133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb0ed7-b627-4824-9ee2-4863f9fb6d60 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:06.875413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb0ed7-b627-4824-9ee2-4863f9fb6d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:06.875690 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb0ed7-b627-4824-9ee2-4863f9fb6d60 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:06.876319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb0ed7-b627-4824-9ee2-4863f9fb6d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:06.879585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb0ed7-b627-4824-9ee2-4863f9fb6d60 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:06.906866 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1158/2325] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:33:06 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:33:06.910311 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:06.911276 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb0ed7-b627-4824-9ee2-4863f9fb6d60 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:06.924031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb0ed7-b627-4824-9ee2-4863f9fb6d60 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:06.930796 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2cbfd-1833-4ccd-a4fb-4ce1352eeec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:06.931706 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2cbfd-1833-4ccd-a4fb-4ce1352eeec6 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:06.931991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2cbfd-1833-4ccd-a4fb-4ce1352eeec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:06.932261 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2cbfd-1833-4ccd-a4fb-4ce1352eeec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:06.933002 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2cbfd-1833-4ccd-a4fb-4ce1352eeec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:06.934602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2cbfd-1833-4ccd-a4fb-4ce1352eeec6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:06.951461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1159/2326] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:33:06.955804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2cbfd-1833-4ccd-a4fb-4ce1352eeec6 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:06.962091 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1168/2327] 10.222.0.96 () {58 vars in 967 bytes} [Wed Aug 24 04:33:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:06.970033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2cbfd-1833-4ccd-a4fb-4ce1352eeec6 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:06.975217 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627245b5-eb42-4634-9e3b-4bba3daa3de4 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:06.975673 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a2480-9516-440f-8425-cabe3c20039c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:06.976327 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a2480-9516-440f-8425-cabe3c20039c admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:06.976589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-627245b5-eb42-4634-9e3b-4bba3daa3de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:06.976718 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a2480-9516-440f-8425-cabe3c20039c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:06.976945 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a2480-9516-440f-8425-cabe3c20039c admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:06.977594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a2480-9516-440f-8425-cabe3c20039c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:06.979321 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a2480-9516-440f-8425-cabe3c20039c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:06.993269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1160/2328] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:33:06.994331 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a2480-9516-440f-8425-cabe3c20039c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:07.004564 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a2480-9516-440f-8425-cabe3c20039c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:07.009147 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266f8db-83b8-4305-a3ac-002d121affae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:07.009786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266f8db-83b8-4305-a3ac-002d121affae admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:07.010069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266f8db-83b8-4305-a3ac-002d121affae admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:07.010345 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266f8db-83b8-4305-a3ac-002d121affae admin admin] PATH_INFO: `/v3/projects/1e2bfebf517942eebae2b1de0b1a66b7/users/e1da32f5da30461a86cd8fd717b4acee/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:07.026562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266f8db-83b8-4305-a3ac-002d121affae admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2bfebf517942eebae2b1de0b1a66b7, user_id=e1da32f5da30461a86cd8fd717b4acee, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:07.030494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266f8db-83b8-4305-a3ac-002d121affae admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:07.051856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1161/2329] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:33:06 2022] PUT /identity/v3/projects/1e2bfebf517942eebae2b1de0b1a66b7/users/e1da32f5da30461a86cd8fd717b4acee/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:33:07.054348 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627245b5-eb42-4634-9e3b-4bba3daa3de4 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:07.063050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ad4c4-62b5-4764-a89b-f9d7d03df278 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:07.063348 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ad4c4-62b5-4764-a89b-f9d7d03df278 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:07.063628 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ad4c4-62b5-4764-a89b-f9d7d03df278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:07.072416 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:07.094114 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-285ad4c4-62b5-4764-a89b-f9d7d03df278 None None] MFA Rules not processed for user `e1da32f5da30461a86cd8fd717b4acee`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:07.095945 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-285ad4c4-62b5-4764-a89b-f9d7d03df278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:07.118425 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bcc79-a262-43f9-ba9a-0cf329ab00fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953d2dbd5e7d435f9148fd043b4ce7a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:07.119048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bcc79-a262-43f9-ba9a-0cf329ab00fa service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:07.119332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bcc79-a262-43f9-ba9a-0cf329ab00fa service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:07.119606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bcc79-a262-43f9-ba9a-0cf329ab00fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:07.166422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1162/2330] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:33:07.170737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ad4c4-62b5-4764-a89b-f9d7d03df278 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:07.181965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382bcc79-a262-43f9-ba9a-0cf329ab00fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:07.184065 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382bcc79-a262-43f9-ba9a-0cf329ab00fa service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:07.193174 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1169/2331] 10.222.0.96 () {60 vars in 1384 bytes} [Wed Aug 24 04:33:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 04:33:07.245786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ad4c4-62b5-4764-a89b-f9d7d03df278 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:07.252126 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fc822-e774-433c-a1ee-52fb2b299b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:07.252849 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fc822-e774-433c-a1ee-52fb2b299b2a admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:07.253198 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fc822-e774-433c-a1ee-52fb2b299b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:07.253539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fc822-e774-433c-a1ee-52fb2b299b2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:07.254708 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fc822-e774-433c-a1ee-52fb2b299b2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:07.256426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fc822-e774-433c-a1ee-52fb2b299b2a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:07.288425 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1163/2332] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:33:07 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:33:07.292539 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bcc79-a262-43f9-ba9a-0cf329ab00fa service swift] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:07.303613 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bcc79-a262-43f9-ba9a-0cf329ab00fa service swift] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:07.319263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:07.388589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27781c0e-fc26-4abb-b6e7-04693089fd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:07.389423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27781c0e-fc26-4abb-b6e7-04693089fd55 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:07.389808 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27781c0e-fc26-4abb-b6e7-04693089fd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:07.390192 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27781c0e-fc26-4abb-b6e7-04693089fd55 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:07.390982 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27781c0e-fc26-4abb-b6e7-04693089fd55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:07.394050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27781c0e-fc26-4abb-b6e7-04693089fd55 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:07.425845 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1170/2333] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:33:07 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:33:07.429993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fc822-e774-433c-a1ee-52fb2b299b2a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:07.442822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fc822-e774-433c-a1ee-52fb2b299b2a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:07.448950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c099600-92e4-46f6-9e45-c84189fd19a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:07.449637 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c099600-92e4-46f6-9e45-c84189fd19a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:07.449931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c099600-92e4-46f6-9e45-c84189fd19a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:07.450213 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c099600-92e4-46f6-9e45-c84189fd19a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:07.450872 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c099600-92e4-46f6-9e45-c84189fd19a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:07.452459 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c099600-92e4-46f6-9e45-c84189fd19a2 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:07.470178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1164/2334] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:33:07.471823 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27781c0e-fc26-4abb-b6e7-04693089fd55 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:07.483096 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27781c0e-fc26-4abb-b6e7-04693089fd55 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:07.487855 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6139426-db24-403d-8956-c2431b956b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:07.488468 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6139426-db24-403d-8956-c2431b956b7d admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:07.488813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6139426-db24-403d-8956-c2431b956b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:07.489098 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6139426-db24-403d-8956-c2431b956b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:07.493178 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6139426-db24-403d-8956-c2431b956b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:07.493178 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6139426-db24-403d-8956-c2431b956b7d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:07.503464 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1171/2335] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:33:07.507152 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c099600-92e4-46f6-9e45-c84189fd19a2 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:07.521486 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c099600-92e4-46f6-9e45-c84189fd19a2 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:07.526798 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea666fe-bb18-4d4c-9386-680367e92e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:07.527574 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea666fe-bb18-4d4c-9386-680367e92e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:07.528014 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea666fe-bb18-4d4c-9386-680367e92e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:07.528583 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea666fe-bb18-4d4c-9386-680367e92e6e admin admin] PATH_INFO: `/v3/projects/243727ecee4a4a45bb19a293e3c7f9b2/users/7bbf3e8ac1bb42878448135b39f8645d/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:07.549258 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea666fe-bb18-4d4c-9386-680367e92e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=243727ecee4a4a45bb19a293e3c7f9b2, user_id=7bbf3e8ac1bb42878448135b39f8645d, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:07.552271 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea666fe-bb18-4d4c-9386-680367e92e6e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:07.570524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1165/2336] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:33:07 2022] PUT /identity/v3/projects/243727ecee4a4a45bb19a293e3c7f9b2/users/7bbf3e8ac1bb42878448135b39f8645d/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:33:07.581041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6546cad-cef5-44e2-bd15-7a4779f7072c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:07.581334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6546cad-cef5-44e2-bd15-7a4779f7072c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:07.581614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6546cad-cef5-44e2-bd15-7a4779f7072c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:07.612794 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f6546cad-cef5-44e2-bd15-7a4779f7072c None None] MFA Rules not processed for user `7bbf3e8ac1bb42878448135b39f8645d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:07.614075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f6546cad-cef5-44e2-bd15-7a4779f7072c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:07.695888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1172/2337] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:07.700855 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea666fe-bb18-4d4c-9386-680367e92e6e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:07.756116 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:07.774221 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea666fe-bb18-4d4c-9386-680367e92e6e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:07.779011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f83b65-336d-4fbb-a06e-6b324234615e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:07.779627 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f83b65-336d-4fbb-a06e-6b324234615e admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:07.779911 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f83b65-336d-4fbb-a06e-6b324234615e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:07.780192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f83b65-336d-4fbb-a06e-6b324234615e admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:07.780858 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f83b65-336d-4fbb-a06e-6b324234615e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:07.783352 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f83b65-336d-4fbb-a06e-6b324234615e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:07.819062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1166/2338] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:33:07 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:33:07.823818 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6546cad-cef5-44e2-bd15-7a4779f7072c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:07.838871 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6546cad-cef5-44e2-bd15-7a4779f7072c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:07.901984 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866950b7-00d4-4962-9aa1-32c5f8907a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:07.902695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866950b7-00d4-4962-9aa1-32c5f8907a4b admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:07.903095 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866950b7-00d4-4962-9aa1-32c5f8907a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:07.903463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866950b7-00d4-4962-9aa1-32c5f8907a4b admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:07.904160 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866950b7-00d4-4962-9aa1-32c5f8907a4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:07.906165 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866950b7-00d4-4962-9aa1-32c5f8907a4b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:07.932326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1173/2339] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:33:07 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:33:07.936296 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f83b65-336d-4fbb-a06e-6b324234615e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:07.948631 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f83b65-336d-4fbb-a06e-6b324234615e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:07.953933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195d9eb-dcdf-43da-9953-bd4bd8fff50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:07.954587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195d9eb-dcdf-43da-9953-bd4bd8fff50d admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:07.954953 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195d9eb-dcdf-43da-9953-bd4bd8fff50d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:07.955292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195d9eb-dcdf-43da-9953-bd4bd8fff50d admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:07.956120 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195d9eb-dcdf-43da-9953-bd4bd8fff50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:07.957767 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195d9eb-dcdf-43da-9953-bd4bd8fff50d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:07.971014 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1167/2340] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:33:07.975188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866950b7-00d4-4962-9aa1-32c5f8907a4b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:07.987174 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866950b7-00d4-4962-9aa1-32c5f8907a4b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:07.993118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7762f-c644-404a-9d50-b853eb12cf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:07.993816 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7762f-c644-404a-9d50-b853eb12cf84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:07.994093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7762f-c644-404a-9d50-b853eb12cf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:07.994367 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7762f-c644-404a-9d50-b853eb12cf84 admin admin] PATH_INFO: `/v3/projects/b7762e0d9ff8454a848182dee65a82e8/users/2f6eb0face8b40a5b741752e2fc09e3b/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:08.009401 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:08.018826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7762f-c644-404a-9d50-b853eb12cf84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7762e0d9ff8454a848182dee65a82e8, user_id=2f6eb0face8b40a5b741752e2fc09e3b, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:08.025260 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7762f-c644-404a-9d50-b853eb12cf84 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:08.044728 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1174/2341] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:33:07 2022] PUT /identity/v3/projects/b7762e0d9ff8454a848182dee65a82e8/users/2f6eb0face8b40a5b741752e2fc09e3b/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:33:08.049882 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195d9eb-dcdf-43da-9953-bd4bd8fff50d admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:08.060935 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195d9eb-dcdf-43da-9953-bd4bd8fff50d admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:08.153213 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295ebc7-d8da-4062-9d4d-8a07862026b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:08.153844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295ebc7-d8da-4062-9d4d-8a07862026b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:08.154146 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295ebc7-d8da-4062-9d4d-8a07862026b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:08.154528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295ebc7-d8da-4062-9d4d-8a07862026b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:08.155185 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295ebc7-d8da-4062-9d4d-8a07862026b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:08.156818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295ebc7-d8da-4062-9d4d-8a07862026b9 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:08.174949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1168/2342] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:33:08.178327 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7762f-c644-404a-9d50-b853eb12cf84 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:08.191492 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7762f-c644-404a-9d50-b853eb12cf84 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:08.198205 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de5c2a-7322-478a-845c-d10fc2750996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:08.199586 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de5c2a-7322-478a-845c-d10fc2750996 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:08.200079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de5c2a-7322-478a-845c-d10fc2750996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:08.201057 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de5c2a-7322-478a-845c-d10fc2750996 admin admin] PATH_INFO: `/v3/projects/b7762e0d9ff8454a848182dee65a82e8/users/2f6eb0face8b40a5b741752e2fc09e3b/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:08.207585 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de5c2a-7322-478a-845c-d10fc2750996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7762e0d9ff8454a848182dee65a82e8, user_id=2f6eb0face8b40a5b741752e2fc09e3b, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:08.209536 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de5c2a-7322-478a-845c-d10fc2750996 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:08.223099 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1175/2343] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:33:08 2022] PUT /identity/v3/projects/b7762e0d9ff8454a848182dee65a82e8/users/2f6eb0face8b40a5b741752e2fc09e3b/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:33:08.234493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215a9e7-4773-48b0-b20c-46e9666b111a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:08.235018 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215a9e7-4773-48b0-b20c-46e9666b111a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:08.235354 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215a9e7-4773-48b0-b20c-46e9666b111a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:08.277473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-2215a9e7-4773-48b0-b20c-46e9666b111a None None] MFA Rules not processed for user `2f6eb0face8b40a5b741752e2fc09e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:08.278924 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2215a9e7-4773-48b0-b20c-46e9666b111a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:08.367589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1169/2344] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:08.381966 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de5c2a-7322-478a-845c-d10fc2750996 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:08.384083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f2de5c2a-7322-478a-845c-d10fc2750996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:08.486744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de5c2a-7322-478a-845c-d10fc2750996 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:08.494445 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e6683-973b-4194-b7e3-877477a2ef49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:08.494445 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e6683-973b-4194-b7e3-877477a2ef49 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:08.494445 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e6683-973b-4194-b7e3-877477a2ef49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:08.494922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e6683-973b-4194-b7e3-877477a2ef49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:08.583710 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e6683-973b-4194-b7e3-877477a2ef49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:08.585246 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e6683-973b-4194-b7e3-877477a2ef49 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:08.597512 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1176/2345] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:33:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:33:09.567872 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215a9e7-4773-48b0-b20c-46e9666b111a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:09.569636 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2215a9e7-4773-48b0-b20c-46e9666b111a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:09.617945 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:09.645042 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215a9e7-4773-48b0-b20c-46e9666b111a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:09.651054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51af5f3-3eb2-4fd8-9868-6cdb0516a329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:09.651697 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51af5f3-3eb2-4fd8-9868-6cdb0516a329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:09.651981 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51af5f3-3eb2-4fd8-9868-6cdb0516a329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:09.652258 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51af5f3-3eb2-4fd8-9868-6cdb0516a329 admin admin] PATH_INFO: `/v3/users/d8b9fc4976a84d0db395a85afbc4dc9e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:09.653454 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51af5f3-3eb2-4fd8-9868-6cdb0516a329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8b9fc4976a84d0db395a85afbc4dc9e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:09.656029 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51af5f3-3eb2-4fd8-9868-6cdb0516a329 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:09.708487 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c51af5f3-3eb2-4fd8-9868-6cdb0516a329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8b9fc4976a84d0db395a85afbc4dc9e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:09.709254 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c51af5f3-3eb2-4fd8-9868-6cdb0516a329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8b9fc4976a84d0db395a85afbc4dc9e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:09.723071 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c51af5f3-3eb2-4fd8-9868-6cdb0516a329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8b9fc4976a84d0db395a85afbc4dc9e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:09.724211 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c51af5f3-3eb2-4fd8-9868-6cdb0516a329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8b9fc4976a84d0db395a85afbc4dc9e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:09.734041 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c51af5f3-3eb2-4fd8-9868-6cdb0516a329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8b9fc4976a84d0db395a85afbc4dc9e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:09.753800 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1170/2346] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:33:09 2022] DELETE /identity/v3/users/d8b9fc4976a84d0db395a85afbc4dc9e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:33:09.758660 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c548be6-2182-4af6-a29b-d2331d1499c8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:09.759139 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c548be6-2182-4af6-a29b-d2331d1499c8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:09.759369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c548be6-2182-4af6-a29b-d2331d1499c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:09.779814 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-5c548be6-2182-4af6-a29b-d2331d1499c8 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:09.781154 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5c548be6-2182-4af6-a29b-d2331d1499c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:09.849209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1177/2347] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:09.858799 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51af5f3-3eb2-4fd8-9868-6cdb0516a329 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:09.860292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c51af5f3-3eb2-4fd8-9868-6cdb0516a329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:09.923813 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51af5f3-3eb2-4fd8-9868-6cdb0516a329 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:09.927893 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaccc22-6f52-4a56-94a4-f651637f0c61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:09.928508 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaccc22-6f52-4a56-94a4-f651637f0c61 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:09.928830 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaccc22-6f52-4a56-94a4-f651637f0c61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:09.929130 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaccc22-6f52-4a56-94a4-f651637f0c61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:09.938591 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaccc22-6f52-4a56-94a4-f651637f0c61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:09.941005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaccc22-6f52-4a56-94a4-f651637f0c61 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:09.952724 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1171/2348] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:33:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:33:10.151896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c548be6-2182-4af6-a29b-d2331d1499c8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:10.153796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5c548be6-2182-4af6-a29b-d2331d1499c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:10.178793 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c548be6-2182-4af6-a29b-d2331d1499c8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:10.181277 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaccc22-6f52-4a56-94a4-f651637f0c61 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:10.183251 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ccaccc22-6f52-4a56-94a4-f651637f0c61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:10.186322 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ab2bb-b6d5-452a-8bc2-4ecce9392a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:10.186992 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ab2bb-b6d5-452a-8bc2-4ecce9392a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:10.187279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ab2bb-b6d5-452a-8bc2-4ecce9392a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:10.187612 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ab2bb-b6d5-452a-8bc2-4ecce9392a1b admin admin] PATH_INFO: `/v3/projects/7d20e987a86d4b168b6615f0542aafbb` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:10.189830 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ab2bb-b6d5-452a-8bc2-4ecce9392a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d20e987a86d4b168b6615f0542aafbb)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:10.192232 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ab2bb-b6d5-452a-8bc2-4ecce9392a1b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:10.228788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:10.247558 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaccc22-6f52-4a56-94a4-f651637f0c61 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:10.247750 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fe8ab2bb-b6d5-452a-8bc2-4ecce9392a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d20e987a86d4b168b6615f0542aafbb', 'request_id': 'req-fe8ab2bb-b6d5-452a-8bc2-4ecce9392a1b'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:10.255817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fe8ab2bb-b6d5-452a-8bc2-4ecce9392a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d20e987a86d4b168b6615f0542aafbb', 'request_id': 'req-fe8ab2bb-b6d5-452a-8bc2-4ecce9392a1b'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:10.261100 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:10.262263 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fe8ab2bb-b6d5-452a-8bc2-4ecce9392a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d20e987a86d4b168b6615f0542aafbb', 'request_id': 'req-fe8ab2bb-b6d5-452a-8bc2-4ecce9392a1b'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:10.274709 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fe8ab2bb-b6d5-452a-8bc2-4ecce9392a1b admin admin] The token cache is being invalidate because project 7d20e987a86d4b168b6615f0542aafbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:33:10.275030 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fe8ab2bb-b6d5-452a-8bc2-4ecce9392a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:10.275672 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fe8ab2bb-b6d5-452a-8bc2-4ecce9392a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:10.277554 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1178/2349] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:33:10 2022] DELETE /identity/v3/projects/7d20e987a86d4b168b6615f0542aafbb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:33:10.282158 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5a41f-331c-481d-9417-b90de60eaff8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:10.282450 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5a41f-331c-481d-9417-b90de60eaff8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:10.283428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5a41f-331c-481d-9417-b90de60eaff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:10.302472 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832bfc3-0290-4b94-8b2a-8ced8abfc040 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:10.303199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832bfc3-0290-4b94-8b2a-8ced8abfc040 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:10.303489 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832bfc3-0290-4b94-8b2a-8ced8abfc040 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:10.303803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832bfc3-0290-4b94-8b2a-8ced8abfc040 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:10.304235 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2fe5a41f-331c-481d-9417-b90de60eaff8 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:10.305595 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3832bfc3-0290-4b94-8b2a-8ced8abfc040 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:10.305839 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2fe5a41f-331c-481d-9417-b90de60eaff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:10.392113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832bfc3-0290-4b94-8b2a-8ced8abfc040 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:10.394929 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832bfc3-0290-4b94-8b2a-8ced8abfc040 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:10.410300 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1172/2350] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:33:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:33:10.523229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1179/2351] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:33:10.532091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91398643-54a3-4f57-af5a-a505682c819c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:10.533803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91398643-54a3-4f57-af5a-a505682c819c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:10.535160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91398643-54a3-4f57-af5a-a505682c819c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:10.557176 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-91398643-54a3-4f57-af5a-a505682c819c None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:10.558440 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-91398643-54a3-4f57-af5a-a505682c819c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:10.580722 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1173/2352] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:33:10.586109 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5a41f-331c-481d-9417-b90de60eaff8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:10.597136 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5a41f-331c-481d-9417-b90de60eaff8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:10.602413 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfce17-93a5-42b5-8427-26d64ef9c1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:10.602973 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfce17-93a5-42b5-8427-26d64ef9c1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:10.603258 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfce17-93a5-42b5-8427-26d64ef9c1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:10.603533 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfce17-93a5-42b5-8427-26d64ef9c1d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:10.604206 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfce17-93a5-42b5-8427-26d64ef9c1d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:10.604510 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfce17-93a5-42b5-8427-26d64ef9c1d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:10.606200 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfce17-93a5-42b5-8427-26d64ef9c1d6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:10.619984 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1180/2353] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:33:10.625104 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91398643-54a3-4f57-af5a-a505682c819c None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:10.634717 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91398643-54a3-4f57-af5a-a505682c819c None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:10.639440 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ec239-fb9f-4f32-9a97-6e84317e385c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:10.640069 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ec239-fb9f-4f32-9a97-6e84317e385c admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:10.640353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ec239-fb9f-4f32-9a97-6e84317e385c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:10.640631 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ec239-fb9f-4f32-9a97-6e84317e385c admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:10.641318 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ec239-fb9f-4f32-9a97-6e84317e385c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:10.643360 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ec239-fb9f-4f32-9a97-6e84317e385c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:10.673004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1174/2354] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:33:10 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:33:10.678505 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfce17-93a5-42b5-8427-26d64ef9c1d6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:10.690909 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfce17-93a5-42b5-8427-26d64ef9c1d6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:10.757778 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d05b42-708c-4cd6-ba6a-19e213f8acd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:10.758466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d05b42-708c-4cd6-ba6a-19e213f8acd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:10.758803 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d05b42-708c-4cd6-ba6a-19e213f8acd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:10.759359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d05b42-708c-4cd6-ba6a-19e213f8acd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:10.759730 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d05b42-708c-4cd6-ba6a-19e213f8acd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:10.763618 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d05b42-708c-4cd6-ba6a-19e213f8acd8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:10.800734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1181/2355] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:33:10 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:33:10.882264 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ec239-fb9f-4f32-9a97-6e84317e385c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:10.896222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ec239-fb9f-4f32-9a97-6e84317e385c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:10.901813 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023a805-24f9-4193-bd71-53a081c6af09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:10.902428 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023a805-24f9-4193-bd71-53a081c6af09 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:10.902800 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023a805-24f9-4193-bd71-53a081c6af09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:10.903081 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023a805-24f9-4193-bd71-53a081c6af09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:10.904045 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023a805-24f9-4193-bd71-53a081c6af09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:10.905905 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023a805-24f9-4193-bd71-53a081c6af09 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:10.922227 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1175/2356] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:33:10.928526 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d05b42-708c-4cd6-ba6a-19e213f8acd8 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:10.953323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d05b42-708c-4cd6-ba6a-19e213f8acd8 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:10.959250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfa301-a782-41fb-945d-9d74af4bfd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:10.971696 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfa301-a782-41fb-945d-9d74af4bfd22 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:10.972022 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfa301-a782-41fb-945d-9d74af4bfd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:10.972309 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfa301-a782-41fb-945d-9d74af4bfd22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:10.973045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfa301-a782-41fb-945d-9d74af4bfd22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:10.974693 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfa301-a782-41fb-945d-9d74af4bfd22 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:10.998814 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1182/2357] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:33:11.003833 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023a805-24f9-4193-bd71-53a081c6af09 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:11.017427 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023a805-24f9-4193-bd71-53a081c6af09 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:11.022327 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7f235-5e71-4cca-91bb-8c08d4c6cffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:11.023088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7f235-5e71-4cca-91bb-8c08d4c6cffa admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:11.023447 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7f235-5e71-4cca-91bb-8c08d4c6cffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:11.024663 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7f235-5e71-4cca-91bb-8c08d4c6cffa admin admin] PATH_INFO: `/v3/projects/cd4d8c0fd6e249af995b3ca66c2de057/users/75f2c24684c04230897fd9b67baf86a1/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:11.046743 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c7f235-5e71-4cca-91bb-8c08d4c6cffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4d8c0fd6e249af995b3ca66c2de057, user_id=75f2c24684c04230897fd9b67baf86a1, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:11.053332 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c7f235-5e71-4cca-91bb-8c08d4c6cffa admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:11.074990 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1176/2358] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:33:11 2022] PUT /identity/v3/projects/cd4d8c0fd6e249af995b3ca66c2de057/users/75f2c24684c04230897fd9b67baf86a1/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:33:11.094129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed62d0c-5d54-469a-8e07-f23282fdc02f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:11.096000 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed62d0c-5d54-469a-8e07-f23282fdc02f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:11.097195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed62d0c-5d54-469a-8e07-f23282fdc02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:11.148702 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4ed62d0c-5d54-469a-8e07-f23282fdc02f None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:11.154019 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4ed62d0c-5d54-469a-8e07-f23282fdc02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:11.187300 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:11.304711 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7f235-5e71-4cca-91bb-8c08d4c6cffa admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:11.306714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c2c7f235-5e71-4cca-91bb-8c08d4c6cffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:11.325066 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1183/2359] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:11.337903 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed62d0c-5d54-469a-8e07-f23282fdc02f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:11.339861 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4ed62d0c-5d54-469a-8e07-f23282fdc02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:11.425690 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7f235-5e71-4cca-91bb-8c08d4c6cffa admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:11.437085 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca62c8-3de1-494a-b5db-fef83b7aabaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:11.438194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed62d0c-5d54-469a-8e07-f23282fdc02f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:11.439221 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca62c8-3de1-494a-b5db-fef83b7aabaf service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:11.440804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca62c8-3de1-494a-b5db-fef83b7aabaf service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:11.440804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca62c8-3de1-494a-b5db-fef83b7aabaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:11.444464 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cbca62c8-3de1-494a-b5db-fef83b7aabaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:11.445643 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665f942-f8fb-4ac1-8e8a-48e542220153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:11.446221 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665f942-f8fb-4ac1-8e8a-48e542220153 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:11.446519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665f942-f8fb-4ac1-8e8a-48e542220153 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:11.446778 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665f942-f8fb-4ac1-8e8a-48e542220153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:11.461234 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665f942-f8fb-4ac1-8e8a-48e542220153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:11.462721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665f942-f8fb-4ac1-8e8a-48e542220153 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:11.473223 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:11.477897 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1184/2360] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:33:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:33:11.549892 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca62c8-3de1-494a-b5db-fef83b7aabaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:11.551514 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca62c8-3de1-494a-b5db-fef83b7aabaf service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:11.563864 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1177/2361] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:33:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:33:13.182622 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595a9c9-732e-44fc-8039-6956992702c7 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:13.183096 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595a9c9-732e-44fc-8039-6956992702c7 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:13.183186 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595a9c9-732e-44fc-8039-6956992702c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:13.214687 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-7595a9c9-732e-44fc-8039-6956992702c7 None None] MFA Rules not processed for user `75f2c24684c04230897fd9b67baf86a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:13.215731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7595a9c9-732e-44fc-8039-6956992702c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:13.294856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1185/2362] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:13.303675 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca62c8-3de1-494a-b5db-fef83b7aabaf service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:13.313412 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca62c8-3de1-494a-b5db-fef83b7aabaf service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:13.319085 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fc5cb-ec98-4381-b0a1-1181d97b61e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:13.319869 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fc5cb-ec98-4381-b0a1-1181d97b61e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:13.320627 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fc5cb-ec98-4381-b0a1-1181d97b61e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:13.321064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fc5cb-ec98-4381-b0a1-1181d97b61e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:13.331649 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fc5cb-ec98-4381-b0a1-1181d97b61e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:13.333707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fc5cb-ec98-4381-b0a1-1181d97b61e0 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:13.344857 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1178/2363] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:33:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:33:14.742048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970da8be-d079-4511-878e-f063bd8f1120 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:14.742586 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970da8be-d079-4511-878e-f063bd8f1120 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:14.742586 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970da8be-d079-4511-878e-f063bd8f1120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:14.768646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-970da8be-d079-4511-878e-f063bd8f1120 None None] MFA Rules not processed for user `75f2c24684c04230897fd9b67baf86a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:14.769962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-970da8be-d079-4511-878e-f063bd8f1120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:14.777185 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1186/2364] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:15.673628 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fc5cb-ec98-4381-b0a1-1181d97b61e0 service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:15.675453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-077fc5cb-ec98-4381-b0a1-1181d97b61e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:15.706275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fc5cb-ec98-4381-b0a1-1181d97b61e0 service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:15.711914 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa7620-330f-4a54-9dfa-22e7a8537716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:15.712876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa7620-330f-4a54-9dfa-22e7a8537716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:15.713237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa7620-330f-4a54-9dfa-22e7a8537716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:15.713525 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa7620-330f-4a54-9dfa-22e7a8537716 admin admin] PATH_INFO: `/v3/users/e1da32f5da30461a86cd8fd717b4acee` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:15.715029 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa7620-330f-4a54-9dfa-22e7a8537716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1da32f5da30461a86cd8fd717b4acee)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:15.717198 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa7620-330f-4a54-9dfa-22e7a8537716 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:15.783378 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-95fa7620-330f-4a54-9dfa-22e7a8537716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1da32f5da30461a86cd8fd717b4acee'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:15.784183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-95fa7620-330f-4a54-9dfa-22e7a8537716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1da32f5da30461a86cd8fd717b4acee'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:15.792706 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-95fa7620-330f-4a54-9dfa-22e7a8537716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1da32f5da30461a86cd8fd717b4acee'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:15.793868 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-95fa7620-330f-4a54-9dfa-22e7a8537716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1da32f5da30461a86cd8fd717b4acee'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:15.806314 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-95fa7620-330f-4a54-9dfa-22e7a8537716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1da32f5da30461a86cd8fd717b4acee'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:15.838174 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1179/2365] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:33:15 2022] DELETE /identity/v3/users/e1da32f5da30461a86cd8fd717b4acee => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:33:15.845972 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1babec1-7f63-4855-a7ed-935f397712c3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:15.846813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1babec1-7f63-4855-a7ed-935f397712c3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:15.847097 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1babec1-7f63-4855-a7ed-935f397712c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:15.874023 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c1babec1-7f63-4855-a7ed-935f397712c3 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:15.877072 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c1babec1-7f63-4855-a7ed-935f397712c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:15.937248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:15.963692 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1187/2366] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:15.972058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa7620-330f-4a54-9dfa-22e7a8537716 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:15.973562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-95fa7620-330f-4a54-9dfa-22e7a8537716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:16.052825 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa7620-330f-4a54-9dfa-22e7a8537716 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:16.057551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aad5a5-b069-41e1-90c5-bd493b3b48e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:16.058204 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aad5a5-b069-41e1-90c5-bd493b3b48e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:16.058501 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aad5a5-b069-41e1-90c5-bd493b3b48e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:16.058902 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aad5a5-b069-41e1-90c5-bd493b3b48e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:16.070180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aad5a5-b069-41e1-90c5-bd493b3b48e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:16.072072 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aad5a5-b069-41e1-90c5-bd493b3b48e7 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:16.084087 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1180/2367] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:33:16.496248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1babec1-7f63-4855-a7ed-935f397712c3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:16.497948 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c1babec1-7f63-4855-a7ed-935f397712c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:16.512952 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1babec1-7f63-4855-a7ed-935f397712c3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:16.520119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed6fb7-08fb-4180-a7b6-8d3c39e1841a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:16.520825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed6fb7-08fb-4180-a7b6-8d3c39e1841a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:16.521294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed6fb7-08fb-4180-a7b6-8d3c39e1841a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:16.521701 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed6fb7-08fb-4180-a7b6-8d3c39e1841a admin admin] PATH_INFO: `/v3/projects/1e2bfebf517942eebae2b1de0b1a66b7` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:16.522759 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed6fb7-08fb-4180-a7b6-8d3c39e1841a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e2bfebf517942eebae2b1de0b1a66b7)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:16.524720 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed6fb7-08fb-4180-a7b6-8d3c39e1841a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:16.578072 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-48ed6fb7-08fb-4180-a7b6-8d3c39e1841a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2bfebf517942eebae2b1de0b1a66b7', 'request_id': 'req-48ed6fb7-08fb-4180-a7b6-8d3c39e1841a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:16.587173 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-48ed6fb7-08fb-4180-a7b6-8d3c39e1841a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2bfebf517942eebae2b1de0b1a66b7', 'request_id': 'req-48ed6fb7-08fb-4180-a7b6-8d3c39e1841a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:16.593392 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-48ed6fb7-08fb-4180-a7b6-8d3c39e1841a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2bfebf517942eebae2b1de0b1a66b7', 'request_id': 'req-48ed6fb7-08fb-4180-a7b6-8d3c39e1841a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:16.606483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-48ed6fb7-08fb-4180-a7b6-8d3c39e1841a admin admin] The token cache is being invalidate because project 1e2bfebf517942eebae2b1de0b1a66b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:33:16.606779 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-48ed6fb7-08fb-4180-a7b6-8d3c39e1841a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:16.607550 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-48ed6fb7-08fb-4180-a7b6-8d3c39e1841a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:16.608954 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1188/2368] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:33:16 2022] DELETE /identity/v3/projects/1e2bfebf517942eebae2b1de0b1a66b7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:33:16.613604 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aad5a5-b069-41e1-90c5-bd493b3b48e7 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:16.624240 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aad5a5-b069-41e1-90c5-bd493b3b48e7 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:16.641033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:16.702435 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73387a6c-7ffd-4a87-b5ef-54f0a8204ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:16.703079 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73387a6c-7ffd-4a87-b5ef-54f0a8204ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:16.703359 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73387a6c-7ffd-4a87-b5ef-54f0a8204ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:16.703639 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73387a6c-7ffd-4a87-b5ef-54f0a8204ab1 admin admin] PATH_INFO: `/v3/users/7bbf3e8ac1bb42878448135b39f8645d` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:16.705540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73387a6c-7ffd-4a87-b5ef-54f0a8204ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bbf3e8ac1bb42878448135b39f8645d)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:16.707493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73387a6c-7ffd-4a87-b5ef-54f0a8204ab1 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:16.765461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-73387a6c-7ffd-4a87-b5ef-54f0a8204ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bbf3e8ac1bb42878448135b39f8645d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:16.766306 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-73387a6c-7ffd-4a87-b5ef-54f0a8204ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bbf3e8ac1bb42878448135b39f8645d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:16.776963 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-73387a6c-7ffd-4a87-b5ef-54f0a8204ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bbf3e8ac1bb42878448135b39f8645d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:16.778210 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-73387a6c-7ffd-4a87-b5ef-54f0a8204ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bbf3e8ac1bb42878448135b39f8645d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:16.789202 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-73387a6c-7ffd-4a87-b5ef-54f0a8204ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bbf3e8ac1bb42878448135b39f8645d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:16.821920 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1181/2369] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:33:16 2022] DELETE /identity/v3/users/7bbf3e8ac1bb42878448135b39f8645d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:33:17.202807 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed6fb7-08fb-4180-a7b6-8d3c39e1841a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:17.204797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-48ed6fb7-08fb-4180-a7b6-8d3c39e1841a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:17.219378 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed6fb7-08fb-4180-a7b6-8d3c39e1841a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:17.295410 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aff64d-d797-4a35-8143-40d7f5b447a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:17.296236 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aff64d-d797-4a35-8143-40d7f5b447a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:17.296523 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aff64d-d797-4a35-8143-40d7f5b447a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:17.296836 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aff64d-d797-4a35-8143-40d7f5b447a9 admin admin] PATH_INFO: `/v3/projects/243727ecee4a4a45bb19a293e3c7f9b2` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:17.305330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aff64d-d797-4a35-8143-40d7f5b447a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=243727ecee4a4a45bb19a293e3c7f9b2)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:17.308668 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aff64d-d797-4a35-8143-40d7f5b447a9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:17.393539 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-70aff64d-d797-4a35-8143-40d7f5b447a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '243727ecee4a4a45bb19a293e3c7f9b2', 'request_id': 'req-70aff64d-d797-4a35-8143-40d7f5b447a9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:17.414896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-70aff64d-d797-4a35-8143-40d7f5b447a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '243727ecee4a4a45bb19a293e3c7f9b2', 'request_id': 'req-70aff64d-d797-4a35-8143-40d7f5b447a9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:17.422302 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-70aff64d-d797-4a35-8143-40d7f5b447a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '243727ecee4a4a45bb19a293e3c7f9b2', 'request_id': 'req-70aff64d-d797-4a35-8143-40d7f5b447a9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:17.433874 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:17.443931 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-70aff64d-d797-4a35-8143-40d7f5b447a9 admin admin] The token cache is being invalidate because project 243727ecee4a4a45bb19a293e3c7f9b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:33:17.444474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-70aff64d-d797-4a35-8143-40d7f5b447a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:17.446724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-70aff64d-d797-4a35-8143-40d7f5b447a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:17.449550 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1189/2370] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:33:17 2022] DELETE /identity/v3/projects/243727ecee4a4a45bb19a293e3c7f9b2 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:33:17.453611 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73387a6c-7ffd-4a87-b5ef-54f0a8204ab1 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:17.456309 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-73387a6c-7ffd-4a87-b5ef-54f0a8204ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:17.476923 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73387a6c-7ffd-4a87-b5ef-54f0a8204ab1 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:17.572664 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c630a-0aef-4fb3-bade-37fdc8448db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:17.572664 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c630a-0aef-4fb3-bade-37fdc8448db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:17.572664 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c630a-0aef-4fb3-bade-37fdc8448db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:17.573121 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c630a-0aef-4fb3-bade-37fdc8448db9 admin admin] PATH_INFO: `/v3/users/2f6eb0face8b40a5b741752e2fc09e3b` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:17.577253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c630a-0aef-4fb3-bade-37fdc8448db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f6eb0face8b40a5b741752e2fc09e3b)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:17.580221 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c630a-0aef-4fb3-bade-37fdc8448db9 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:17.639022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:17.650917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b27c630a-0aef-4fb3-bade-37fdc8448db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f6eb0face8b40a5b741752e2fc09e3b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:17.651905 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b27c630a-0aef-4fb3-bade-37fdc8448db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f6eb0face8b40a5b741752e2fc09e3b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:17.666912 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b27c630a-0aef-4fb3-bade-37fdc8448db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f6eb0face8b40a5b741752e2fc09e3b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:17.668053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b27c630a-0aef-4fb3-bade-37fdc8448db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f6eb0face8b40a5b741752e2fc09e3b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:17.680753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b27c630a-0aef-4fb3-bade-37fdc8448db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f6eb0face8b40a5b741752e2fc09e3b'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:17.703552 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1182/2371] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:33:17 2022] DELETE /identity/v3/users/2f6eb0face8b40a5b741752e2fc09e3b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:33:18.446983 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aff64d-d797-4a35-8143-40d7f5b447a9 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:18.450282 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-70aff64d-d797-4a35-8143-40d7f5b447a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:18.465388 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aff64d-d797-4a35-8143-40d7f5b447a9 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:18.557088 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c39c9-f01f-40fb-aa0e-3e52fc429c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:18.557749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c39c9-f01f-40fb-aa0e-3e52fc429c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:18.558033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c39c9-f01f-40fb-aa0e-3e52fc429c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:18.558471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c39c9-f01f-40fb-aa0e-3e52fc429c08 admin admin] PATH_INFO: `/v3/projects/b7762e0d9ff8454a848182dee65a82e8` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:18.559685 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c39c9-f01f-40fb-aa0e-3e52fc429c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7762e0d9ff8454a848182dee65a82e8)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:18.562059 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c39c9-f01f-40fb-aa0e-3e52fc429c08 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:18.633175 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fe2c39c9-f01f-40fb-aa0e-3e52fc429c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7762e0d9ff8454a848182dee65a82e8', 'request_id': 'req-fe2c39c9-f01f-40fb-aa0e-3e52fc429c08'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:18.644472 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fe2c39c9-f01f-40fb-aa0e-3e52fc429c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7762e0d9ff8454a848182dee65a82e8', 'request_id': 'req-fe2c39c9-f01f-40fb-aa0e-3e52fc429c08'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:18.653017 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fe2c39c9-f01f-40fb-aa0e-3e52fc429c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7762e0d9ff8454a848182dee65a82e8', 'request_id': 'req-fe2c39c9-f01f-40fb-aa0e-3e52fc429c08'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:18.668476 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fe2c39c9-f01f-40fb-aa0e-3e52fc429c08 admin admin] The token cache is being invalidate because project b7762e0d9ff8454a848182dee65a82e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:33:18.669560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fe2c39c9-f01f-40fb-aa0e-3e52fc429c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:18.670423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-fe2c39c9-f01f-40fb-aa0e-3e52fc429c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:33:18.673378 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1190/2372] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:33:18 2022] DELETE /identity/v3/projects/b7762e0d9ff8454a848182dee65a82e8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:33:18.678574 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b16f0-7143-4a35-a07b-c08413fe5713 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:18.679017 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b16f0-7143-4a35-a07b-c08413fe5713 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:18.679870 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b16f0-7143-4a35-a07b-c08413fe5713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:18.706720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-5c8b16f0-7143-4a35-a07b-c08413fe5713 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:18.708963 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5c8b16f0-7143-4a35-a07b-c08413fe5713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:18.802154 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1183/2373] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:18.804237 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d8409-4f92-410e-90a6-9898f2d83f40 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:18.804950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d8409-4f92-410e-90a6-9898f2d83f40 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:18.805370 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d8409-4f92-410e-90a6-9898f2d83f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:18.824616 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50731836-3823-479e-a980-cac796dd6983 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:18.825335 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50731836-3823-479e-a980-cac796dd6983 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:18.826230 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50731836-3823-479e-a980-cac796dd6983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:18.837222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f48d8409-4f92-410e-90a6-9898f2d83f40 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:18.838865 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f48d8409-4f92-410e-90a6-9898f2d83f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:18.849627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1191/2374] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:18.852761 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d8409-4f92-410e-90a6-9898f2d83f40 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:18.857353 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-50731836-3823-479e-a980-cac796dd6983 None None] MFA Rules not processed for user `c0a2c80ee21c45af9028106a50db4791`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:18.859419 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-50731836-3823-479e-a980-cac796dd6983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:18.878987 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d8409-4f92-410e-90a6-9898f2d83f40 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:18.889943 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80453581-049a-4f30-914a-ad7cf87bfbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:18.890707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80453581-049a-4f30-914a-ad7cf87bfbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:18.891094 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80453581-049a-4f30-914a-ad7cf87bfbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:18.891474 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80453581-049a-4f30-914a-ad7cf87bfbe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:18.892863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80453581-049a-4f30-914a-ad7cf87bfbe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:33:18.893302 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80453581-049a-4f30-914a-ad7cf87bfbe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:18.895092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80453581-049a-4f30-914a-ad7cf87bfbe7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:18.911077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1192/2375] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:33:18.915112 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80453581-049a-4f30-914a-ad7cf87bfbe7 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:18.943903 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80453581-049a-4f30-914a-ad7cf87bfbe7 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:18.949733 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd38305-5073-4550-9973-13b1bf7f3a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:18.950749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd38305-5073-4550-9973-13b1bf7f3a13 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:18.951188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd38305-5073-4550-9973-13b1bf7f3a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:18.951472 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd38305-5073-4550-9973-13b1bf7f3a13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:18.952134 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd38305-5073-4550-9973-13b1bf7f3a13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:18.954865 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd38305-5073-4550-9973-13b1bf7f3a13 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:18.972876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1184/2376] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:33:18.998082 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1193/2377] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:33:18 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:33:19.003255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50731836-3823-479e-a980-cac796dd6983 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:19.023094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50731836-3823-479e-a980-cac796dd6983 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:19.129829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432a6cc-6a5b-4795-94a3-9ff251974ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:19.131235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432a6cc-6a5b-4795-94a3-9ff251974ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:19.132403 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432a6cc-6a5b-4795-94a3-9ff251974ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:19.132403 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432a6cc-6a5b-4795-94a3-9ff251974ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:19.133459 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432a6cc-6a5b-4795-94a3-9ff251974ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:19.135841 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432a6cc-6a5b-4795-94a3-9ff251974ab4 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:19.148375 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:19.171789 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1185/2378] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:33:19 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:33:19.173084 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd38305-5073-4550-9973-13b1bf7f3a13 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:19.184209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd38305-5073-4550-9973-13b1bf7f3a13 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:19.189491 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b735d6-b110-4acc-ad7b-5d660dca2bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:19.190193 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b735d6-b110-4acc-ad7b-5d660dca2bfe admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:19.190403 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b735d6-b110-4acc-ad7b-5d660dca2bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:19.190681 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b735d6-b110-4acc-ad7b-5d660dca2bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:19.191552 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b735d6-b110-4acc-ad7b-5d660dca2bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:19.193240 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b735d6-b110-4acc-ad7b-5d660dca2bfe admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:19.205674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1194/2379] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:33:19.209594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432a6cc-6a5b-4795-94a3-9ff251974ab4 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:19.224021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432a6cc-6a5b-4795-94a3-9ff251974ab4 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:19.229147 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa1dee-5859-4e3b-a2de-bc92f86d4bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:19.229772 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa1dee-5859-4e3b-a2de-bc92f86d4bfd admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:19.230055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa1dee-5859-4e3b-a2de-bc92f86d4bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:19.230336 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa1dee-5859-4e3b-a2de-bc92f86d4bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:19.231024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa1dee-5859-4e3b-a2de-bc92f86d4bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:19.232667 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa1dee-5859-4e3b-a2de-bc92f86d4bfd admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:19.246682 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1186/2380] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:33:19.252941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b735d6-b110-4acc-ad7b-5d660dca2bfe admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:19.265069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b735d6-b110-4acc-ad7b-5d660dca2bfe admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:19.271891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b853824-2b5e-40d0-b9e0-6a12cdfc0cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:19.272873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b853824-2b5e-40d0-b9e0-6a12cdfc0cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:19.273293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b853824-2b5e-40d0-b9e0-6a12cdfc0cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:19.273683 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b853824-2b5e-40d0-b9e0-6a12cdfc0cd0 admin admin] PATH_INFO: `/v3/projects/bf93e98e5d5f435ca0fbb155f69b0c80/users/1d4d395ec752434fabf216d33e839498/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:19.291249 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b853824-2b5e-40d0-b9e0-6a12cdfc0cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf93e98e5d5f435ca0fbb155f69b0c80, user_id=1d4d395ec752434fabf216d33e839498, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:19.294401 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b853824-2b5e-40d0-b9e0-6a12cdfc0cd0 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:19.312843 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1195/2381] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:33:19 2022] PUT /identity/v3/projects/bf93e98e5d5f435ca0fbb155f69b0c80/users/1d4d395ec752434fabf216d33e839498/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:33:19.318777 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6907e-55a1-411e-8257-b13bbe0cb7aa None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:19.319195 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6907e-55a1-411e-8257-b13bbe0cb7aa None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:19.319532 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6907e-55a1-411e-8257-b13bbe0cb7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:19.345084 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-5cc6907e-55a1-411e-8257-b13bbe0cb7aa None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:19.346751 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5cc6907e-55a1-411e-8257-b13bbe0cb7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:19.430018 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1187/2382] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:19.447089 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b853824-2b5e-40d0-b9e0-6a12cdfc0cd0 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:19.450280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7b853824-2b5e-40d0-b9e0-6a12cdfc0cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:19.469588 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:19.547147 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b853824-2b5e-40d0-b9e0-6a12cdfc0cd0 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:19.554913 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582eb7a-9e5d-470e-a602-793d10714f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:19.556292 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582eb7a-9e5d-470e-a602-793d10714f52 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:19.557331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582eb7a-9e5d-470e-a602-793d10714f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:19.557796 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582eb7a-9e5d-470e-a602-793d10714f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:19.569361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582eb7a-9e5d-470e-a602-793d10714f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:19.571593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582eb7a-9e5d-470e-a602-793d10714f52 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:19.584306 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1196/2383] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:33:20.684242 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa2160-6e3a-465e-91f9-fb14cb558e66 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:20.684752 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa2160-6e3a-465e-91f9-fb14cb558e66 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:20.685655 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa2160-6e3a-465e-91f9-fb14cb558e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:20.734889 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-edaa2160-6e3a-465e-91f9-fb14cb558e66 None None] MFA Rules not processed for user `1d4d395ec752434fabf216d33e839498`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:20.737576 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-edaa2160-6e3a-465e-91f9-fb14cb558e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:20.866099 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1188/2384] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:20.879330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582eb7a-9e5d-470e-a602-793d10714f52 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:20.883301 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b582eb7a-9e5d-470e-a602-793d10714f52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:20.972232 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582eb7a-9e5d-470e-a602-793d10714f52 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:20.978205 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5f3e3-9042-4a6a-b510-6039ac5b36cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:20.979137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5f3e3-9042-4a6a-b510-6039ac5b36cb service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:20.979521 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5f3e3-9042-4a6a-b510-6039ac5b36cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:20.980020 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5f3e3-9042-4a6a-b510-6039ac5b36cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:20.991539 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5f3e3-9042-4a6a-b510-6039ac5b36cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:20.993221 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5f3e3-9042-4a6a-b510-6039ac5b36cb service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:21.003720 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1197/2385] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:33:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:33:22.471663 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b2bb6-8488-4f54-a408-af1669e51058 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:22.472182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b2bb6-8488-4f54-a408-af1669e51058 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:22.472315 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b2bb6-8488-4f54-a408-af1669e51058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:22.495044 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-625b2bb6-8488-4f54-a408-af1669e51058 None None] MFA Rules not processed for user `1d4d395ec752434fabf216d33e839498`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:22.496513 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-625b2bb6-8488-4f54-a408-af1669e51058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:22.503613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1189/2386] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:24.202432 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2bc70-6c9b-4bf6-8ba7-0be1dcc99e55 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:24.202991 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2bc70-6c9b-4bf6-8ba7-0be1dcc99e55 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:24.202991 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2bc70-6c9b-4bf6-8ba7-0be1dcc99e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:24.245833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-7dc2bc70-6c9b-4bf6-8ba7-0be1dcc99e55 None None] MFA Rules not processed for user `e9ffc48d1f6d49f49d00d1c2e762b987`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:24.247302 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7dc2bc70-6c9b-4bf6-8ba7-0be1dcc99e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:24.358738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1198/2387] 10.222.0.96 () {58 vars in 1009 bytes} [Wed Aug 24 04:33:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:24.372319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b2bb6-8488-4f54-a408-af1669e51058 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:24.373848 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-625b2bb6-8488-4f54-a408-af1669e51058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:24.467938 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b2bb6-8488-4f54-a408-af1669e51058 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:24.474243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98625245-4235-4ed0-a047-dba809311be8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953d2dbd5e7d435f9148fd043b4ce7a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:24.474888 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98625245-4235-4ed0-a047-dba809311be8 service swift] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:24.475178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98625245-4235-4ed0-a047-dba809311be8 service swift] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:24.475466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98625245-4235-4ed0-a047-dba809311be8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:24.482563 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:24.489510 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98625245-4235-4ed0-a047-dba809311be8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:24.491645 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98625245-4235-4ed0-a047-dba809311be8 service swift] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:24.502836 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1190/2388] 10.222.0.96 () {60 vars in 1384 bytes} [Wed Aug 24 04:33:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:33:25.085482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2bc70-6c9b-4bf6-8ba7-0be1dcc99e55 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:25.089870 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7dc2bc70-6c9b-4bf6-8ba7-0be1dcc99e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:25.120645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2bc70-6c9b-4bf6-8ba7-0be1dcc99e55 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:25.131390 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2a3f1-3cd3-4f06-bc69-60c9168a1d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:25.133159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2a3f1-3cd3-4f06-bc69-60c9168a1d51 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:25.133610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2a3f1-3cd3-4f06-bc69-60c9168a1d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:25.134069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2a3f1-3cd3-4f06-bc69-60c9168a1d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:25.136170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4fa2a3f1-3cd3-4f06-bc69-60c9168a1d51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:25.329011 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2a3f1-3cd3-4f06-bc69-60c9168a1d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:25.332591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2a3f1-3cd3-4f06-bc69-60c9168a1d51 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:25.339067 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:25.379916 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1199/2389] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:33:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:33:34.498395 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:35.344048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:33:46.759877 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2e5c4-c8ec-4241-b0a7-3ba62b22f580 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:46.760472 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2e5c4-c8ec-4241-b0a7-3ba62b22f580 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:46.760609 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2e5c4-c8ec-4241-b0a7-3ba62b22f580 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:46.762098 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1191/2390] 10.222.0.96 () {54 vars in 921 bytes} [Wed Aug 24 04:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:33:46.770253 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905525b-1055-4ef1-8847-ce55b4ad1145 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:46.770839 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905525b-1055-4ef1-8847-ce55b4ad1145 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:46.770839 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905525b-1055-4ef1-8847-ce55b4ad1145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:46.790703 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8905525b-1055-4ef1-8847-ce55b4ad1145 None None] MFA Rules not processed for user `3539784b4e91472eb20addc6707dc30d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:46.791939 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8905525b-1055-4ef1-8847-ce55b4ad1145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:46.875455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1200/2391] 10.222.0.96 () {58 vars in 1018 bytes} [Wed Aug 24 04:33:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:46.907202 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2e5c4-c8ec-4241-b0a7-3ba62b22f580 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:46.909061 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7bc2e5c4-c8ec-4241-b0a7-3ba62b22f580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:46.909508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867bbb6-40f3-46c3-b694-b3baf16bfb35 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:46.909800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867bbb6-40f3-46c3-b694-b3baf16bfb35 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:46.910076 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867bbb6-40f3-46c3-b694-b3baf16bfb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:46.935136 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6867bbb6-40f3-46c3-b694-b3baf16bfb35 None None] MFA Rules not processed for user `1d4d395ec752434fabf216d33e839498`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:46.936353 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6867bbb6-40f3-46c3-b694-b3baf16bfb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:46.947958 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1201/2392] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:33:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:46.977015 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2e5c4-c8ec-4241-b0a7-3ba62b22f580 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:46.980537 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e3da6-9542-4c62-9b86-ef2e3df43d15 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6106a46199b74f649cd29a0d02610049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:46.981168 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e3da6-9542-4c62-9b86-ef2e3df43d15 service glance] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:46.981446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e3da6-9542-4c62-9b86-ef2e3df43d15 service glance] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:46.981721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e3da6-9542-4c62-9b86-ef2e3df43d15 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:46.992536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e3da6-9542-4c62-9b86-ef2e3df43d15 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:46.993991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e3da6-9542-4c62-9b86-ef2e3df43d15 service glance] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:47.005394 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1192/2393] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:33:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:33:47.105092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee742246-bf73-4965-8193-a125acb5ab2d None None] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:47.105396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee742246-bf73-4965-8193-a125acb5ab2d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:47.105861 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee742246-bf73-4965-8193-a125acb5ab2d None None] PATH_INFO: `/` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:47.107589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1202/2394] 10.222.0.96 () {54 vars in 921 bytes} [Wed Aug 24 04:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:33:47.114057 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976e236-f44c-4275-a3f2-35340627bddf None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:47.114619 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976e236-f44c-4275-a3f2-35340627bddf None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:47.114929 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976e236-f44c-4275-a3f2-35340627bddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:47.143189 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4976e236-f44c-4275-a3f2-35340627bddf None None] MFA Rules not processed for user `50358dbf699a41188dae93496161709d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:47.144429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4976e236-f44c-4275-a3f2-35340627bddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:47.151435 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1193/2395] 10.222.0.96 () {58 vars in 1018 bytes} [Wed Aug 24 04:33:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:47.163955 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee742246-bf73-4965-8193-a125acb5ab2d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:47.175952 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee742246-bf73-4965-8193-a125acb5ab2d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:47.179545 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79736b8c-db31-42b1-907a-96252556b26e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:47.180161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79736b8c-db31-42b1-907a-96252556b26e service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:47.180441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79736b8c-db31-42b1-907a-96252556b26e service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:47.180747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79736b8c-db31-42b1-907a-96252556b26e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:47.188674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79736b8c-db31-42b1-907a-96252556b26e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:47.190102 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79736b8c-db31-42b1-907a-96252556b26e service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:47.198502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1203/2396] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:33:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:33:47.284573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71789e1f-3d61-44d3-bb8e-f8d1ad333602 None None] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:47.284894 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71789e1f-3d61-44d3-bb8e-f8d1ad333602 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:47.285187 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71789e1f-3d61-44d3-bb8e-f8d1ad333602 None None] PATH_INFO: `/` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:47.286583 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1194/2397] 10.222.0.96 () {54 vars in 921 bytes} [Wed Aug 24 04:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:33:47.292974 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c0b1f-1ab6-482c-99ef-45f530babd2e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:47.293521 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c0b1f-1ab6-482c-99ef-45f530babd2e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:47.293791 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c0b1f-1ab6-482c-99ef-45f530babd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:47.314952 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bd4c0b1f-1ab6-482c-99ef-45f530babd2e None None] MFA Rules not processed for user `3539784b4e91472eb20addc6707dc30d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:47.316181 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bd4c0b1f-1ab6-482c-99ef-45f530babd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:47.326064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1204/2398] 10.222.0.96 () {58 vars in 1018 bytes} [Wed Aug 24 04:33:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:47.337763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71789e1f-3d61-44d3-bb8e-f8d1ad333602 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:47.348999 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71789e1f-3d61-44d3-bb8e-f8d1ad333602 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:47.352660 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f766b3-d832-4b4f-9ab0-7dced0c02d04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:47.353295 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f766b3-d832-4b4f-9ab0-7dced0c02d04 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:47.353576 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f766b3-d832-4b4f-9ab0-7dced0c02d04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:47.353848 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f766b3-d832-4b4f-9ab0-7dced0c02d04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:47.364869 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f766b3-d832-4b4f-9ab0-7dced0c02d04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:47.366345 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f766b3-d832-4b4f-9ab0-7dced0c02d04 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:47.382914 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1195/2399] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:33:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:33:50.649990 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddb409-a3b6-400e-aa2b-93105a20b961 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:50.650575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddb409-a3b6-400e-aa2b-93105a20b961 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:50.650797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddb409-a3b6-400e-aa2b-93105a20b961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:50.676665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8dddb409-a3b6-400e-aa2b-93105a20b961 None None] MFA Rules not processed for user `e9ffc48d1f6d49f49d00d1c2e762b987`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:33:50.678038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8dddb409-a3b6-400e-aa2b-93105a20b961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:33:50.689228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1205/2400] 10.222.0.96 () {58 vars in 1009 bytes} [Wed Aug 24 04:33:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:33:50.705986 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f766b3-d832-4b4f-9ab0-7dced0c02d04 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:33:50.722792 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f766b3-d832-4b4f-9ab0-7dced0c02d04 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:33:50.728274 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac91033-6161-4b9c-a204-cab38a94ccc1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953d2dbd5e7d435f9148fd043b4ce7a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:33:50.729010 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac91033-6161-4b9c-a204-cab38a94ccc1 service swift] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:33:50.729373 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac91033-6161-4b9c-a204-cab38a94ccc1 service swift] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:33:50.729724 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac91033-6161-4b9c-a204-cab38a94ccc1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:33:50.739610 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac91033-6161-4b9c-a204-cab38a94ccc1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:33:50.741387 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac91033-6161-4b9c-a204-cab38a94ccc1 service swift] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:33:50.750532 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1196/2401] 10.222.0.96 () {60 vars in 1384 bytes} [Wed Aug 24 04:33:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:34:00.669438 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=46 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:00.746870 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=41 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:13.461168 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddb409-a3b6-400e-aa2b-93105a20b961 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:13.462952 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8dddb409-a3b6-400e-aa2b-93105a20b961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:13.593468 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddb409-a3b6-400e-aa2b-93105a20b961 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:13.603937 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc6748-7475-488d-a33c-6e71916f2b68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f7fe9af30947dbae1f2334b18f630d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:13.604579 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc6748-7475-488d-a33c-6e71916f2b68 service placement] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:13.605588 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc6748-7475-488d-a33c-6e71916f2b68 service placement] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:13.605982 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc6748-7475-488d-a33c-6e71916f2b68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:13.608093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-68cc6748-7475-488d-a33c-6e71916f2b68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:13.638363 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc6748-7475-488d-a33c-6e71916f2b68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:13.640758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc6748-7475-488d-a33c-6e71916f2b68 service placement] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:13.661302 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1206/2402] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:34:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:34:14.086405 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452ccd3-aad6-49ba-920c-e88af0e6f365 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:14.087256 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452ccd3-aad6-49ba-920c-e88af0e6f365 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:14.087256 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452ccd3-aad6-49ba-920c-e88af0e6f365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:14.111964 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-1452ccd3-aad6-49ba-920c-e88af0e6f365 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:14.113257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1452ccd3-aad6-49ba-920c-e88af0e6f365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:14.121122 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1197/2403] 10.222.0.100 () {58 vars in 1017 bytes} [Wed Aug 24 04:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:34:14.149724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc6748-7475-488d-a33c-6e71916f2b68 service placement] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:14.151174 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-68cc6748-7475-488d-a33c-6e71916f2b68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:14.166877 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc6748-7475-488d-a33c-6e71916f2b68 service placement] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:14.172483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd605bf-5e99-44c5-af05-8eaf34f07883 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:14.173754 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd605bf-5e99-44c5-af05-8eaf34f07883 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:14.174039 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd605bf-5e99-44c5-af05-8eaf34f07883 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:14.174316 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd605bf-5e99-44c5-af05-8eaf34f07883 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:14.183012 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd605bf-5e99-44c5-af05-8eaf34f07883 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:14.184590 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd605bf-5e99-44c5-af05-8eaf34f07883 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:14.194374 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1207/2404] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:34:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:34:16.832135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb48ce-eb06-4810-9378-4bddc10816ce None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:16.832771 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb48ce-eb06-4810-9378-4bddc10816ce None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:16.832771 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb48ce-eb06-4810-9378-4bddc10816ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:16.856145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-58bb48ce-eb06-4810-9378-4bddc10816ce None None] MFA Rules not processed for user `e9ffc48d1f6d49f49d00d1c2e762b987`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:16.857753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-58bb48ce-eb06-4810-9378-4bddc10816ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:16.866170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1198/2405] 10.222.0.96 () {58 vars in 967 bytes} [Wed Aug 24 04:34:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:34:16.894461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd605bf-5e99-44c5-af05-8eaf34f07883 service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:16.906418 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd605bf-5e99-44c5-af05-8eaf34f07883 service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:16.911615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a20b1-7e6c-42bf-8e9c-e9963d798ab2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953d2dbd5e7d435f9148fd043b4ce7a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:16.912236 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a20b1-7e6c-42bf-8e9c-e9963d798ab2 service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:16.912519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a20b1-7e6c-42bf-8e9c-e9963d798ab2 service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:16.912832 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a20b1-7e6c-42bf-8e9c-e9963d798ab2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:16.921481 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a20b1-7e6c-42bf-8e9c-e9963d798ab2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:16.923678 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a20b1-7e6c-42bf-8e9c-e9963d798ab2 service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:16.932633 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1208/2406] 10.222.0.96 () {60 vars in 1384 bytes} [Wed Aug 24 04:34:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:34:23.255600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81902683-cd46-46d2-af37-4ae2145aa098 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:23.256142 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81902683-cd46-46d2-af37-4ae2145aa098 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:23.256142 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81902683-cd46-46d2-af37-4ae2145aa098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:23.285131 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-81902683-cd46-46d2-af37-4ae2145aa098 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:23.286266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-81902683-cd46-46d2-af37-4ae2145aa098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:23.294164 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1199/2407] 10.222.0.100 () {58 vars in 1017 bytes} [Wed Aug 24 04:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:34:23.309326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a20b1-7e6c-42bf-8e9c-e9963d798ab2 service swift] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:23.323227 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a20b1-7e6c-42bf-8e9c-e9963d798ab2 service swift] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:23.329598 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9495fd4-ac4c-4747-8040-a52db0335b28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:23.330224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9495fd4-ac4c-4747-8040-a52db0335b28 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:23.330508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9495fd4-ac4c-4747-8040-a52db0335b28 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:23.330789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9495fd4-ac4c-4747-8040-a52db0335b28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:23.339785 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9495fd4-ac4c-4747-8040-a52db0335b28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:23.341430 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9495fd4-ac4c-4747-8040-a52db0335b28 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:23.352203 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1209/2408] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:34:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:34:26.786725 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bc953-c44b-4288-8dcc-70d50cba7dec None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:26.787293 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bc953-c44b-4288-8dcc-70d50cba7dec None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:26.787293 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bc953-c44b-4288-8dcc-70d50cba7dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:26.810348 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6a2bc953-c44b-4288-8dcc-70d50cba7dec None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:26.811768 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6a2bc953-c44b-4288-8dcc-70d50cba7dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:26.822229 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1200/2409] 10.222.0.100 () {58 vars in 1017 bytes} [Wed Aug 24 04:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:34:26.850916 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9495fd4-ac4c-4747-8040-a52db0335b28 service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:26.863666 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9495fd4-ac4c-4747-8040-a52db0335b28 service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:26.868772 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c572d6-0ffb-4260-99f2-d171a540cdf7 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:26.869070 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c572d6-0ffb-4260-99f2-d171a540cdf7 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:26.869191 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b6ece-1070-4a5d-8a30-396360ffafe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:26.869375 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c572d6-0ffb-4260-99f2-d171a540cdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:26.869792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b6ece-1070-4a5d-8a30-396360ffafe7 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:26.870077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b6ece-1070-4a5d-8a30-396360ffafe7 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:26.870351 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b6ece-1070-4a5d-8a30-396360ffafe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:26.879729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b6ece-1070-4a5d-8a30-396360ffafe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:26.881469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b6ece-1070-4a5d-8a30-396360ffafe7 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:26.888849 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-07c572d6-0ffb-4260-99f2-d171a540cdf7 None None] MFA Rules not processed for user `e9ffc48d1f6d49f49d00d1c2e762b987`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:26.890046 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-07c572d6-0ffb-4260-99f2-d171a540cdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:26.892425 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1210/2410] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:34:26.898183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1201/2411] 10.222.0.96 () {58 vars in 1009 bytes} [Wed Aug 24 04:34:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:34:26.917475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b6ece-1070-4a5d-8a30-396360ffafe7 service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:26.929655 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b6ece-1070-4a5d-8a30-396360ffafe7 service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:26.937823 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905bd35-ef32-4180-862b-8819a9fe67b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953d2dbd5e7d435f9148fd043b4ce7a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:26.938675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905bd35-ef32-4180-862b-8819a9fe67b8 service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:26.938949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905bd35-ef32-4180-862b-8819a9fe67b8 service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:26.939257 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905bd35-ef32-4180-862b-8819a9fe67b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:26.948675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905bd35-ef32-4180-862b-8819a9fe67b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:26.950311 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905bd35-ef32-4180-862b-8819a9fe67b8 service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:26.959083 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1211/2412] 10.222.0.96 () {60 vars in 1384 bytes} [Wed Aug 24 04:34:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:34:30.692870 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92634bf3-1616-48f9-bf07-a5eeeeb5843b None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:30.694294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92634bf3-1616-48f9-bf07-a5eeeeb5843b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:30.694724 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92634bf3-1616-48f9-bf07-a5eeeeb5843b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:30.723967 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-92634bf3-1616-48f9-bf07-a5eeeeb5843b None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:30.726001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-92634bf3-1616-48f9-bf07-a5eeeeb5843b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:30.739595 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1202/2413] 10.222.0.100 () {58 vars in 1017 bytes} [Wed Aug 24 04:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:34:30.759902 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905bd35-ef32-4180-862b-8819a9fe67b8 service swift] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:30.775426 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905bd35-ef32-4180-862b-8819a9fe67b8 service swift] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:30.786729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793488d8-8858-42f5-baae-fd940e2461fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:30.787405 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793488d8-8858-42f5-baae-fd940e2461fc service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:30.788096 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793488d8-8858-42f5-baae-fd940e2461fc service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:30.788495 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793488d8-8858-42f5-baae-fd940e2461fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:30.800962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793488d8-8858-42f5-baae-fd940e2461fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:30.802749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793488d8-8858-42f5-baae-fd940e2461fc service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:30.816976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1212/2414] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:34:34.943355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8857149-c769-48a9-aab0-541fb66f62a1 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:34.943916 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8857149-c769-48a9-aab0-541fb66f62a1 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:34.944143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8857149-c769-48a9-aab0-541fb66f62a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:34.982348 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-b8857149-c769-48a9-aab0-541fb66f62a1 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:34.983972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b8857149-c769-48a9-aab0-541fb66f62a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:34.993950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1203/2415] 10.222.0.100 () {58 vars in 1017 bytes} [Wed Aug 24 04:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:34:35.012450 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793488d8-8858-42f5-baae-fd940e2461fc service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:35.014071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-793488d8-8858-42f5-baae-fd940e2461fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:35.033466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793488d8-8858-42f5-baae-fd940e2461fc service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:35.039725 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bce20-90d3-4736-aebb-ed2c474e3d66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:35.040611 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bce20-90d3-4736-aebb-ed2c474e3d66 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:35.041087 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bce20-90d3-4736-aebb-ed2c474e3d66 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:35.041540 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bce20-90d3-4736-aebb-ed2c474e3d66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:35.052503 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768bce20-90d3-4736-aebb-ed2c474e3d66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:35.054441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768bce20-90d3-4736-aebb-ed2c474e3d66 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:35.070672 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1213/2416] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:34:39.165991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b87cd4-2c70-430e-9d36-3493d8494292 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:39.167383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b87cd4-2c70-430e-9d36-3493d8494292 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:39.168255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b87cd4-2c70-430e-9d36-3493d8494292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:39.202337 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e3b87cd4-2c70-430e-9d36-3493d8494292 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:39.206198 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e3b87cd4-2c70-430e-9d36-3493d8494292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:39.224077 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1204/2417] 10.222.0.100 () {58 vars in 1017 bytes} [Wed Aug 24 04:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:34:39.242499 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bce20-90d3-4736-aebb-ed2c474e3d66 service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:39.255458 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bce20-90d3-4736-aebb-ed2c474e3d66 service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:39.261572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fe34d-ba8f-462d-ae04-ee5104d24613 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:39.263341 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fe34d-ba8f-462d-ae04-ee5104d24613 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:39.263853 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fe34d-ba8f-462d-ae04-ee5104d24613 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:39.264367 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fe34d-ba8f-462d-ae04-ee5104d24613 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:39.275994 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fe34d-ba8f-462d-ae04-ee5104d24613 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:39.277994 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fe34d-ba8f-462d-ae04-ee5104d24613 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:39.290301 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1214/2418] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:34:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:34:43.501618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63d85c-dbe6-4a21-8fc5-6711dd2e9fa6 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:43.502337 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63d85c-dbe6-4a21-8fc5-6711dd2e9fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:43.502337 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63d85c-dbe6-4a21-8fc5-6711dd2e9fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:43.509537 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=25 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:43.524194 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-5b63d85c-dbe6-4a21-8fc5-6711dd2e9fa6 None None] MFA Rules not processed for user `e9ffc48d1f6d49f49d00d1c2e762b987`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:43.525465 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5b63d85c-dbe6-4a21-8fc5-6711dd2e9fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:43.533031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1205/2419] 10.222.0.96 () {58 vars in 967 bytes} [Wed Aug 24 04:34:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:34:43.546480 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fe34d-ba8f-462d-ae04-ee5104d24613 service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:43.552437 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=81 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:43.559265 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fe34d-ba8f-462d-ae04-ee5104d24613 service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:43.565734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0af61f-fbff-4d39-a32c-479a5da019b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953d2dbd5e7d435f9148fd043b4ce7a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:43.566361 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0af61f-fbff-4d39-a32c-479a5da019b4 service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:43.566642 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0af61f-fbff-4d39-a32c-479a5da019b4 service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:43.566920 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0af61f-fbff-4d39-a32c-479a5da019b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:43.576557 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0af61f-fbff-4d39-a32c-479a5da019b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:43.578271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0af61f-fbff-4d39-a32c-479a5da019b4 service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:43.588234 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1215/2420] 10.222.0.96 () {60 vars in 1384 bytes} [Wed Aug 24 04:34:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:34:45.594425 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63d85c-dbe6-4a21-8fc5-6711dd2e9fa6 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:45.607913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63d85c-dbe6-4a21-8fc5-6711dd2e9fa6 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:45.615355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7385b5-5dcf-45fb-8826-4270019dcdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:45.616432 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7385b5-5dcf-45fb-8826-4270019dcdfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:45.616911 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7385b5-5dcf-45fb-8826-4270019dcdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:45.617185 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7385b5-5dcf-45fb-8826-4270019dcdfa admin admin] PATH_INFO: `/v3/users/1d4d395ec752434fabf216d33e839498` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:45.618502 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7385b5-5dcf-45fb-8826-4270019dcdfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d4d395ec752434fabf216d33e839498)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:45.620960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7385b5-5dcf-45fb-8826-4270019dcdfa admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:45.680340 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ac7385b5-5dcf-45fb-8826-4270019dcdfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d4d395ec752434fabf216d33e839498'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:34:45.681378 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ac7385b5-5dcf-45fb-8826-4270019dcdfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d4d395ec752434fabf216d33e839498'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:34:45.694282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ac7385b5-5dcf-45fb-8826-4270019dcdfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d4d395ec752434fabf216d33e839498'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:34:45.694946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ac7385b5-5dcf-45fb-8826-4270019dcdfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d4d395ec752434fabf216d33e839498'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:34:45.704890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ac7385b5-5dcf-45fb-8826-4270019dcdfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d4d395ec752434fabf216d33e839498'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:34:45.726930 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1206/2421] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:34:45 2022] DELETE /identity/v3/users/1d4d395ec752434fabf216d33e839498 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:34:45.913789 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0af61f-fbff-4d39-a32c-479a5da019b4 service swift] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:45.931010 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0af61f-fbff-4d39-a32c-479a5da019b4 service swift] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:45.998100 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ba047-f81f-4f68-aeab-39d6be9d2f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:45.998743 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ba047-f81f-4f68-aeab-39d6be9d2f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:45.999029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ba047-f81f-4f68-aeab-39d6be9d2f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:45.999311 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ba047-f81f-4f68-aeab-39d6be9d2f2c admin admin] PATH_INFO: `/v3/projects/bf93e98e5d5f435ca0fbb155f69b0c80` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:46.001148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ba047-f81f-4f68-aeab-39d6be9d2f2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf93e98e5d5f435ca0fbb155f69b0c80)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:46.003281 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ba047-f81f-4f68-aeab-39d6be9d2f2c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:46.054270 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-985ba047-f81f-4f68-aeab-39d6be9d2f2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf93e98e5d5f435ca0fbb155f69b0c80', 'request_id': 'req-985ba047-f81f-4f68-aeab-39d6be9d2f2c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:34:46.062294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-985ba047-f81f-4f68-aeab-39d6be9d2f2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf93e98e5d5f435ca0fbb155f69b0c80', 'request_id': 'req-985ba047-f81f-4f68-aeab-39d6be9d2f2c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:34:46.069623 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-985ba047-f81f-4f68-aeab-39d6be9d2f2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf93e98e5d5f435ca0fbb155f69b0c80', 'request_id': 'req-985ba047-f81f-4f68-aeab-39d6be9d2f2c'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:34:46.082061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-985ba047-f81f-4f68-aeab-39d6be9d2f2c admin admin] The token cache is being invalidate because project bf93e98e5d5f435ca0fbb155f69b0c80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:34:46.082355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-985ba047-f81f-4f68-aeab-39d6be9d2f2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:34:46.083030 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-985ba047-f81f-4f68-aeab-39d6be9d2f2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:34:46.084538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1216/2422] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:34:45 2022] DELETE /identity/v3/projects/bf93e98e5d5f435ca0fbb155f69b0c80 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:34:46.089927 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d85d9-868f-4ec0-9ac8-0910e3e3e669 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:46.090220 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d85d9-868f-4ec0-9ac8-0910e3e3e669 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:46.090496 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d85d9-868f-4ec0-9ac8-0910e3e3e669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:46.110805 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-e29d85d9-868f-4ec0-9ac8-0910e3e3e669 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:46.112025 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e29d85d9-868f-4ec0-9ac8-0910e3e3e669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:46.180288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1207/2423] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:34:46.250294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e300dd1-a50a-4511-96b5-360a79c99185 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:46.250560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e300dd1-a50a-4511-96b5-360a79c99185 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:46.250837 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e300dd1-a50a-4511-96b5-360a79c99185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:46.270555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6e300dd1-a50a-4511-96b5-360a79c99185 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:46.271803 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6e300dd1-a50a-4511-96b5-360a79c99185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:46.279788 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1217/2424] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:34:46.285038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d85d9-868f-4ec0-9ac8-0910e3e3e669 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:46.294948 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d85d9-868f-4ec0-9ac8-0910e3e3e669 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:46.299714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea666178-976e-41c6-8328-fe9588ee1aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:46.300328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea666178-976e-41c6-8328-fe9588ee1aec admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:46.300614 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea666178-976e-41c6-8328-fe9588ee1aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:46.300939 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea666178-976e-41c6-8328-fe9588ee1aec admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:46.301629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea666178-976e-41c6-8328-fe9588ee1aec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:34:46.301940 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea666178-976e-41c6-8328-fe9588ee1aec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:46.303545 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea666178-976e-41c6-8328-fe9588ee1aec admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:46.315705 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1208/2425] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:34:46.320130 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e300dd1-a50a-4511-96b5-360a79c99185 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:46.330391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e300dd1-a50a-4511-96b5-360a79c99185 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:46.335215 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2c73b-5a41-4a11-90be-ec59e0dbd5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:46.335819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2c73b-5a41-4a11-90be-ec59e0dbd5f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:46.336105 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2c73b-5a41-4a11-90be-ec59e0dbd5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:46.336383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2c73b-5a41-4a11-90be-ec59e0dbd5f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:46.337312 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2c73b-5a41-4a11-90be-ec59e0dbd5f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:46.339220 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2c73b-5a41-4a11-90be-ec59e0dbd5f9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:46.367409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1218/2426] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:34:46 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:34:46.371575 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea666178-976e-41c6-8328-fe9588ee1aec admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:46.382608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea666178-976e-41c6-8328-fe9588ee1aec admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:46.432636 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:46.441448 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f9d09-1fc1-43cc-9533-84bb74251599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:46.442194 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f9d09-1fc1-43cc-9533-84bb74251599 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:46.442674 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f9d09-1fc1-43cc-9533-84bb74251599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:46.443117 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f9d09-1fc1-43cc-9533-84bb74251599 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:46.444028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f9d09-1fc1-43cc-9533-84bb74251599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:46.446059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f9d09-1fc1-43cc-9533-84bb74251599 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:46.467919 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1209/2427] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:34:46 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:34:46.472165 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2c73b-5a41-4a11-90be-ec59e0dbd5f9 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:46.482691 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2c73b-5a41-4a11-90be-ec59e0dbd5f9 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:46.487527 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a302bd-a95c-4f89-a66a-a3471cff6804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:46.488075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a302bd-a95c-4f89-a66a-a3471cff6804 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:46.488355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a302bd-a95c-4f89-a66a-a3471cff6804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:46.488632 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a302bd-a95c-4f89-a66a-a3471cff6804 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:46.489323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a302bd-a95c-4f89-a66a-a3471cff6804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:46.490917 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a302bd-a95c-4f89-a66a-a3471cff6804 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:46.501562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1219/2428] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:34:46.505550 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f9d09-1fc1-43cc-9533-84bb74251599 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:46.516448 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f9d09-1fc1-43cc-9533-84bb74251599 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:46.521345 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e00bca-0f3d-4922-8ab5-aa85fc573934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:46.521953 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e00bca-0f3d-4922-8ab5-aa85fc573934 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:46.522239 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e00bca-0f3d-4922-8ab5-aa85fc573934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:46.522546 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e00bca-0f3d-4922-8ab5-aa85fc573934 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:46.523202 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e00bca-0f3d-4922-8ab5-aa85fc573934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:46.524867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e00bca-0f3d-4922-8ab5-aa85fc573934 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:46.536269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1210/2429] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:34:46.540401 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a302bd-a95c-4f89-a66a-a3471cff6804 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:46.550278 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a302bd-a95c-4f89-a66a-a3471cff6804 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:46.554858 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97702f65-e50a-4495-9ea1-3d38c98a0955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:46.555503 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97702f65-e50a-4495-9ea1-3d38c98a0955 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:46.555782 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97702f65-e50a-4495-9ea1-3d38c98a0955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:46.556054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97702f65-e50a-4495-9ea1-3d38c98a0955 admin admin] PATH_INFO: `/v3/projects/1a1f4012cdf84caa855a88e25fb50971/users/9d6ed2597a1a4d42aaeb24ce1ea02fe8/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:46.571492 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97702f65-e50a-4495-9ea1-3d38c98a0955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1f4012cdf84caa855a88e25fb50971, user_id=9d6ed2597a1a4d42aaeb24ce1ea02fe8, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:46.574182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97702f65-e50a-4495-9ea1-3d38c98a0955 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:46.588287 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1220/2430] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:34:46 2022] PUT /identity/v3/projects/1a1f4012cdf84caa855a88e25fb50971/users/9d6ed2597a1a4d42aaeb24ce1ea02fe8/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:34:46.598780 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c9e77-afae-4982-b595-77c27fa5cd46 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:46.599303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c9e77-afae-4982-b595-77c27fa5cd46 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:46.599303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c9e77-afae-4982-b595-77c27fa5cd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:46.628197 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-587c9e77-afae-4982-b595-77c27fa5cd46 None None] MFA Rules not processed for user `9d6ed2597a1a4d42aaeb24ce1ea02fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:46.629456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-587c9e77-afae-4982-b595-77c27fa5cd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:46.698548 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1211/2431] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:34:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:34:46.710219 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97702f65-e50a-4495-9ea1-3d38c98a0955 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:34:46.711922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-97702f65-e50a-4495-9ea1-3d38c98a0955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:46.730534 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:46.772107 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97702f65-e50a-4495-9ea1-3d38c98a0955 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:34:46.775710 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f08056-c92a-4753-a4c3-f535c9569818 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:34:46.776335 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f08056-c92a-4753-a4c3-f535c9569818 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:46.776621 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f08056-c92a-4753-a4c3-f535c9569818 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:46.776934 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f08056-c92a-4753-a4c3-f535c9569818 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:46.785614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f08056-c92a-4753-a4c3-f535c9569818 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:34:46.787056 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f08056-c92a-4753-a4c3-f535c9569818 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:34:46.795853 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1221/2432] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:34:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:34:56.695494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=41,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:56.784476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71384b-8b59-4318-9693-c314513e7060 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:34:56.784798 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71384b-8b59-4318-9693-c314513e7060 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:34:56.785092 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71384b-8b59-4318-9693-c314513e7060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:34:56.791795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=19 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:34:56.804924 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-8a71384b-8b59-4318-9693-c314513e7060 None None] MFA Rules not processed for user `75f2c24684c04230897fd9b67baf86a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:34:56.806148 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-8a71384b-8b59-4318-9693-c314513e7060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:34:56.864105 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1212/2433] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:34:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:35:06.856511 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=25 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:15.331640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbfaa1-db9b-43f5-96e8-3ab1a77d6c86 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:15.332073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbfaa1-db9b-43f5-96e8-3ab1a77d6c86 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:15.332176 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbfaa1-db9b-43f5-96e8-3ab1a77d6c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:15.351917 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-75dbfaa1-db9b-43f5-96e8-3ab1a77d6c86 None None] MFA Rules not processed for user `c0a2c80ee21c45af9028106a50db4791`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:15.353412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-75dbfaa1-db9b-43f5-96e8-3ab1a77d6c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:15.409532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1222/2434] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:35:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:35:17.090513 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f917101-bc46-4f8a-b1ae-3680c2776b1d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:17.091194 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f917101-bc46-4f8a-b1ae-3680c2776b1d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:17.091476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f917101-bc46-4f8a-b1ae-3680c2776b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:17.115387 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-2f917101-bc46-4f8a-b1ae-3680c2776b1d None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:17.116792 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2f917101-bc46-4f8a-b1ae-3680c2776b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:17.193574 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1213/2435] 10.222.0.100 () {58 vars in 1017 bytes} [Wed Aug 24 04:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:35:17.210078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbfaa1-db9b-43f5-96e8-3ab1a77d6c86 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:17.212040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-75dbfaa1-db9b-43f5-96e8-3ab1a77d6c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:17.287745 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbfaa1-db9b-43f5-96e8-3ab1a77d6c86 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:17.293830 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565b29c-eb8b-4827-bdf1-7a1393f10cad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:17.294262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565b29c-eb8b-4827-bdf1-7a1393f10cad service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:17.294545 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565b29c-eb8b-4827-bdf1-7a1393f10cad service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:17.294825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565b29c-eb8b-4827-bdf1-7a1393f10cad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:17.305336 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565b29c-eb8b-4827-bdf1-7a1393f10cad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:17.306956 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565b29c-eb8b-4827-bdf1-7a1393f10cad service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:17.317768 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1223/2436] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:35:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:35:19.150338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f917101-bc46-4f8a-b1ae-3680c2776b1d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:19.160968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f917101-bc46-4f8a-b1ae-3680c2776b1d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:19.165762 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed81c5-7de2-4570-8e08-3d6e7d769854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:19.166422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed81c5-7de2-4570-8e08-3d6e7d769854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:19.166707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed81c5-7de2-4570-8e08-3d6e7d769854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:19.166984 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed81c5-7de2-4570-8e08-3d6e7d769854 admin admin] PATH_INFO: `/v3/users/9d6ed2597a1a4d42aaeb24ce1ea02fe8` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:19.168158 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed81c5-7de2-4570-8e08-3d6e7d769854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d6ed2597a1a4d42aaeb24ce1ea02fe8)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:19.170187 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed81c5-7de2-4570-8e08-3d6e7d769854 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:19.225319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-44ed81c5-7de2-4570-8e08-3d6e7d769854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d6ed2597a1a4d42aaeb24ce1ea02fe8'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:35:19.226028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-44ed81c5-7de2-4570-8e08-3d6e7d769854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d6ed2597a1a4d42aaeb24ce1ea02fe8'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:35:19.235055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-44ed81c5-7de2-4570-8e08-3d6e7d769854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d6ed2597a1a4d42aaeb24ce1ea02fe8'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:35:19.235395 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-44ed81c5-7de2-4570-8e08-3d6e7d769854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d6ed2597a1a4d42aaeb24ce1ea02fe8'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:35:19.244302 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-44ed81c5-7de2-4570-8e08-3d6e7d769854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d6ed2597a1a4d42aaeb24ce1ea02fe8'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:35:19.263092 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1214/2437] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:35:19 2022] DELETE /identity/v3/users/9d6ed2597a1a4d42aaeb24ce1ea02fe8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:35:19.267854 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c032b9-db3f-4121-82de-9447537955cf None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:19.268360 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c032b9-db3f-4121-82de-9447537955cf None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:19.268477 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c032b9-db3f-4121-82de-9447537955cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:19.288895 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-18c032b9-db3f-4121-82de-9447537955cf None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:19.290129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-18c032b9-db3f-4121-82de-9447537955cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:19.354099 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1224/2438] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:35:19.364589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed81c5-7de2-4570-8e08-3d6e7d769854 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:19.366051 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-44ed81c5-7de2-4570-8e08-3d6e7d769854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:19.429256 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed81c5-7de2-4570-8e08-3d6e7d769854 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:19.432881 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76ae7d-2470-48a4-be29-073372a8f57d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:19.433498 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76ae7d-2470-48a4-be29-073372a8f57d service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:19.433780 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76ae7d-2470-48a4-be29-073372a8f57d service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:19.434052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76ae7d-2470-48a4-be29-073372a8f57d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:19.443387 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76ae7d-2470-48a4-be29-073372a8f57d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:19.444856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76ae7d-2470-48a4-be29-073372a8f57d service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:19.454640 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1215/2439] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:35:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:35:19.736710 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c032b9-db3f-4121-82de-9447537955cf None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:19.737900 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-18c032b9-db3f-4121-82de-9447537955cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:19.752466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c032b9-db3f-4121-82de-9447537955cf None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:19.757742 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7e1d9-10d4-406a-88b0-0a6caa147608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:19.758540 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7e1d9-10d4-406a-88b0-0a6caa147608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:19.759063 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7e1d9-10d4-406a-88b0-0a6caa147608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:19.759551 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7e1d9-10d4-406a-88b0-0a6caa147608 admin admin] PATH_INFO: `/v3/projects/1a1f4012cdf84caa855a88e25fb50971` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:19.761199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7e1d9-10d4-406a-88b0-0a6caa147608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a1f4012cdf84caa855a88e25fb50971)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:19.763508 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7e1d9-10d4-406a-88b0-0a6caa147608 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:19.798391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:19.833913 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-01a7e1d9-10d4-406a-88b0-0a6caa147608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a1f4012cdf84caa855a88e25fb50971', 'request_id': 'req-01a7e1d9-10d4-406a-88b0-0a6caa147608'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:35:19.844846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-01a7e1d9-10d4-406a-88b0-0a6caa147608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a1f4012cdf84caa855a88e25fb50971', 'request_id': 'req-01a7e1d9-10d4-406a-88b0-0a6caa147608'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:35:19.855013 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-01a7e1d9-10d4-406a-88b0-0a6caa147608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a1f4012cdf84caa855a88e25fb50971', 'request_id': 'req-01a7e1d9-10d4-406a-88b0-0a6caa147608'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:35:19.868454 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-01a7e1d9-10d4-406a-88b0-0a6caa147608 admin admin] The token cache is being invalidate because project 1a1f4012cdf84caa855a88e25fb50971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:35:19.868779 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-01a7e1d9-10d4-406a-88b0-0a6caa147608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:35:19.869447 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-01a7e1d9-10d4-406a-88b0-0a6caa147608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:35:19.870939 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1225/2440] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:35:19 2022] DELETE /identity/v3/projects/1a1f4012cdf84caa855a88e25fb50971 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:35:21.367539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37397817-3250-4332-8c4f-cf9434a916d0 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:21.368073 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37397817-3250-4332-8c4f-cf9434a916d0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:21.368073 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37397817-3250-4332-8c4f-cf9434a916d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:21.387578 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-37397817-3250-4332-8c4f-cf9434a916d0 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:21.388819 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-37397817-3250-4332-8c4f-cf9434a916d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:21.399135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:21.459169 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1216/2441] 10.222.0.100 () {58 vars in 1017 bytes} [Wed Aug 24 04:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:35:21.476229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7e1d9-10d4-406a-88b0-0a6caa147608 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:21.477935 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-01a7e1d9-10d4-406a-88b0-0a6caa147608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:21.560136 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7e1d9-10d4-406a-88b0-0a6caa147608 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:21.566439 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecf2ba-5af5-4091-861b-2017438821a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:21.567051 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecf2ba-5af5-4091-861b-2017438821a4 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:21.567332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecf2ba-5af5-4091-861b-2017438821a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:21.567605 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecf2ba-5af5-4091-861b-2017438821a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:21.575841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbecf2ba-5af5-4091-861b-2017438821a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:21.577466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbecf2ba-5af5-4091-861b-2017438821a4 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:21.587141 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1226/2442] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:35:24.202044 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0962695-a841-42c7-b964-b179df0b62a1 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:24.202571 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0962695-a841-42c7-b964-b179df0b62a1 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:24.203261 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0962695-a841-42c7-b964-b179df0b62a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:24.228474 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a0962695-a841-42c7-b964-b179df0b62a1 None None] MFA Rules not processed for user `eb97bbb6260a45f3bfeb404b8c9fa815`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:24.229727 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a0962695-a841-42c7-b964-b179df0b62a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:24.289504 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1217/2443] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:35:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:35:24.467324 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c4f64-7b02-4076-bae4-6379f2cd84f6 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:24.467866 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c4f64-7b02-4076-bae4-6379f2cd84f6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:24.467866 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c4f64-7b02-4076-bae4-6379f2cd84f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:24.489040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-bf7c4f64-7b02-4076-bae4-6379f2cd84f6 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:24.490262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-bf7c4f64-7b02-4076-bae4-6379f2cd84f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:24.498925 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1227/2444] 10.222.0.100 () {58 vars in 1017 bytes} [Wed Aug 24 04:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:35:24.520064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0962695-a841-42c7-b964-b179df0b62a1 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:24.533297 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0962695-a841-42c7-b964-b179df0b62a1 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:24.538796 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ed80c-c872-4761-b757-3a2a43348a96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:24.539412 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ed80c-c872-4761-b757-3a2a43348a96 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:24.539698 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ed80c-c872-4761-b757-3a2a43348a96 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:24.539980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ed80c-c872-4761-b757-3a2a43348a96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:24.549794 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ed80c-c872-4761-b757-3a2a43348a96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:24.551399 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ed80c-c872-4761-b757-3a2a43348a96 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:24.563286 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1218/2445] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:35:27.607233 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e88554-264a-42b1-8bf7-cd95dc8bebd1 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:27.607766 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e88554-264a-42b1-8bf7-cd95dc8bebd1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:27.607766 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e88554-264a-42b1-8bf7-cd95dc8bebd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:27.628932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-38e88554-264a-42b1-8bf7-cd95dc8bebd1 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:27.630188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-38e88554-264a-42b1-8bf7-cd95dc8bebd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:27.639005 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1228/2446] 10.222.0.100 () {58 vars in 1017 bytes} [Wed Aug 24 04:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:35:27.654428 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ed80c-c872-4761-b757-3a2a43348a96 service nova] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:27.666406 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ed80c-c872-4761-b757-3a2a43348a96 service nova] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:27.672975 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47ede6-d637-4575-b19b-3648705c46bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:27.673598 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47ede6-d637-4575-b19b-3648705c46bd service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:27.673886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47ede6-d637-4575-b19b-3648705c46bd service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:27.674172 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47ede6-d637-4575-b19b-3648705c46bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:27.683087 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47ede6-d637-4575-b19b-3648705c46bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:27.684705 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47ede6-d637-4575-b19b-3648705c46bd service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:27.695184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1219/2447] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:35:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:35:31.843251 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b934204-08e3-444a-86b5-f5600b6c1f51 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:31.844251 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b934204-08e3-444a-86b5-f5600b6c1f51 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:31.844621 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b934204-08e3-444a-86b5-f5600b6c1f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:31.866946 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-7b934204-08e3-444a-86b5-f5600b6c1f51 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:31.868179 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7b934204-08e3-444a-86b5-f5600b6c1f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:31.877236 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1229/2448] 10.222.0.100 () {58 vars in 1017 bytes} [Wed Aug 24 04:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:35:31.892067 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47ede6-d637-4575-b19b-3648705c46bd service nova] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:31.893938 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-fb47ede6-d637-4575-b19b-3648705c46bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:31.912116 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47ede6-d637-4575-b19b-3648705c46bd service nova] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:31.918280 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98282c-9639-4536-9da8-8a1f8cb97f16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:31.918863 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98282c-9639-4536-9da8-8a1f8cb97f16 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:31.919659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98282c-9639-4536-9da8-8a1f8cb97f16 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:31.919659 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98282c-9639-4536-9da8-8a1f8cb97f16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:31.929344 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98282c-9639-4536-9da8-8a1f8cb97f16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:31.930928 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98282c-9639-4536-9da8-8a1f8cb97f16 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:31.943727 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1220/2449] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:35:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:35:41.861905 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=6,keystone:SELECT=57,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:41.938275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=63 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:02.210471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b934204-08e3-444a-86b5-f5600b6c1f51 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:02.212443 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7b934204-08e3-444a-86b5-f5600b6c1f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:02.228718 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b934204-08e3-444a-86b5-f5600b6c1f51 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:02.233478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f444038-8f81-4394-8bea-e4a43e4ab3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:02.234126 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f444038-8f81-4394-8bea-e4a43e4ab3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:02.234594 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f444038-8f81-4394-8bea-e4a43e4ab3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:02.234881 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f444038-8f81-4394-8bea-e4a43e4ab3e4 admin admin] PATH_INFO: `/v3/users/75f2c24684c04230897fd9b67baf86a1` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:02.236039 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f444038-8f81-4394-8bea-e4a43e4ab3e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75f2c24684c04230897fd9b67baf86a1)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:02.238037 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f444038-8f81-4394-8bea-e4a43e4ab3e4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:02.286394 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6f444038-8f81-4394-8bea-e4a43e4ab3e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75f2c24684c04230897fd9b67baf86a1'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:02.287054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6f444038-8f81-4394-8bea-e4a43e4ab3e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75f2c24684c04230897fd9b67baf86a1'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:02.294532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6f444038-8f81-4394-8bea-e4a43e4ab3e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75f2c24684c04230897fd9b67baf86a1'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:02.295159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6f444038-8f81-4394-8bea-e4a43e4ab3e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75f2c24684c04230897fd9b67baf86a1'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:02.307104 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6f444038-8f81-4394-8bea-e4a43e4ab3e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75f2c24684c04230897fd9b67baf86a1'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:02.319551 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1230/2450] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:36:02 2022] DELETE /identity/v3/users/75f2c24684c04230897fd9b67baf86a1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:02.504170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98282c-9639-4536-9da8-8a1f8cb97f16 service nova] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:02.516760 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98282c-9639-4536-9da8-8a1f8cb97f16 service nova] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:02.580180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fc2fa-bad3-4075-9077-704c2ace1377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:02.580752 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fc2fa-bad3-4075-9077-704c2ace1377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:02.581189 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fc2fa-bad3-4075-9077-704c2ace1377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:02.581470 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fc2fa-bad3-4075-9077-704c2ace1377 admin admin] PATH_INFO: `/v3/projects/cd4d8c0fd6e249af995b3ca66c2de057` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:02.582622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fc2fa-bad3-4075-9077-704c2ace1377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd4d8c0fd6e249af995b3ca66c2de057)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:02.584537 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fc2fa-bad3-4075-9077-704c2ace1377 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:02.633122 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2a4fc2fa-bad3-4075-9077-704c2ace1377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4d8c0fd6e249af995b3ca66c2de057', 'request_id': 'req-2a4fc2fa-bad3-4075-9077-704c2ace1377'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:02.638866 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2a4fc2fa-bad3-4075-9077-704c2ace1377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4d8c0fd6e249af995b3ca66c2de057', 'request_id': 'req-2a4fc2fa-bad3-4075-9077-704c2ace1377'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:02.646086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2a4fc2fa-bad3-4075-9077-704c2ace1377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4d8c0fd6e249af995b3ca66c2de057', 'request_id': 'req-2a4fc2fa-bad3-4075-9077-704c2ace1377'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:02.660718 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2a4fc2fa-bad3-4075-9077-704c2ace1377 admin admin] The token cache is being invalidate because project cd4d8c0fd6e249af995b3ca66c2de057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:36:02.661105 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2a4fc2fa-bad3-4075-9077-704c2ace1377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:02.662188 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-2a4fc2fa-bad3-4075-9077-704c2ace1377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:02.663786 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1221/2451] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:36:02 2022] DELETE /identity/v3/projects/cd4d8c0fd6e249af995b3ca66c2de057 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:06.102546 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f444038-8f81-4394-8bea-e4a43e4ab3e4 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:06.103900 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6f444038-8f81-4394-8bea-e4a43e4ab3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:06.161545 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f444038-8f81-4394-8bea-e4a43e4ab3e4 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:06.211942 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfd92d-0fad-4d2e-bb50-d0bf640489f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:06.212568 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfd92d-0fad-4d2e-bb50-d0bf640489f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:06.212881 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfd92d-0fad-4d2e-bb50-d0bf640489f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:06.213162 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfd92d-0fad-4d2e-bb50-d0bf640489f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:06.215255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d8dfd92d-0fad-4d2e-bb50-d0bf640489f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:06.263466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:06.295292 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dfd92d-0fad-4d2e-bb50-d0bf640489f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:06.296799 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dfd92d-0fad-4d2e-bb50-d0bf640489f7 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:06.307786 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1231/2452] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:36:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:36:07.495004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fc2fa-bad3-4075-9077-704c2ace1377 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:07.496816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2a4fc2fa-bad3-4075-9077-704c2ace1377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:07.509859 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fc2fa-bad3-4075-9077-704c2ace1377 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:07.513841 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777c52d-5d86-4436-822f-31a234b589bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:07.514444 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777c52d-5d86-4436-822f-31a234b589bc service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:07.514904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777c52d-5d86-4436-822f-31a234b589bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:07.515413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777c52d-5d86-4436-822f-31a234b589bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:07.517246 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3777c52d-5d86-4436-822f-31a234b589bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:07.531049 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777c52d-5d86-4436-822f-31a234b589bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:07.532405 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777c52d-5d86-4436-822f-31a234b589bc service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:07.543237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1222/2453] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:36:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:36:16.302891 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=14 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:17.538483 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:24.020489 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfd92d-0fad-4d2e-bb50-d0bf640489f7 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:24.021914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d8dfd92d-0fad-4d2e-bb50-d0bf640489f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:24.036063 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfd92d-0fad-4d2e-bb50-d0bf640489f7 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:24.041626 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b472e2-f715-4625-b839-982cba7b40d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:24.042292 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b472e2-f715-4625-b839-982cba7b40d8 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:24.042582 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b472e2-f715-4625-b839-982cba7b40d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:24.042862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b472e2-f715-4625-b839-982cba7b40d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:24.044607 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-19b472e2-f715-4625-b839-982cba7b40d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:24.105178 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b472e2-f715-4625-b839-982cba7b40d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:24.106785 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b472e2-f715-4625-b839-982cba7b40d8 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:24.115994 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1232/2454] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:36:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:36:34.111651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=28 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:35.040875 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777c52d-5d86-4436-822f-31a234b589bc service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:35.043183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3777c52d-5d86-4436-822f-31a234b589bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:35.066399 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777c52d-5d86-4436-822f-31a234b589bc service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:35.073618 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73c755-6881-46c0-a85b-53190268acb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:35.074826 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73c755-6881-46c0-a85b-53190268acb5 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:35.075473 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73c755-6881-46c0-a85b-53190268acb5 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:35.076136 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73c755-6881-46c0-a85b-53190268acb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:35.078396 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4a73c755-6881-46c0-a85b-53190268acb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:35.160103 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73c755-6881-46c0-a85b-53190268acb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:35.161778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73c755-6881-46c0-a85b-53190268acb5 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:35.171224 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1223/2455] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:36:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:36:36.172450 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b472e2-f715-4625-b839-982cba7b40d8 service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:36.174052 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-19b472e2-f715-4625-b839-982cba7b40d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:36.185932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b472e2-f715-4625-b839-982cba7b40d8 service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:36.190109 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803ed76-7a36-4dbe-ba8d-dae09b7dde9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:36.190722 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803ed76-7a36-4dbe-ba8d-dae09b7dde9f service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:36.191008 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803ed76-7a36-4dbe-ba8d-dae09b7dde9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:36.191285 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803ed76-7a36-4dbe-ba8d-dae09b7dde9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:36.193067 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b803ed76-7a36-4dbe-ba8d-dae09b7dde9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:36.281183 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803ed76-7a36-4dbe-ba8d-dae09b7dde9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:36.282733 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803ed76-7a36-4dbe-ba8d-dae09b7dde9f service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:36.294902 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1233/2456] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:36:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:36:39.214417 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e267fc-f8f5-415c-bbd4-5d23dad9fda2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:39.214947 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e267fc-f8f5-415c-bbd4-5d23dad9fda2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:39.215063 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e267fc-f8f5-415c-bbd4-5d23dad9fda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:39.235685 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-50e267fc-f8f5-415c-bbd4-5d23dad9fda2 None None] MFA Rules not processed for user `67bfd102d61945519b8480abb37f305a`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:39.236931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-50e267fc-f8f5-415c-bbd4-5d23dad9fda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:39.305506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1224/2457] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:36:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:36:39.815863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803ed76-7a36-4dbe-ba8d-dae09b7dde9f service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:39.843175 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803ed76-7a36-4dbe-ba8d-dae09b7dde9f service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:39.848041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c25ebc-4377-4ca4-8453-81712c5e5c73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:39.848676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c25ebc-4377-4ca4-8453-81712c5e5c73 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:39.849055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c25ebc-4377-4ca4-8453-81712c5e5c73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:39.849339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c25ebc-4377-4ca4-8453-81712c5e5c73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:39.851136 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-28c25ebc-4377-4ca4-8453-81712c5e5c73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:39.863176 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c25ebc-4377-4ca4-8453-81712c5e5c73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:39.864854 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c25ebc-4377-4ca4-8453-81712c5e5c73 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:39.875236 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1234/2458] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:36:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:36:40.323575 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e267fc-f8f5-415c-bbd4-5d23dad9fda2 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:40.325173 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-50e267fc-f8f5-415c-bbd4-5d23dad9fda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:40.419986 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e267fc-f8f5-415c-bbd4-5d23dad9fda2 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:40.425600 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b37b96-bce7-4e6c-a0e6-eadcd15022bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f7fe9af30947dbae1f2334b18f630d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:40.426246 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b37b96-bce7-4e6c-a0e6-eadcd15022bc service placement] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.426535 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b37b96-bce7-4e6c-a0e6-eadcd15022bc service placement] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.426818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b37b96-bce7-4e6c-a0e6-eadcd15022bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.428864 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e8b37b96-bce7-4e6c-a0e6-eadcd15022bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:40.443607 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b37b96-bce7-4e6c-a0e6-eadcd15022bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:40.445292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b37b96-bce7-4e6c-a0e6-eadcd15022bc service placement] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:40.459062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1225/2459] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:36:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:36:40.476500 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c25ebc-4377-4ca4-8453-81712c5e5c73 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:40.478261 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-28c25ebc-4377-4ca4-8453-81712c5e5c73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:40.497337 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c25ebc-4377-4ca4-8453-81712c5e5c73 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:40.502640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde685e-116a-46a1-b13e-097d149fb379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:40.503379 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde685e-116a-46a1-b13e-097d149fb379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.503738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde685e-116a-46a1-b13e-097d149fb379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.504090 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde685e-116a-46a1-b13e-097d149fb379 admin admin] PATH_INFO: `/v3/users/c0a2c80ee21c45af9028106a50db4791` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.505356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde685e-116a-46a1-b13e-097d149fb379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0a2c80ee21c45af9028106a50db4791)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:40.507383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde685e-116a-46a1-b13e-097d149fb379 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:40.573416 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9cde685e-116a-46a1-b13e-097d149fb379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0a2c80ee21c45af9028106a50db4791'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:40.573636 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9cde685e-116a-46a1-b13e-097d149fb379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0a2c80ee21c45af9028106a50db4791'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:40.584308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9cde685e-116a-46a1-b13e-097d149fb379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0a2c80ee21c45af9028106a50db4791'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:40.585030 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9cde685e-116a-46a1-b13e-097d149fb379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0a2c80ee21c45af9028106a50db4791'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:40.599647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-9cde685e-116a-46a1-b13e-097d149fb379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0a2c80ee21c45af9028106a50db4791'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:40.618557 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1235/2460] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:36:40 2022] DELETE /identity/v3/users/c0a2c80ee21c45af9028106a50db4791 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:40.832295 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b37b96-bce7-4e6c-a0e6-eadcd15022bc service placement] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:40.867683 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b37b96-bce7-4e6c-a0e6-eadcd15022bc service placement] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:40.924345 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:40.955179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c77890-6984-4cd2-a3c0-57017dc862b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:40.955823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c77890-6984-4cd2-a3c0-57017dc862b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.956108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c77890-6984-4cd2-a3c0-57017dc862b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.956386 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c77890-6984-4cd2-a3c0-57017dc862b1 admin admin] PATH_INFO: `/v3/projects/ff0a9e8cbf06404a8f1ad645c037e763` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.957552 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c77890-6984-4cd2-a3c0-57017dc862b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff0a9e8cbf06404a8f1ad645c037e763)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:40.959469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c77890-6984-4cd2-a3c0-57017dc862b1 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.013538 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-72c77890-6984-4cd2-a3c0-57017dc862b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff0a9e8cbf06404a8f1ad645c037e763', 'request_id': 'req-72c77890-6984-4cd2-a3c0-57017dc862b1'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:41.020153 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-72c77890-6984-4cd2-a3c0-57017dc862b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff0a9e8cbf06404a8f1ad645c037e763', 'request_id': 'req-72c77890-6984-4cd2-a3c0-57017dc862b1'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:41.026789 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-72c77890-6984-4cd2-a3c0-57017dc862b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff0a9e8cbf06404a8f1ad645c037e763', 'request_id': 'req-72c77890-6984-4cd2-a3c0-57017dc862b1'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:41.041000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-72c77890-6984-4cd2-a3c0-57017dc862b1 admin admin] The token cache is being invalidate because project ff0a9e8cbf06404a8f1ad645c037e763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:36:41.041233 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-72c77890-6984-4cd2-a3c0-57017dc862b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:41.041853 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-72c77890-6984-4cd2-a3c0-57017dc862b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:41.043408 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1226/2461] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:36:40 2022] DELETE /identity/v3/projects/ff0a9e8cbf06404a8f1ad645c037e763 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:41.048486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390a915-24f7-4898-8b66-613a47707c09 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.049023 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390a915-24f7-4898-8b66-613a47707c09 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.049217 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390a915-24f7-4898-8b66-613a47707c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.070259 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c390a915-24f7-4898-8b66-613a47707c09 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:41.071506 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c390a915-24f7-4898-8b66-613a47707c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:41.127273 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:41.142711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1236/2462] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:36:41.150345 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72256bbf-8b06-450c-8293-bb56a99f1fcf None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.150639 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72256bbf-8b06-450c-8293-bb56a99f1fcf None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.150917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72256bbf-8b06-450c-8293-bb56a99f1fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.171839 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-72256bbf-8b06-450c-8293-bb56a99f1fcf None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:41.173092 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-72256bbf-8b06-450c-8293-bb56a99f1fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:41.180881 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1227/2463] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:36:41.185236 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390a915-24f7-4898-8b66-613a47707c09 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:41.195926 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390a915-24f7-4898-8b66-613a47707c09 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:41.200406 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fb034-ae4a-4f02-b0c3-8837c87b2e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:41.201039 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fb034-ae4a-4f02-b0c3-8837c87b2e4f admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.201324 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fb034-ae4a-4f02-b0c3-8837c87b2e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.202216 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fb034-ae4a-4f02-b0c3-8837c87b2e4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.203134 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fb034-ae4a-4f02-b0c3-8837c87b2e4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:41.203439 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fb034-ae4a-4f02-b0c3-8837c87b2e4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:41.205073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fb034-ae4a-4f02-b0c3-8837c87b2e4f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.216909 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1237/2464] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:41.221926 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72256bbf-8b06-450c-8293-bb56a99f1fcf None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:41.231363 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72256bbf-8b06-450c-8293-bb56a99f1fcf None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:41.236188 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a695c0d-6337-4213-b3c1-d8efad847039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:41.236830 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a695c0d-6337-4213-b3c1-d8efad847039 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.237115 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a695c0d-6337-4213-b3c1-d8efad847039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.237389 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a695c0d-6337-4213-b3c1-d8efad847039 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.238024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a695c0d-6337-4213-b3c1-d8efad847039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:41.239932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a695c0d-6337-4213-b3c1-d8efad847039 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.268551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1228/2465] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:36:41 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:41.272294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fb034-ae4a-4f02-b0c3-8837c87b2e4f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:41.282594 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fb034-ae4a-4f02-b0c3-8837c87b2e4f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:41.344204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63338d4-f370-4d78-829e-a91fb93ab94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:41.344853 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63338d4-f370-4d78-829e-a91fb93ab94c admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.345145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63338d4-f370-4d78-829e-a91fb93ab94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.345420 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63338d4-f370-4d78-829e-a91fb93ab94c admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.346061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63338d4-f370-4d78-829e-a91fb93ab94c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:41.347984 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63338d4-f370-4d78-829e-a91fb93ab94c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.368907 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1238/2466] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:36:41 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:41.373035 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a695c0d-6337-4213-b3c1-d8efad847039 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:41.386129 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a695c0d-6337-4213-b3c1-d8efad847039 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:41.391746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8164076-f2a3-45e3-b3dc-3339cd5fca9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:41.392367 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8164076-f2a3-45e3-b3dc-3339cd5fca9a admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.392650 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8164076-f2a3-45e3-b3dc-3339cd5fca9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.393571 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8164076-f2a3-45e3-b3dc-3339cd5fca9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.393704 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8164076-f2a3-45e3-b3dc-3339cd5fca9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:41.395272 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8164076-f2a3-45e3-b3dc-3339cd5fca9a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.406462 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1229/2467] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:36:41.411350 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63338d4-f370-4d78-829e-a91fb93ab94c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:41.423015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63338d4-f370-4d78-829e-a91fb93ab94c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:41.428426 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41987dc9-3c1e-425d-977a-c2b40df228c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:41.429215 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41987dc9-3c1e-425d-977a-c2b40df228c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.429503 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41987dc9-3c1e-425d-977a-c2b40df228c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.429777 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41987dc9-3c1e-425d-977a-c2b40df228c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.430536 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41987dc9-3c1e-425d-977a-c2b40df228c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:41.432167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41987dc9-3c1e-425d-977a-c2b40df228c3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.446006 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1239/2468] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:36:41.452300 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8164076-f2a3-45e3-b3dc-3339cd5fca9a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:41.470124 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8164076-f2a3-45e3-b3dc-3339cd5fca9a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:41.478374 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b69b9-c844-445a-a342-948e8a8b219a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:41.484944 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b69b9-c844-445a-a342-948e8a8b219a admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.485545 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b69b9-c844-445a-a342-948e8a8b219a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.486037 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b69b9-c844-445a-a342-948e8a8b219a admin admin] PATH_INFO: `/v3/projects/6ea52d1c47ff445db52dce61d2942474/users/285df9332214454d989774c83082744d/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.507687 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b69b9-c844-445a-a342-948e8a8b219a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ea52d1c47ff445db52dce61d2942474, user_id=285df9332214454d989774c83082744d, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:41.511099 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b69b9-c844-445a-a342-948e8a8b219a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.535177 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1230/2469] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:36:41 2022] PUT /identity/v3/projects/6ea52d1c47ff445db52dce61d2942474/users/285df9332214454d989774c83082744d/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:41.547224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a381e0-41a9-484d-b736-b98df0232b9e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.547562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a381e0-41a9-484d-b736-b98df0232b9e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.547844 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a381e0-41a9-484d-b736-b98df0232b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.643823 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-17a381e0-41a9-484d-b736-b98df0232b9e None None] MFA Rules not processed for user `285df9332214454d989774c83082744d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:41.647142 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-17a381e0-41a9-484d-b736-b98df0232b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:41.741242 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1240/2470] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:36:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:36:41.752532 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b69b9-c844-445a-a342-948e8a8b219a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:41.754268 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5d9b69b9-c844-445a-a342-948e8a8b219a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:41.815612 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b69b9-c844-445a-a342-948e8a8b219a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:41.819868 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b941af-f563-4fab-907d-87d7627d1547 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:41.820528 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b941af-f563-4fab-907d-87d7627d1547 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.820855 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b941af-f563-4fab-907d-87d7627d1547 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.821133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b941af-f563-4fab-907d-87d7627d1547 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.835889 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b941af-f563-4fab-907d-87d7627d1547 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:41.837457 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b941af-f563-4fab-907d-87d7627d1547 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.848334 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1231/2471] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:36:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:36:42.354201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a381e0-41a9-484d-b736-b98df0232b9e None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:42.355739 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-17a381e0-41a9-484d-b736-b98df0232b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:42.419310 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:42.425044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a381e0-41a9-484d-b736-b98df0232b9e None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:42.430356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474405d-c9b0-4600-a46b-476f5bf3d838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:42.430989 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474405d-c9b0-4600-a46b-476f5bf3d838 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:42.431271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474405d-c9b0-4600-a46b-476f5bf3d838 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:42.431543 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474405d-c9b0-4600-a46b-476f5bf3d838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:42.433515 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6474405d-c9b0-4600-a46b-476f5bf3d838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:42.444285 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474405d-c9b0-4600-a46b-476f5bf3d838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:42.445819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474405d-c9b0-4600-a46b-476f5bf3d838 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:42.454077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1241/2472] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:36:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:36:43.131917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b941af-f563-4fab-907d-87d7627d1547 service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:43.133587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-97b941af-f563-4fab-907d-87d7627d1547 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:43.140268 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:43.222951 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b941af-f563-4fab-907d-87d7627d1547 service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:43.229089 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c8bf4-3f56-4922-9275-d51fc17d67cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:43.229728 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c8bf4-3f56-4922-9275-d51fc17d67cc service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:43.230011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c8bf4-3f56-4922-9275-d51fc17d67cc service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:43.230288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c8bf4-3f56-4922-9275-d51fc17d67cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:43.232090 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d50c8bf4-3f56-4922-9275-d51fc17d67cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:43.254547 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c8bf4-3f56-4922-9275-d51fc17d67cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:43.256481 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c8bf4-3f56-4922-9275-d51fc17d67cc service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:43.269194 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1232/2473] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:36:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:36:50.659882 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474405d-c9b0-4600-a46b-476f5bf3d838 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:50.723567 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474405d-c9b0-4600-a46b-476f5bf3d838 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:50.728096 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ad23e-0905-4840-8a88-adf246cf9f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:50.728758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ad23e-0905-4840-8a88-adf246cf9f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:50.729045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ad23e-0905-4840-8a88-adf246cf9f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:50.729325 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ad23e-0905-4840-8a88-adf246cf9f9e admin admin] PATH_INFO: `/v3/users/285df9332214454d989774c83082744d` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:50.730482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ad23e-0905-4840-8a88-adf246cf9f9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=285df9332214454d989774c83082744d)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:50.732412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ad23e-0905-4840-8a88-adf246cf9f9e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:50.781797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-227ad23e-0905-4840-8a88-adf246cf9f9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '285df9332214454d989774c83082744d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:50.782484 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-227ad23e-0905-4840-8a88-adf246cf9f9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '285df9332214454d989774c83082744d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:50.789843 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-227ad23e-0905-4840-8a88-adf246cf9f9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '285df9332214454d989774c83082744d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:50.790487 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-227ad23e-0905-4840-8a88-adf246cf9f9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '285df9332214454d989774c83082744d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:50.802922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-227ad23e-0905-4840-8a88-adf246cf9f9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '285df9332214454d989774c83082744d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:50.815511 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1242/2474] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:36:50 2022] DELETE /identity/v3/users/285df9332214454d989774c83082744d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:50.819997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740fe95-a6a0-401e-ba35-9b1bacb2c6fc None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:50.820481 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740fe95-a6a0-401e-ba35-9b1bacb2c6fc None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:50.820592 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740fe95-a6a0-401e-ba35-9b1bacb2c6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:50.841226 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-c740fe95-a6a0-401e-ba35-9b1bacb2c6fc None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:50.843441 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c740fe95-a6a0-401e-ba35-9b1bacb2c6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:50.908988 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1233/2475] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:36:50.919274 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ad23e-0905-4840-8a88-adf246cf9f9e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:50.921381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-227ad23e-0905-4840-8a88-adf246cf9f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:50.979282 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ad23e-0905-4840-8a88-adf246cf9f9e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:50.983749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a9c68-bcfb-4565-b434-3a1c8f7f83cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:50.984364 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a9c68-bcfb-4565-b434-3a1c8f7f83cd service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:50.984648 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a9c68-bcfb-4565-b434-3a1c8f7f83cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:50.984959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a9c68-bcfb-4565-b434-3a1c8f7f83cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:50.994695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a9c68-bcfb-4565-b434-3a1c8f7f83cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:50.996441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a9c68-bcfb-4565-b434-3a1c8f7f83cd service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:51.008221 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1243/2476] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:36:51.345188 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740fe95-a6a0-401e-ba35-9b1bacb2c6fc None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:51.346989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c740fe95-a6a0-401e-ba35-9b1bacb2c6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:51.359962 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740fe95-a6a0-401e-ba35-9b1bacb2c6fc None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:51.365553 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cccf25-9de7-4a7a-90f0-9f7eda313d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:51.367078 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cccf25-9de7-4a7a-90f0-9f7eda313d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.367420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cccf25-9de7-4a7a-90f0-9f7eda313d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.367942 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cccf25-9de7-4a7a-90f0-9f7eda313d64 admin admin] PATH_INFO: `/v3/projects/6ea52d1c47ff445db52dce61d2942474` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.370016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cccf25-9de7-4a7a-90f0-9f7eda313d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ea52d1c47ff445db52dce61d2942474)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:51.373331 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cccf25-9de7-4a7a-90f0-9f7eda313d64 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:51.423725 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c0cccf25-9de7-4a7a-90f0-9f7eda313d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ea52d1c47ff445db52dce61d2942474', 'request_id': 'req-c0cccf25-9de7-4a7a-90f0-9f7eda313d64'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:51.429429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c0cccf25-9de7-4a7a-90f0-9f7eda313d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ea52d1c47ff445db52dce61d2942474', 'request_id': 'req-c0cccf25-9de7-4a7a-90f0-9f7eda313d64'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:51.435848 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c0cccf25-9de7-4a7a-90f0-9f7eda313d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ea52d1c47ff445db52dce61d2942474', 'request_id': 'req-c0cccf25-9de7-4a7a-90f0-9f7eda313d64'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:51.448395 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c0cccf25-9de7-4a7a-90f0-9f7eda313d64 admin admin] The token cache is being invalidate because project 6ea52d1c47ff445db52dce61d2942474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:36:51.448708 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c0cccf25-9de7-4a7a-90f0-9f7eda313d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:51.449348 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c0cccf25-9de7-4a7a-90f0-9f7eda313d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:36:51.450838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1234/2477] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:36:51 2022] DELETE /identity/v3/projects/6ea52d1c47ff445db52dce61d2942474 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:51.457167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26606ead-4e9a-4132-ba44-30924f640895 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.457457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26606ead-4e9a-4132-ba44-30924f640895 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.457738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26606ead-4e9a-4132-ba44-30924f640895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.479904 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-26606ead-4e9a-4132-ba44-30924f640895 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:51.481164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-26606ead-4e9a-4132-ba44-30924f640895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:51.490944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:51.543650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1244/2478] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:36:51.553594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf432e-0a57-4f3c-b9f7-1ea4efc2b93d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.553893 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf432e-0a57-4f3c-b9f7-1ea4efc2b93d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.554206 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf432e-0a57-4f3c-b9f7-1ea4efc2b93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.575814 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-c6cf432e-0a57-4f3c-b9f7-1ea4efc2b93d None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:51.577291 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c6cf432e-0a57-4f3c-b9f7-1ea4efc2b93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:51.585212 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1235/2479] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:36:51.589615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26606ead-4e9a-4132-ba44-30924f640895 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:51.599397 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26606ead-4e9a-4132-ba44-30924f640895 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:51.603934 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38efec-83fd-4a71-8894-f8e89c4a27f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:51.604532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38efec-83fd-4a71-8894-f8e89c4a27f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.604840 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38efec-83fd-4a71-8894-f8e89c4a27f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.605119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38efec-83fd-4a71-8894-f8e89c4a27f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.605763 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38efec-83fd-4a71-8894-f8e89c4a27f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:51.606078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38efec-83fd-4a71-8894-f8e89c4a27f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:51.608191 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38efec-83fd-4a71-8894-f8e89c4a27f2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:51.619673 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1245/2480] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:51.624985 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf432e-0a57-4f3c-b9f7-1ea4efc2b93d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:51.630712 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:51.634718 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf432e-0a57-4f3c-b9f7-1ea4efc2b93d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:51.640594 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2600bf-de0f-4d9f-81ce-1c72b3050523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:51.641324 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2600bf-de0f-4d9f-81ce-1c72b3050523 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.641824 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2600bf-de0f-4d9f-81ce-1c72b3050523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.642133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2600bf-de0f-4d9f-81ce-1c72b3050523 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.642967 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2600bf-de0f-4d9f-81ce-1c72b3050523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:51.645175 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2600bf-de0f-4d9f-81ce-1c72b3050523 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:51.673248 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1236/2481] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:36:51 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:51.677657 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38efec-83fd-4a71-8894-f8e89c4a27f2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:51.688047 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38efec-83fd-4a71-8894-f8e89c4a27f2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:51.746684 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0b7ec-60b1-494a-afef-66ae5f6913c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:51.747293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0b7ec-60b1-494a-afef-66ae5f6913c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.747580 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0b7ec-60b1-494a-afef-66ae5f6913c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.747857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0b7ec-60b1-494a-afef-66ae5f6913c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.748531 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0b7ec-60b1-494a-afef-66ae5f6913c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:51.750649 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0b7ec-60b1-494a-afef-66ae5f6913c6 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:51.770852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1246/2482] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:36:51 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:36:51.774976 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2600bf-de0f-4d9f-81ce-1c72b3050523 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:51.785918 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2600bf-de0f-4d9f-81ce-1c72b3050523 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:51.790570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844484c-c06f-4759-93e4-10bd96dc0ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:51.791171 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844484c-c06f-4759-93e4-10bd96dc0ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.791453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844484c-c06f-4759-93e4-10bd96dc0ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.791729 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844484c-c06f-4759-93e4-10bd96dc0ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.792369 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844484c-c06f-4759-93e4-10bd96dc0ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:51.794034 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844484c-c06f-4759-93e4-10bd96dc0ec4 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:51.805057 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1237/2483] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:36:51.808935 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0b7ec-60b1-494a-afef-66ae5f6913c6 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:51.819356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0b7ec-60b1-494a-afef-66ae5f6913c6 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:51.824292 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b6179-4e11-4f5a-8687-dbf51d925413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:51.825367 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b6179-4e11-4f5a-8687-dbf51d925413 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.825690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b6179-4e11-4f5a-8687-dbf51d925413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.825969 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b6179-4e11-4f5a-8687-dbf51d925413 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.826658 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b6179-4e11-4f5a-8687-dbf51d925413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:51.828392 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b6179-4e11-4f5a-8687-dbf51d925413 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:51.844531 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1247/2484] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:36:51.848756 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844484c-c06f-4759-93e4-10bd96dc0ec4 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:51.859629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844484c-c06f-4759-93e4-10bd96dc0ec4 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:51.864204 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01814e5-1787-44c6-8acd-3c951c71bfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:51.864893 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01814e5-1787-44c6-8acd-3c951c71bfa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.865185 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01814e5-1787-44c6-8acd-3c951c71bfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.865599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01814e5-1787-44c6-8acd-3c951c71bfa9 admin admin] PATH_INFO: `/v3/projects/205196c794c846baadee973582518d31/users/c55dd3af9e074d95848ea0fbd92112fc/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.880175 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01814e5-1787-44c6-8acd-3c951c71bfa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=205196c794c846baadee973582518d31, user_id=c55dd3af9e074d95848ea0fbd92112fc, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:51.882872 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01814e5-1787-44c6-8acd-3c951c71bfa9 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:51.895746 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1238/2485] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:36:51 2022] PUT /identity/v3/projects/205196c794c846baadee973582518d31/users/c55dd3af9e074d95848ea0fbd92112fc/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:51.906528 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b696668-97fd-44c5-98e8-2e7801c4032e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.906820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b696668-97fd-44c5-98e8-2e7801c4032e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.907101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b696668-97fd-44c5-98e8-2e7801c4032e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.934709 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0b696668-97fd-44c5-98e8-2e7801c4032e None None] MFA Rules not processed for user `c55dd3af9e074d95848ea0fbd92112fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:51.935938 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0b696668-97fd-44c5-98e8-2e7801c4032e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:52.003821 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1248/2486] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:36:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:36:52.008769 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01814e5-1787-44c6-8acd-3c951c71bfa9 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:52.073693 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01814e5-1787-44c6-8acd-3c951c71bfa9 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:52.079362 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57110ee3-0f9f-427f-8b4a-b63cfbceb693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:52.079982 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57110ee3-0f9f-427f-8b4a-b63cfbceb693 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:52.080267 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57110ee3-0f9f-427f-8b4a-b63cfbceb693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:52.080546 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57110ee3-0f9f-427f-8b4a-b63cfbceb693 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.081254 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57110ee3-0f9f-427f-8b4a-b63cfbceb693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:52.083243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57110ee3-0f9f-427f-8b4a-b63cfbceb693 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:52.113843 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1239/2487] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:36:52 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:52.117917 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b696668-97fd-44c5-98e8-2e7801c4032e None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:52.129403 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b696668-97fd-44c5-98e8-2e7801c4032e None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:52.134224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:52.190246 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aba815-0a23-4a00-8a5c-c6c6c479aeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:52.191017 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aba815-0a23-4a00-8a5c-c6c6c479aeec admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:52.191377 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aba815-0a23-4a00-8a5c-c6c6c479aeec admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:52.191751 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aba815-0a23-4a00-8a5c-c6c6c479aeec admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.192489 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aba815-0a23-4a00-8a5c-c6c6c479aeec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:52.194887 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aba815-0a23-4a00-8a5c-c6c6c479aeec admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:52.221246 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1249/2488] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:36:52 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:52.225269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57110ee3-0f9f-427f-8b4a-b63cfbceb693 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:52.236113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57110ee3-0f9f-427f-8b4a-b63cfbceb693 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:52.240763 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec10678-4971-4035-b2e2-682e9633c1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:52.241385 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec10678-4971-4035-b2e2-682e9633c1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:52.241663 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec10678-4971-4035-b2e2-682e9633c1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:52.241940 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec10678-4971-4035-b2e2-682e9633c1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.242583 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec10678-4971-4035-b2e2-682e9633c1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:52.244194 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec10678-4971-4035-b2e2-682e9633c1f0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:52.256152 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1240/2489] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:36:52.260402 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aba815-0a23-4a00-8a5c-c6c6c479aeec admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:52.270941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aba815-0a23-4a00-8a5c-c6c6c479aeec admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:52.275592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e8fff-8099-4f84-9c26-68338ff72f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:52.276262 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e8fff-8099-4f84-9c26-68338ff72f1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:52.276545 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e8fff-8099-4f84-9c26-68338ff72f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:52.276875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e8fff-8099-4f84-9c26-68338ff72f1f admin admin] PATH_INFO: `/v3/projects/de344be7af934cf0bbe99c5091c28cce/users/95f2107ad2e14b4eb50b6bbea15a2072/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.293586 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e8fff-8099-4f84-9c26-68338ff72f1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=de344be7af934cf0bbe99c5091c28cce, user_id=95f2107ad2e14b4eb50b6bbea15a2072, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:52.296401 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e8fff-8099-4f84-9c26-68338ff72f1f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:52.314959 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1250/2490] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:36:52 2022] PUT /identity/v3/projects/de344be7af934cf0bbe99c5091c28cce/users/95f2107ad2e14b4eb50b6bbea15a2072/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:52.319182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec10678-4971-4035-b2e2-682e9633c1f0 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:52.330804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec10678-4971-4035-b2e2-682e9633c1f0 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:52.397182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e21789-e903-4ec6-9eb7-3a54681b12ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:52.397819 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e21789-e903-4ec6-9eb7-3a54681b12ee admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:52.398106 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e21789-e903-4ec6-9eb7-3a54681b12ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:52.398417 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e21789-e903-4ec6-9eb7-3a54681b12ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.399132 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e21789-e903-4ec6-9eb7-3a54681b12ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:52.401023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e21789-e903-4ec6-9eb7-3a54681b12ee admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:52.412698 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1241/2491] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:36:52.416751 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e8fff-8099-4f84-9c26-68338ff72f1f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:52.427733 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e8fff-8099-4f84-9c26-68338ff72f1f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:52.433057 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b90d5-1c06-4156-b363-e6314c0da62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:52.433733 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b90d5-1c06-4156-b363-e6314c0da62d admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:52.434018 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b90d5-1c06-4156-b363-e6314c0da62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:52.434299 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b90d5-1c06-4156-b363-e6314c0da62d admin admin] PATH_INFO: `/v3/projects/de344be7af934cf0bbe99c5091c28cce/users/95f2107ad2e14b4eb50b6bbea15a2072/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.436883 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b90d5-1c06-4156-b363-e6314c0da62d admin admin] RBAC: Authorizing `identity:create_grant(project_id=de344be7af934cf0bbe99c5091c28cce, user_id=95f2107ad2e14b4eb50b6bbea15a2072, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:52.439737 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b90d5-1c06-4156-b363-e6314c0da62d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:52.452786 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1251/2492] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:36:52 2022] PUT /identity/v3/projects/de344be7af934cf0bbe99c5091c28cce/users/95f2107ad2e14b4eb50b6bbea15a2072/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:52.463378 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ca334-4a4f-467f-89f3-993fdccb3da7 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:52.463677 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ca334-4a4f-467f-89f3-993fdccb3da7 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:52.463959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ca334-4a4f-467f-89f3-993fdccb3da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.497670 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-466ca334-4a4f-467f-89f3-993fdccb3da7 None None] MFA Rules not processed for user `95f2107ad2e14b4eb50b6bbea15a2072`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:52.501660 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-466ca334-4a4f-467f-89f3-993fdccb3da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:52.507484 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:52.574202 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1242/2493] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:36:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:36:52.585939 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b90d5-1c06-4156-b363-e6314c0da62d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:52.587682 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ff9b90d5-1c06-4156-b363-e6314c0da62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:52.647050 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b90d5-1c06-4156-b363-e6314c0da62d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:52.650627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f674b05-2420-47ed-bfdc-ff7d7104d0d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:52.651244 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f674b05-2420-47ed-bfdc-ff7d7104d0d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:52.651527 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f674b05-2420-47ed-bfdc-ff7d7104d0d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:52.651800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f674b05-2420-47ed-bfdc-ff7d7104d0d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.710483 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f674b05-2420-47ed-bfdc-ff7d7104d0d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:52.712230 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f674b05-2420-47ed-bfdc-ff7d7104d0d2 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:52.722548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1252/2494] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:36:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:36:55.233657 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a72433-3003-45f3-8f3a-5a51c3b06da5 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:55.234380 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a72433-3003-45f3-8f3a-5a51c3b06da5 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:55.234380 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a72433-3003-45f3-8f3a-5a51c3b06da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:55.260074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-03a72433-3003-45f3-8f3a-5a51c3b06da5 None None] MFA Rules not processed for user `e9ffc48d1f6d49f49d00d1c2e762b987`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:55.261860 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-03a72433-3003-45f3-8f3a-5a51c3b06da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:55.352595 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1243/2495] 10.222.0.96 () {58 vars in 1009 bytes} [Wed Aug 24 04:36:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:36:55.354741 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f674b05-2420-47ed-bfdc-ff7d7104d0d2 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:55.369464 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f674b05-2420-47ed-bfdc-ff7d7104d0d2 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:55.374863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d389a-1c1a-4818-ad0c-2e35f3e0b0fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:55.375601 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d389a-1c1a-4818-ad0c-2e35f3e0b0fa service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:55.376093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d389a-1c1a-4818-ad0c-2e35f3e0b0fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:55.376402 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d389a-1c1a-4818-ad0c-2e35f3e0b0fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:55.394256 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d389a-1c1a-4818-ad0c-2e35f3e0b0fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:55.396172 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d389a-1c1a-4818-ad0c-2e35f3e0b0fa service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:55.409561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1253/2496] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:36:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:36:55.419285 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a72433-3003-45f3-8f3a-5a51c3b06da5 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:55.422238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-03a72433-3003-45f3-8f3a-5a51c3b06da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:55.538216 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a72433-3003-45f3-8f3a-5a51c3b06da5 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:55.547181 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368fc85-0302-4a3d-b303-070f502806a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953d2dbd5e7d435f9148fd043b4ce7a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:55.548538 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368fc85-0302-4a3d-b303-070f502806a8 service swift] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:55.548660 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368fc85-0302-4a3d-b303-070f502806a8 service swift] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:55.550093 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368fc85-0302-4a3d-b303-070f502806a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:55.558410 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368fc85-0302-4a3d-b303-070f502806a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:55.560202 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368fc85-0302-4a3d-b303-070f502806a8 service swift] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:55.570352 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1244/2497] 10.222.0.96 () {60 vars in 1384 bytes} [Wed Aug 24 04:36:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:36:57.286584 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d389a-1c1a-4818-ad0c-2e35f3e0b0fa service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:57.288545 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ca8d389a-1c1a-4818-ad0c-2e35f3e0b0fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:57.295994 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:57.413698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d389a-1c1a-4818-ad0c-2e35f3e0b0fa service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:57.419299 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b9431-45a2-4dc6-80e3-c77cbd250f49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:57.419927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b9431-45a2-4dc6-80e3-c77cbd250f49 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:57.420248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b9431-45a2-4dc6-80e3-c77cbd250f49 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:57.420527 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b9431-45a2-4dc6-80e3-c77cbd250f49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:57.422540 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6b1b9431-45a2-4dc6-80e3-c77cbd250f49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:57.438865 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b9431-45a2-4dc6-80e3-c77cbd250f49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:57.440577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b9431-45a2-4dc6-80e3-c77cbd250f49 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:57.456343 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1254/2498] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:36:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:37:05.566387 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=83 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:07.450358 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=33 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:08.713289 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368fc85-0302-4a3d-b303-070f502806a8 service swift] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:08.791639 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368fc85-0302-4a3d-b303-070f502806a8 service swift] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:08.796332 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c67e9-6d98-49b9-8c8d-4007bc935c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:08.797009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c67e9-6d98-49b9-8c8d-4007bc935c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:08.797298 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c67e9-6d98-49b9-8c8d-4007bc935c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:08.797601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c67e9-6d98-49b9-8c8d-4007bc935c3f admin admin] PATH_INFO: `/v3/users/c55dd3af9e074d95848ea0fbd92112fc` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:08.799269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c67e9-6d98-49b9-8c8d-4007bc935c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c55dd3af9e074d95848ea0fbd92112fc)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:08.801305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c67e9-6d98-49b9-8c8d-4007bc935c3f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:08.870971 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5f2c67e9-6d98-49b9-8c8d-4007bc935c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c55dd3af9e074d95848ea0fbd92112fc'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:08.871898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5f2c67e9-6d98-49b9-8c8d-4007bc935c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c55dd3af9e074d95848ea0fbd92112fc'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:08.882150 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5f2c67e9-6d98-49b9-8c8d-4007bc935c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c55dd3af9e074d95848ea0fbd92112fc'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:08.883128 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5f2c67e9-6d98-49b9-8c8d-4007bc935c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c55dd3af9e074d95848ea0fbd92112fc'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:08.893314 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5f2c67e9-6d98-49b9-8c8d-4007bc935c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c55dd3af9e074d95848ea0fbd92112fc'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:08.923332 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1245/2499] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:37:08 2022] DELETE /identity/v3/users/c55dd3af9e074d95848ea0fbd92112fc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:37:08.928002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c496d5b-4bde-442a-98a5-4e2e2f9de7a8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:08.928516 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c496d5b-4bde-442a-98a5-4e2e2f9de7a8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:08.928516 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c496d5b-4bde-442a-98a5-4e2e2f9de7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:08.947373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6c496d5b-4bde-442a-98a5-4e2e2f9de7a8 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:08.948653 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6c496d5b-4bde-442a-98a5-4e2e2f9de7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:09.023887 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1255/2500] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:37:09.034638 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c67e9-6d98-49b9-8c8d-4007bc935c3f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:09.036174 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5f2c67e9-6d98-49b9-8c8d-4007bc935c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:09.104566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c67e9-6d98-49b9-8c8d-4007bc935c3f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:09.108488 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1cb08-90a5-4ec8-a3cd-987cfe44edb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:09.109249 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1cb08-90a5-4ec8-a3cd-987cfe44edb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:09.109500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1cb08-90a5-4ec8-a3cd-987cfe44edb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:09.109718 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1cb08-90a5-4ec8-a3cd-987cfe44edb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:09.121696 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1cb08-90a5-4ec8-a3cd-987cfe44edb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:09.123149 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1cb08-90a5-4ec8-a3cd-987cfe44edb3 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:09.138231 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1246/2501] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:37:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:37:09.487526 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c496d5b-4bde-442a-98a5-4e2e2f9de7a8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:09.490619 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6c496d5b-4bde-442a-98a5-4e2e2f9de7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:09.505940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c496d5b-4bde-442a-98a5-4e2e2f9de7a8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:09.510726 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701c898-47ca-4de2-bcf2-8120faeb09bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:09.511372 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701c898-47ca-4de2-bcf2-8120faeb09bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:09.511653 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701c898-47ca-4de2-bcf2-8120faeb09bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:09.511929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701c898-47ca-4de2-bcf2-8120faeb09bf admin admin] PATH_INFO: `/v3/projects/205196c794c846baadee973582518d31` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:09.513964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701c898-47ca-4de2-bcf2-8120faeb09bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=205196c794c846baadee973582518d31)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:09.515574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701c898-47ca-4de2-bcf2-8120faeb09bf admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:09.592018 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c701c898-47ca-4de2-bcf2-8120faeb09bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '205196c794c846baadee973582518d31', 'request_id': 'req-c701c898-47ca-4de2-bcf2-8120faeb09bf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:09.602659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c701c898-47ca-4de2-bcf2-8120faeb09bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '205196c794c846baadee973582518d31', 'request_id': 'req-c701c898-47ca-4de2-bcf2-8120faeb09bf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:09.614667 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c701c898-47ca-4de2-bcf2-8120faeb09bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '205196c794c846baadee973582518d31', 'request_id': 'req-c701c898-47ca-4de2-bcf2-8120faeb09bf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:09.629467 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c701c898-47ca-4de2-bcf2-8120faeb09bf admin admin] The token cache is being invalidate because project 205196c794c846baadee973582518d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:37:09.629777 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c701c898-47ca-4de2-bcf2-8120faeb09bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:09.630916 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c701c898-47ca-4de2-bcf2-8120faeb09bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:09.633147 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1256/2502] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:37:09 2022] DELETE /identity/v3/projects/205196c794c846baadee973582518d31 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:37:09.638055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1cb08-90a5-4ec8-a3cd-987cfe44edb3 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:09.655936 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1cb08-90a5-4ec8-a3cd-987cfe44edb3 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:09.683365 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:09.741832 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215ea39-9176-45fb-81ac-ec782a80975e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:09.742488 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215ea39-9176-45fb-81ac-ec782a80975e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:09.742775 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215ea39-9176-45fb-81ac-ec782a80975e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:09.743061 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215ea39-9176-45fb-81ac-ec782a80975e admin admin] PATH_INFO: `/v3/users/95f2107ad2e14b4eb50b6bbea15a2072` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:09.744226 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215ea39-9176-45fb-81ac-ec782a80975e admin admin] RBAC: Authorizing `identity:delete_user(user_id=95f2107ad2e14b4eb50b6bbea15a2072)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:09.746205 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215ea39-9176-45fb-81ac-ec782a80975e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:09.806080 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0215ea39-9176-45fb-81ac-ec782a80975e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95f2107ad2e14b4eb50b6bbea15a2072'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:09.806808 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0215ea39-9176-45fb-81ac-ec782a80975e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95f2107ad2e14b4eb50b6bbea15a2072'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:09.815539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0215ea39-9176-45fb-81ac-ec782a80975e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95f2107ad2e14b4eb50b6bbea15a2072'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:09.817882 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0215ea39-9176-45fb-81ac-ec782a80975e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95f2107ad2e14b4eb50b6bbea15a2072'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:09.826830 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-0215ea39-9176-45fb-81ac-ec782a80975e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95f2107ad2e14b4eb50b6bbea15a2072'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:09.852178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1247/2503] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:37:09 2022] DELETE /identity/v3/users/95f2107ad2e14b4eb50b6bbea15a2072 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:37:10.181567 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701c898-47ca-4de2-bcf2-8120faeb09bf admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:10.183334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c701c898-47ca-4de2-bcf2-8120faeb09bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:10.203613 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701c898-47ca-4de2-bcf2-8120faeb09bf admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:10.279443 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3561b9-6c39-4913-a77d-bb70925c3e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:10.280091 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3561b9-6c39-4913-a77d-bb70925c3e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:10.280373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3561b9-6c39-4913-a77d-bb70925c3e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:10.280648 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3561b9-6c39-4913-a77d-bb70925c3e6f admin admin] PATH_INFO: `/v3/projects/de344be7af934cf0bbe99c5091c28cce` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:10.281811 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3561b9-6c39-4913-a77d-bb70925c3e6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=de344be7af934cf0bbe99c5091c28cce)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:10.284328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3561b9-6c39-4913-a77d-bb70925c3e6f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:10.316115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:10.336053 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ee3561b9-6c39-4913-a77d-bb70925c3e6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de344be7af934cf0bbe99c5091c28cce', 'request_id': 'req-ee3561b9-6c39-4913-a77d-bb70925c3e6f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:10.344198 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ee3561b9-6c39-4913-a77d-bb70925c3e6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de344be7af934cf0bbe99c5091c28cce', 'request_id': 'req-ee3561b9-6c39-4913-a77d-bb70925c3e6f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:10.350092 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ee3561b9-6c39-4913-a77d-bb70925c3e6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de344be7af934cf0bbe99c5091c28cce', 'request_id': 'req-ee3561b9-6c39-4913-a77d-bb70925c3e6f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:10.362197 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ee3561b9-6c39-4913-a77d-bb70925c3e6f admin admin] The token cache is being invalidate because project de344be7af934cf0bbe99c5091c28cce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:37:10.362479 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ee3561b9-6c39-4913-a77d-bb70925c3e6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:10.363167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ee3561b9-6c39-4913-a77d-bb70925c3e6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:10.364738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1257/2504] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:37:10 2022] DELETE /identity/v3/projects/de344be7af934cf0bbe99c5091c28cce => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:37:10.370602 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2c80c-af67-465a-b9d0-e4133cf49a37 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:10.370885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2c80c-af67-465a-b9d0-e4133cf49a37 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:10.371225 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2c80c-af67-465a-b9d0-e4133cf49a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:10.392551 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-cec2c80c-af67-465a-b9d0-e4133cf49a37 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:10.393826 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cec2c80c-af67-465a-b9d0-e4133cf49a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:10.455492 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1248/2505] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:37:10.463855 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92a2fe-7d69-4d30-99ef-9fd180727aa1 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:10.464142 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92a2fe-7d69-4d30-99ef-9fd180727aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:10.464702 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92a2fe-7d69-4d30-99ef-9fd180727aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:10.485965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6f92a2fe-7d69-4d30-99ef-9fd180727aa1 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:10.487237 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6f92a2fe-7d69-4d30-99ef-9fd180727aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:10.495492 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1258/2506] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:37:10.499744 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2c80c-af67-465a-b9d0-e4133cf49a37 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:10.511380 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2c80c-af67-465a-b9d0-e4133cf49a37 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:10.516307 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc1fa0-267e-45b5-8682-1c60c3b30649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:10.517749 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc1fa0-267e-45b5-8682-1c60c3b30649 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:10.518152 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc1fa0-267e-45b5-8682-1c60c3b30649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:10.518439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc1fa0-267e-45b5-8682-1c60c3b30649 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:10.519161 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc1fa0-267e-45b5-8682-1c60c3b30649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:10.519639 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc1fa0-267e-45b5-8682-1c60c3b30649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:10.521346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc1fa0-267e-45b5-8682-1c60c3b30649 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:10.537497 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1249/2507] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:10.538595 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92a2fe-7d69-4d30-99ef-9fd180727aa1 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:10.548537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92a2fe-7d69-4d30-99ef-9fd180727aa1 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:10.553292 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ae951-c81b-4c92-ad85-4a3c97871566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:10.553916 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ae951-c81b-4c92-ad85-4a3c97871566 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:10.554199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ae951-c81b-4c92-ad85-4a3c97871566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:10.554476 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ae951-c81b-4c92-ad85-4a3c97871566 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:10.555122 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ae951-c81b-4c92-ad85-4a3c97871566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:10.557064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ae951-c81b-4c92-ad85-4a3c97871566 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:10.586150 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1259/2508] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:37:10 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:37:10.590679 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc1fa0-267e-45b5-8682-1c60c3b30649 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:10.601826 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc1fa0-267e-45b5-8682-1c60c3b30649 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:10.630243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:10.677009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715570c-c955-426f-b38e-17e9057c89e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:10.677760 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715570c-c955-426f-b38e-17e9057c89e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:10.678110 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715570c-c955-426f-b38e-17e9057c89e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:10.678461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715570c-c955-426f-b38e-17e9057c89e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:10.679190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715570c-c955-426f-b38e-17e9057c89e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:10.681344 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715570c-c955-426f-b38e-17e9057c89e4 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:10.710202 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1250/2509] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:37:10 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:10.711594 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ae951-c81b-4c92-ad85-4a3c97871566 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:10.724218 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ae951-c81b-4c92-ad85-4a3c97871566 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:10.729182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973b067-80c0-42fa-9f1c-3c051c1546aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:10.729818 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973b067-80c0-42fa-9f1c-3c051c1546aa admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:10.730102 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973b067-80c0-42fa-9f1c-3c051c1546aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:10.730379 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973b067-80c0-42fa-9f1c-3c051c1546aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:10.731042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973b067-80c0-42fa-9f1c-3c051c1546aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:10.732666 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973b067-80c0-42fa-9f1c-3c051c1546aa admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:10.745379 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1260/2510] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:37:10.749292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715570c-c955-426f-b38e-17e9057c89e4 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:10.761307 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715570c-c955-426f-b38e-17e9057c89e4 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:10.766937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a09362-e6ba-4fa2-b038-48ddbf5251e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:10.767578 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a09362-e6ba-4fa2-b038-48ddbf5251e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:10.767877 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a09362-e6ba-4fa2-b038-48ddbf5251e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:10.768145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a09362-e6ba-4fa2-b038-48ddbf5251e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:10.768864 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a09362-e6ba-4fa2-b038-48ddbf5251e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:10.770536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a09362-e6ba-4fa2-b038-48ddbf5251e5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:10.783119 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1251/2511] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:37:10.787363 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973b067-80c0-42fa-9f1c-3c051c1546aa admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:10.799882 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973b067-80c0-42fa-9f1c-3c051c1546aa admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:10.811648 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2beee-b971-4606-bd9b-e37fd527f76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:10.812334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2beee-b971-4606-bd9b-e37fd527f76f admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:10.812619 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2beee-b971-4606-bd9b-e37fd527f76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:10.813023 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2beee-b971-4606-bd9b-e37fd527f76f admin admin] PATH_INFO: `/v3/projects/0960a3d548cd46649ea77e56a6807dca/users/c966ff027a9e41d8a49506cf9ff715fe/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:10.843445 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2beee-b971-4606-bd9b-e37fd527f76f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0960a3d548cd46649ea77e56a6807dca, user_id=c966ff027a9e41d8a49506cf9ff715fe, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:10.847259 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2beee-b971-4606-bd9b-e37fd527f76f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:10.867159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1261/2512] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:37:10 2022] PUT /identity/v3/projects/0960a3d548cd46649ea77e56a6807dca/users/c966ff027a9e41d8a49506cf9ff715fe/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:37:10.878341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc6151-397d-481a-ab14-e27519885ada None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:10.878627 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc6151-397d-481a-ab14-e27519885ada None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:10.878906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc6151-397d-481a-ab14-e27519885ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:10.910818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-68dc6151-397d-481a-ab14-e27519885ada None None] MFA Rules not processed for user `c966ff027a9e41d8a49506cf9ff715fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:10.912086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-68dc6151-397d-481a-ab14-e27519885ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:10.986436 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1252/2513] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:37:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:37:10.991055 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2beee-b971-4606-bd9b-e37fd527f76f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:11.069932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2beee-b971-4606-bd9b-e37fd527f76f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:11.074692 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568540a-5015-4405-a3b8-efd0ce20729c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:11.075468 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568540a-5015-4405-a3b8-efd0ce20729c admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:11.075759 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568540a-5015-4405-a3b8-efd0ce20729c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:11.076038 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568540a-5015-4405-a3b8-efd0ce20729c admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:11.076719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568540a-5015-4405-a3b8-efd0ce20729c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:11.078695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568540a-5015-4405-a3b8-efd0ce20729c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:11.112979 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1262/2514] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:37:10 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:11.117423 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc6151-397d-481a-ab14-e27519885ada None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:11.129777 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc6151-397d-481a-ab14-e27519885ada None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:11.196560 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1346db3-dd9c-4b6f-8456-4cbea2bd1e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:11.197372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1346db3-dd9c-4b6f-8456-4cbea2bd1e7b admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:11.198368 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1346db3-dd9c-4b6f-8456-4cbea2bd1e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:11.198660 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1346db3-dd9c-4b6f-8456-4cbea2bd1e7b admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:11.199437 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1346db3-dd9c-4b6f-8456-4cbea2bd1e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:11.201427 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1346db3-dd9c-4b6f-8456-4cbea2bd1e7b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:11.226031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1253/2515] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:37:11 2022] POST /identity/v3/users => generated 298 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:37:11.230181 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568540a-5015-4405-a3b8-efd0ce20729c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:11.240975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568540a-5015-4405-a3b8-efd0ce20729c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:11.245721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14663694-52ce-40c1-8d33-2e28783a3f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:11.246365 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14663694-52ce-40c1-8d33-2e28783a3f04 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:11.246648 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14663694-52ce-40c1-8d33-2e28783a3f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:11.246925 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14663694-52ce-40c1-8d33-2e28783a3f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:11.247602 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14663694-52ce-40c1-8d33-2e28783a3f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:11.249252 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14663694-52ce-40c1-8d33-2e28783a3f04 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:11.261581 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1263/2516] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:37:11.265859 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1346db3-dd9c-4b6f-8456-4cbea2bd1e7b admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:11.277281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1346db3-dd9c-4b6f-8456-4cbea2bd1e7b admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:11.282938 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5d3b1-c869-4532-9d85-58820d4a3383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:11.283634 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5d3b1-c869-4532-9d85-58820d4a3383 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:11.283955 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5d3b1-c869-4532-9d85-58820d4a3383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:11.284241 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5d3b1-c869-4532-9d85-58820d4a3383 admin admin] PATH_INFO: `/v3/projects/fc098a49861e401d8b7f4230e569a607/users/87e7938671544660a8ff0bacb48cd8da/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:11.305678 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5d3b1-c869-4532-9d85-58820d4a3383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc098a49861e401d8b7f4230e569a607, user_id=87e7938671544660a8ff0bacb48cd8da, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:11.308497 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5d3b1-c869-4532-9d85-58820d4a3383 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:11.329586 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1254/2517] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:37:11 2022] PUT /identity/v3/projects/fc098a49861e401d8b7f4230e569a607/users/87e7938671544660a8ff0bacb48cd8da/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:37:11.334256 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14663694-52ce-40c1-8d33-2e28783a3f04 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:11.350187 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14663694-52ce-40c1-8d33-2e28783a3f04 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:11.369584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123143f8-39f0-40ba-adad-07e66874610a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:11.369872 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123143f8-39f0-40ba-adad-07e66874610a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:11.370147 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123143f8-39f0-40ba-adad-07e66874610a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:11.373391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:11.378389 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:11.394705 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-123143f8-39f0-40ba-adad-07e66874610a None None] MFA Rules not processed for user `e9ffc48d1f6d49f49d00d1c2e762b987`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:11.395937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-123143f8-39f0-40ba-adad-07e66874610a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:11.417683 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69957a2-f417-43d0-9da4-a1eb542393ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:11.418322 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69957a2-f417-43d0-9da4-a1eb542393ed admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:11.418608 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69957a2-f417-43d0-9da4-a1eb542393ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:11.418928 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69957a2-f417-43d0-9da4-a1eb542393ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:11.419576 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69957a2-f417-43d0-9da4-a1eb542393ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:11.421471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69957a2-f417-43d0-9da4-a1eb542393ed admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:11.433597 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1264/2518] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:37:11.437564 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69957a2-f417-43d0-9da4-a1eb542393ed admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:11.448346 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69957a2-f417-43d0-9da4-a1eb542393ed admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:11.453063 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc282d60-bcc0-4f67-a2c0-294ec0831e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:11.453741 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc282d60-bcc0-4f67-a2c0-294ec0831e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:11.454024 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc282d60-bcc0-4f67-a2c0-294ec0831e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:11.454304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc282d60-bcc0-4f67-a2c0-294ec0831e6c admin admin] PATH_INFO: `/v3/projects/fc098a49861e401d8b7f4230e569a607/users/87e7938671544660a8ff0bacb48cd8da/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:11.456359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc282d60-bcc0-4f67-a2c0-294ec0831e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc098a49861e401d8b7f4230e569a607, user_id=87e7938671544660a8ff0bacb48cd8da, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:11.456932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1255/2519] 10.222.0.96 () {58 vars in 1009 bytes} [Wed Aug 24 04:37:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:37:11.459230 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc282d60-bcc0-4f67-a2c0-294ec0831e6c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:11.470187 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123143f8-39f0-40ba-adad-07e66874610a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:11.471835 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1265/2520] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:37:11 2022] PUT /identity/v3/projects/fc098a49861e401d8b7f4230e569a607/users/87e7938671544660a8ff0bacb48cd8da/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:37:11.471997 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-123143f8-39f0-40ba-adad-07e66874610a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:11.483236 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9820a-cde9-43c7-a4c6-e5b2cb80ce21 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:11.483635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9820a-cde9-43c7-a4c6-e5b2cb80ce21 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:11.483909 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9820a-cde9-43c7-a4c6-e5b2cb80ce21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:11.514464 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-33d9820a-cde9-43c7-a4c6-e5b2cb80ce21 None None] MFA Rules not processed for user `87e7938671544660a8ff0bacb48cd8da`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:11.515707 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-33d9820a-cde9-43c7-a4c6-e5b2cb80ce21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:11.547824 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123143f8-39f0-40ba-adad-07e66874610a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:11.587819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1266/2521] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:37:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:37:11.600046 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9820a-cde9-43c7-a4c6-e5b2cb80ce21 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:11.601465 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-33d9820a-cde9-43c7-a4c6-e5b2cb80ce21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:11.617858 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20206210-bb5a-4636-973e-0deffbd40632 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953d2dbd5e7d435f9148fd043b4ce7a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:11.618395 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20206210-bb5a-4636-973e-0deffbd40632 service swift] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:11.618676 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20206210-bb5a-4636-973e-0deffbd40632 service swift] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:11.618952 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20206210-bb5a-4636-973e-0deffbd40632 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:11.664399 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9820a-cde9-43c7-a4c6-e5b2cb80ce21 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:11.668705 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fde77-7466-4262-85bd-ef50b5419a42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:11.668994 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:11.669345 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fde77-7466-4262-85bd-ef50b5419a42 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:11.669901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fde77-7466-4262-85bd-ef50b5419a42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:11.669901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fde77-7466-4262-85bd-ef50b5419a42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:11.679205 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20206210-bb5a-4636-973e-0deffbd40632 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:11.680773 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20206210-bb5a-4636-973e-0deffbd40632 service swift] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:11.690601 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1256/2522] 10.222.0.96 () {60 vars in 1384 bytes} [Wed Aug 24 04:37:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 04:37:11.723745 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:11.747712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fde77-7466-4262-85bd-ef50b5419a42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:11.750161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fde77-7466-4262-85bd-ef50b5419a42 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:11.763819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1267/2523] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:37:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:37:16.382139 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20206210-bb5a-4636-973e-0deffbd40632 service swift] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:16.383591 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-20206210-bb5a-4636-973e-0deffbd40632 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:16.397935 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20206210-bb5a-4636-973e-0deffbd40632 service swift] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:16.404627 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1a519-76fd-4188-9bb7-7939ef37d9a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:16.405360 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1a519-76fd-4188-9bb7-7939ef37d9a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:16.405718 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1a519-76fd-4188-9bb7-7939ef37d9a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:16.405991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1a519-76fd-4188-9bb7-7939ef37d9a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:16.417524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1a519-76fd-4188-9bb7-7939ef37d9a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:16.419075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1a519-76fd-4188-9bb7-7939ef37d9a7 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:16.430344 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1257/2524] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:37:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:37:21.613817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fde77-7466-4262-85bd-ef50b5419a42 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:21.677234 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fde77-7466-4262-85bd-ef50b5419a42 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:21.681919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28183c-821b-458a-bef3-219389366868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:21.682549 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28183c-821b-458a-bef3-219389366868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:21.682826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28183c-821b-458a-bef3-219389366868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:21.683099 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28183c-821b-458a-bef3-219389366868 admin admin] PATH_INFO: `/v3/users/c966ff027a9e41d8a49506cf9ff715fe` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:21.684237 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28183c-821b-458a-bef3-219389366868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c966ff027a9e41d8a49506cf9ff715fe)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:21.686407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28183c-821b-458a-bef3-219389366868 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:21.734787 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-dc28183c-821b-458a-bef3-219389366868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c966ff027a9e41d8a49506cf9ff715fe'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:21.735448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-dc28183c-821b-458a-bef3-219389366868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c966ff027a9e41d8a49506cf9ff715fe'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:21.745612 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-dc28183c-821b-458a-bef3-219389366868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c966ff027a9e41d8a49506cf9ff715fe'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:21.746329 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-dc28183c-821b-458a-bef3-219389366868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c966ff027a9e41d8a49506cf9ff715fe'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:21.760478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-dc28183c-821b-458a-bef3-219389366868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c966ff027a9e41d8a49506cf9ff715fe'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:21.773212 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1268/2525] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:37:21 2022] DELETE /identity/v3/users/c966ff027a9e41d8a49506cf9ff715fe => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:37:21.777854 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721a8e4-b116-4890-96d9-e3a1a8c539a2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:21.778406 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721a8e4-b116-4890-96d9-e3a1a8c539a2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:21.778406 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721a8e4-b116-4890-96d9-e3a1a8c539a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:21.799012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-1721a8e4-b116-4890-96d9-e3a1a8c539a2 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:21.800254 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1721a8e4-b116-4890-96d9-e3a1a8c539a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:21.870055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1258/2526] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:37:21.879944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28183c-821b-458a-bef3-219389366868 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:21.881437 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-dc28183c-821b-458a-bef3-219389366868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:21.941758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28183c-821b-458a-bef3-219389366868 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:21.945429 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a42df-f7e8-4151-8dc2-d66de0d821f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:21.946041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a42df-f7e8-4151-8dc2-d66de0d821f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:21.946324 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a42df-f7e8-4151-8dc2-d66de0d821f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:21.946596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a42df-f7e8-4151-8dc2-d66de0d821f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:21.956487 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a42df-f7e8-4151-8dc2-d66de0d821f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:21.957984 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a42df-f7e8-4151-8dc2-d66de0d821f1 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:21.968378 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1269/2527] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:37:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:37:22.244712 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721a8e4-b116-4890-96d9-e3a1a8c539a2 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:22.246164 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1721a8e4-b116-4890-96d9-e3a1a8c539a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:22.259434 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721a8e4-b116-4890-96d9-e3a1a8c539a2 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:22.264675 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7801179-3825-4e9b-bdf1-37e9e5557155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:22.265372 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7801179-3825-4e9b-bdf1-37e9e5557155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:22.265639 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7801179-3825-4e9b-bdf1-37e9e5557155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:22.265915 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7801179-3825-4e9b-bdf1-37e9e5557155 admin admin] PATH_INFO: `/v3/projects/0960a3d548cd46649ea77e56a6807dca` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:22.267709 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7801179-3825-4e9b-bdf1-37e9e5557155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0960a3d548cd46649ea77e56a6807dca)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:22.269690 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7801179-3825-4e9b-bdf1-37e9e5557155 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:22.322668 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c7801179-3825-4e9b-bdf1-37e9e5557155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0960a3d548cd46649ea77e56a6807dca', 'request_id': 'req-c7801179-3825-4e9b-bdf1-37e9e5557155'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:22.328431 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c7801179-3825-4e9b-bdf1-37e9e5557155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0960a3d548cd46649ea77e56a6807dca', 'request_id': 'req-c7801179-3825-4e9b-bdf1-37e9e5557155'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:22.336227 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c7801179-3825-4e9b-bdf1-37e9e5557155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0960a3d548cd46649ea77e56a6807dca', 'request_id': 'req-c7801179-3825-4e9b-bdf1-37e9e5557155'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:22.351309 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c7801179-3825-4e9b-bdf1-37e9e5557155 admin admin] The token cache is being invalidate because project 0960a3d548cd46649ea77e56a6807dca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:37:22.351700 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c7801179-3825-4e9b-bdf1-37e9e5557155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:22.352412 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-c7801179-3825-4e9b-bdf1-37e9e5557155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:22.354017 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1259/2528] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:37:22 2022] DELETE /identity/v3/projects/0960a3d548cd46649ea77e56a6807dca => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:37:22.358225 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a42df-f7e8-4151-8dc2-d66de0d821f1 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:22.368384 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a42df-f7e8-4151-8dc2-d66de0d821f1 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:22.374294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:22.438597 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807fff7-b254-416c-93b7-57b8b7632ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:22.440221 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807fff7-b254-416c-93b7-57b8b7632ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:22.440801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807fff7-b254-416c-93b7-57b8b7632ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:22.441079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807fff7-b254-416c-93b7-57b8b7632ff7 admin admin] PATH_INFO: `/v3/users/87e7938671544660a8ff0bacb48cd8da` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:22.442409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807fff7-b254-416c-93b7-57b8b7632ff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e7938671544660a8ff0bacb48cd8da)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:22.444389 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807fff7-b254-416c-93b7-57b8b7632ff7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:22.496114 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1807fff7-b254-416c-93b7-57b8b7632ff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e7938671544660a8ff0bacb48cd8da'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:22.497137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1807fff7-b254-416c-93b7-57b8b7632ff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e7938671544660a8ff0bacb48cd8da'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:22.505969 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1807fff7-b254-416c-93b7-57b8b7632ff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e7938671544660a8ff0bacb48cd8da'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:22.506634 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1807fff7-b254-416c-93b7-57b8b7632ff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e7938671544660a8ff0bacb48cd8da'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:22.520936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-1807fff7-b254-416c-93b7-57b8b7632ff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e7938671544660a8ff0bacb48cd8da'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:22.534592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1270/2529] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:37:22 2022] DELETE /identity/v3/users/87e7938671544660a8ff0bacb48cd8da => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:37:22.819134 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7801179-3825-4e9b-bdf1-37e9e5557155 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:22.821049 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c7801179-3825-4e9b-bdf1-37e9e5557155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:22.848155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7801179-3825-4e9b-bdf1-37e9e5557155 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:22.914530 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d79219-4f09-4e02-a581-eedd3897a6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:22.915834 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d79219-4f09-4e02-a581-eedd3897a6c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:22.916127 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d79219-4f09-4e02-a581-eedd3897a6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:22.916410 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d79219-4f09-4e02-a581-eedd3897a6c3 admin admin] PATH_INFO: `/v3/projects/fc098a49861e401d8b7f4230e569a607` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:22.917690 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d79219-4f09-4e02-a581-eedd3897a6c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc098a49861e401d8b7f4230e569a607)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:22.919679 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d79219-4f09-4e02-a581-eedd3897a6c3 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:22.922766 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:22.989814 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-17d79219-4f09-4e02-a581-eedd3897a6c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc098a49861e401d8b7f4230e569a607', 'request_id': 'req-17d79219-4f09-4e02-a581-eedd3897a6c3'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:22.996816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-17d79219-4f09-4e02-a581-eedd3897a6c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc098a49861e401d8b7f4230e569a607', 'request_id': 'req-17d79219-4f09-4e02-a581-eedd3897a6c3'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:23.004912 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-17d79219-4f09-4e02-a581-eedd3897a6c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc098a49861e401d8b7f4230e569a607', 'request_id': 'req-17d79219-4f09-4e02-a581-eedd3897a6c3'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:23.020174 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-17d79219-4f09-4e02-a581-eedd3897a6c3 admin admin] The token cache is being invalidate because project fc098a49861e401d8b7f4230e569a607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:37:23.020579 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-17d79219-4f09-4e02-a581-eedd3897a6c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:23.021308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-17d79219-4f09-4e02-a581-eedd3897a6c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:23.023146 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1260/2530] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:37:22 2022] DELETE /identity/v3/projects/fc098a49861e401d8b7f4230e569a607 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:37:23.029494 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7ad2e-fe9b-4f64-8a42-7e26241730e3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:23.029964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7ad2e-fe9b-4f64-8a42-7e26241730e3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:23.030057 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7ad2e-fe9b-4f64-8a42-7e26241730e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:23.054433 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4aa7ad2e-fe9b-4f64-8a42-7e26241730e3 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:23.055774 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4aa7ad2e-fe9b-4f64-8a42-7e26241730e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:23.122545 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1271/2531] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:37:23.130986 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31606d9-0ed0-493e-94ad-d65206deb68d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:23.131281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31606d9-0ed0-493e-94ad-d65206deb68d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:23.131563 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31606d9-0ed0-493e-94ad-d65206deb68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:23.151474 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-b31606d9-0ed0-493e-94ad-d65206deb68d None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:23.152712 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b31606d9-0ed0-493e-94ad-d65206deb68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:23.161419 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1261/2532] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:37:23.165831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7ad2e-fe9b-4f64-8a42-7e26241730e3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:23.176895 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7ad2e-fe9b-4f64-8a42-7e26241730e3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:23.181758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248fabc-2ad9-4714-8141-914d27b69bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:23.182248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248fabc-2ad9-4714-8141-914d27b69bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:23.182536 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248fabc-2ad9-4714-8141-914d27b69bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:23.182812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248fabc-2ad9-4714-8141-914d27b69bc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:23.183712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248fabc-2ad9-4714-8141-914d27b69bc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:23.183830 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248fabc-2ad9-4714-8141-914d27b69bc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:23.185436 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248fabc-2ad9-4714-8141-914d27b69bc3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:23.202157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1272/2533] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:23.203287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31606d9-0ed0-493e-94ad-d65206deb68d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:23.214247 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31606d9-0ed0-493e-94ad-d65206deb68d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:23.219537 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46431790-af2f-4371-b253-cef8ef89eb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:23.220161 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46431790-af2f-4371-b253-cef8ef89eb23 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:23.220450 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46431790-af2f-4371-b253-cef8ef89eb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:23.220875 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46431790-af2f-4371-b253-cef8ef89eb23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:23.221413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46431790-af2f-4371-b253-cef8ef89eb23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:23.223363 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46431790-af2f-4371-b253-cef8ef89eb23 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:23.256059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1262/2534] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:37:23 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:23.257231 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248fabc-2ad9-4714-8141-914d27b69bc3 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:23.268600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248fabc-2ad9-4714-8141-914d27b69bc3 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:23.280492 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:23.347230 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab2f9b-3450-4e2b-a7da-c4b21a174824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:23.347863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab2f9b-3450-4e2b-a7da-c4b21a174824 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:23.348512 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab2f9b-3450-4e2b-a7da-c4b21a174824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:23.348512 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab2f9b-3450-4e2b-a7da-c4b21a174824 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:23.349182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab2f9b-3450-4e2b-a7da-c4b21a174824 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:23.351151 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab2f9b-3450-4e2b-a7da-c4b21a174824 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:23.374015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1273/2535] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:37:23 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:37:23.378939 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46431790-af2f-4371-b253-cef8ef89eb23 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:23.390620 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46431790-af2f-4371-b253-cef8ef89eb23 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:23.396744 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bfeb0-acea-4c1c-9dee-78f3b06db1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:23.397389 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bfeb0-acea-4c1c-9dee-78f3b06db1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:23.397676 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bfeb0-acea-4c1c-9dee-78f3b06db1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:23.397957 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bfeb0-acea-4c1c-9dee-78f3b06db1a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:23.398628 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bfeb0-acea-4c1c-9dee-78f3b06db1a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:23.400439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bfeb0-acea-4c1c-9dee-78f3b06db1a2 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:23.414366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1263/2536] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:37:23.415897 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab2f9b-3450-4e2b-a7da-c4b21a174824 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:23.431669 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab2f9b-3450-4e2b-a7da-c4b21a174824 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:23.436449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f2044-d3bf-44a3-a1a2-7e42f942a34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:23.437356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f2044-d3bf-44a3-a1a2-7e42f942a34d admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:23.437641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f2044-d3bf-44a3-a1a2-7e42f942a34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:23.437914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f2044-d3bf-44a3-a1a2-7e42f942a34d admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:23.438562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f2044-d3bf-44a3-a1a2-7e42f942a34d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:23.440819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f2044-d3bf-44a3-a1a2-7e42f942a34d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:23.453826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1274/2537] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:37:23.458065 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bfeb0-acea-4c1c-9dee-78f3b06db1a2 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:23.468839 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bfeb0-acea-4c1c-9dee-78f3b06db1a2 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:23.473939 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb9ff0-cf5f-40fb-9c54-2f5e84f68b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:23.474628 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb9ff0-cf5f-40fb-9c54-2f5e84f68b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:23.474909 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb9ff0-cf5f-40fb-9c54-2f5e84f68b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:23.475187 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb9ff0-cf5f-40fb-9c54-2f5e84f68b97 admin admin] PATH_INFO: `/v3/projects/13116c8b120c4da1906004ceac869fd5/users/7c1c9325eb3e46adad2ed71fd4c74f5e/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:23.492453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb9ff0-cf5f-40fb-9c54-2f5e84f68b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13116c8b120c4da1906004ceac869fd5, user_id=7c1c9325eb3e46adad2ed71fd4c74f5e, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:23.495201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb9ff0-cf5f-40fb-9c54-2f5e84f68b97 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:23.509290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1264/2538] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:37:23 2022] PUT /identity/v3/projects/13116c8b120c4da1906004ceac869fd5/users/7c1c9325eb3e46adad2ed71fd4c74f5e/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:37:23.521145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2834f9b-2463-43ec-b7f1-cc425cb4de15 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:23.521526 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2834f9b-2463-43ec-b7f1-cc425cb4de15 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:23.521806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2834f9b-2463-43ec-b7f1-cc425cb4de15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:23.551032 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f2834f9b-2463-43ec-b7f1-cc425cb4de15 None None] MFA Rules not processed for user `7c1c9325eb3e46adad2ed71fd4c74f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:23.552277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f2834f9b-2463-43ec-b7f1-cc425cb4de15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:23.621892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1275/2539] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:37:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:37:23.633191 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb9ff0-cf5f-40fb-9c54-2f5e84f68b97 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:23.634908 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e7fb9ff0-cf5f-40fb-9c54-2f5e84f68b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:23.695972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb9ff0-cf5f-40fb-9c54-2f5e84f68b97 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:23.699677 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf75cd-4ebf-45e2-b2f5-341f204183dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6106a46199b74f649cd29a0d02610049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:23.700337 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf75cd-4ebf-45e2-b2f5-341f204183dc service glance] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:23.700583 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf75cd-4ebf-45e2-b2f5-341f204183dc service glance] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:23.700888 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf75cd-4ebf-45e2-b2f5-341f204183dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:23.710779 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf75cd-4ebf-45e2-b2f5-341f204183dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:23.712290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf75cd-4ebf-45e2-b2f5-341f204183dc service glance] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:23.722560 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1265/2540] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:37:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:37:26.973496 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9ff03-82d4-4467-a2c3-9c2e464704a6 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:26.974002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9ff03-82d4-4467-a2c3-9c2e464704a6 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:26.974204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9ff03-82d4-4467-a2c3-9c2e464704a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:26.994339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4fb9ff03-82d4-4467-a2c3-9c2e464704a6 None None] MFA Rules not processed for user `e9ffc48d1f6d49f49d00d1c2e762b987`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:26.995566 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4fb9ff03-82d4-4467-a2c3-9c2e464704a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:27.056181 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1276/2541] 10.222.0.96 () {58 vars in 967 bytes} [Wed Aug 24 04:37:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:37:27.069406 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf75cd-4ebf-45e2-b2f5-341f204183dc service glance] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:27.070883 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2cdf75cd-4ebf-45e2-b2f5-341f204183dc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:27.107084 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:27.146390 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf75cd-4ebf-45e2-b2f5-341f204183dc service glance] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:27.151592 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430af799-1a16-4ce7-a12d-e7c2e4ad6c30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953d2dbd5e7d435f9148fd043b4ce7a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:27.152218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430af799-1a16-4ce7-a12d-e7c2e4ad6c30 service swift] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:27.152501 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430af799-1a16-4ce7-a12d-e7c2e4ad6c30 service swift] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:27.152807 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430af799-1a16-4ce7-a12d-e7c2e4ad6c30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:27.162501 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430af799-1a16-4ce7-a12d-e7c2e4ad6c30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:27.164096 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430af799-1a16-4ce7-a12d-e7c2e4ad6c30 service swift] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:27.172289 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1266/2542] 10.222.0.96 () {60 vars in 1384 bytes} [Wed Aug 24 04:37:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:37:37.047914 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:37.168989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=18 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:38.362817 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9ff03-82d4-4467-a2c3-9c2e464704a6 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:38.364467 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4fb9ff03-82d4-4467-a2c3-9c2e464704a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:38.441346 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9ff03-82d4-4467-a2c3-9c2e464704a6 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:38.447029 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221572d4-ca34-4bbf-9fe6-79d60d5c073e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:38.447641 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221572d4-ca34-4bbf-9fe6-79d60d5c073e service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:38.447927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221572d4-ca34-4bbf-9fe6-79d60d5c073e service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:38.448208 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221572d4-ca34-4bbf-9fe6-79d60d5c073e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:38.449966 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-221572d4-ca34-4bbf-9fe6-79d60d5c073e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:38.514270 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221572d4-ca34-4bbf-9fe6-79d60d5c073e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:38.515893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221572d4-ca34-4bbf-9fe6-79d60d5c073e service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:38.525184 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1277/2543] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:37:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:37:39.291260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430af799-1a16-4ce7-a12d-e7c2e4ad6c30 service swift] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:39.358979 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430af799-1a16-4ce7-a12d-e7c2e4ad6c30 service swift] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:39.364262 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce52f99-3843-478f-af14-77114536b65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:39.364939 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce52f99-3843-478f-af14-77114536b65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:39.365254 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce52f99-3843-478f-af14-77114536b65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:39.365535 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce52f99-3843-478f-af14-77114536b65a admin admin] PATH_INFO: `/v3/users/7c1c9325eb3e46adad2ed71fd4c74f5e` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:39.366680 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce52f99-3843-478f-af14-77114536b65a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c1c9325eb3e46adad2ed71fd4c74f5e)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:39.368613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce52f99-3843-478f-af14-77114536b65a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:39.416319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bce52f99-3843-478f-af14-77114536b65a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c1c9325eb3e46adad2ed71fd4c74f5e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:39.417000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bce52f99-3843-478f-af14-77114536b65a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c1c9325eb3e46adad2ed71fd4c74f5e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:39.425727 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bce52f99-3843-478f-af14-77114536b65a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c1c9325eb3e46adad2ed71fd4c74f5e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:39.427606 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bce52f99-3843-478f-af14-77114536b65a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c1c9325eb3e46adad2ed71fd4c74f5e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:39.434697 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bce52f99-3843-478f-af14-77114536b65a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c1c9325eb3e46adad2ed71fd4c74f5e'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:39.452651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1267/2544] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:37:39 2022] DELETE /identity/v3/users/7c1c9325eb3e46adad2ed71fd4c74f5e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:37:39.460008 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb35db-7710-4923-9dbc-0ee40f22fabd None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:39.460805 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb35db-7710-4923-9dbc-0ee40f22fabd None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:39.460805 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb35db-7710-4923-9dbc-0ee40f22fabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:39.480747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-05eb35db-7710-4923-9dbc-0ee40f22fabd None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:39.481975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-05eb35db-7710-4923-9dbc-0ee40f22fabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:39.540783 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1278/2545] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:37:39.551037 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce52f99-3843-478f-af14-77114536b65a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:39.552437 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-bce52f99-3843-478f-af14-77114536b65a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:39.610861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce52f99-3843-478f-af14-77114536b65a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:39.614625 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496e4db-9717-4484-9603-5a988d96f250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:39.615235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496e4db-9717-4484-9603-5a988d96f250 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:39.615521 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496e4db-9717-4484-9603-5a988d96f250 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:39.615826 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496e4db-9717-4484-9603-5a988d96f250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:39.625455 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496e4db-9717-4484-9603-5a988d96f250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:39.626890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496e4db-9717-4484-9603-5a988d96f250 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:39.637661 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1268/2546] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:37:39.913397 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb35db-7710-4923-9dbc-0ee40f22fabd None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:39.914866 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-05eb35db-7710-4923-9dbc-0ee40f22fabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:39.931696 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb35db-7710-4923-9dbc-0ee40f22fabd None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:39.954245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d5a07-0cdf-4468-a993-84cf98d9e547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:39.954904 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d5a07-0cdf-4468-a993-84cf98d9e547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:39.955873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d5a07-0cdf-4468-a993-84cf98d9e547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:39.956587 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d5a07-0cdf-4468-a993-84cf98d9e547 admin admin] PATH_INFO: `/v3/projects/13116c8b120c4da1906004ceac869fd5` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:39.957597 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d5a07-0cdf-4468-a993-84cf98d9e547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13116c8b120c4da1906004ceac869fd5)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:39.959591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d5a07-0cdf-4468-a993-84cf98d9e547 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:39.998831 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:40.014253 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c73d5a07-0cdf-4468-a993-84cf98d9e547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13116c8b120c4da1906004ceac869fd5', 'request_id': 'req-c73d5a07-0cdf-4468-a993-84cf98d9e547'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:40.022730 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c73d5a07-0cdf-4468-a993-84cf98d9e547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13116c8b120c4da1906004ceac869fd5', 'request_id': 'req-c73d5a07-0cdf-4468-a993-84cf98d9e547'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:40.029396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c73d5a07-0cdf-4468-a993-84cf98d9e547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13116c8b120c4da1906004ceac869fd5', 'request_id': 'req-c73d5a07-0cdf-4468-a993-84cf98d9e547'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:40.041453 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c73d5a07-0cdf-4468-a993-84cf98d9e547 admin admin] The token cache is being invalidate because project 13116c8b120c4da1906004ceac869fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:37:40.041749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c73d5a07-0cdf-4468-a993-84cf98d9e547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:40.042417 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c73d5a07-0cdf-4468-a993-84cf98d9e547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:40.043961 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1279/2547] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:37:39 2022] DELETE /identity/v3/projects/13116c8b120c4da1906004ceac869fd5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:37:40.049785 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b21a43-c0e6-47cb-9900-41c8bf5b0e0a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:40.050090 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b21a43-c0e6-47cb-9900-41c8bf5b0e0a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:40.050432 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b21a43-c0e6-47cb-9900-41c8bf5b0e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:40.077171 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-b5b21a43-c0e6-47cb-9900-41c8bf5b0e0a None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:40.078427 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b5b21a43-c0e6-47cb-9900-41c8bf5b0e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:40.100423 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:40.152454 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1269/2548] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:37:40.160934 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713ebcf-0ec0-4109-9a98-e2426de1501b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:40.161309 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713ebcf-0ec0-4109-9a98-e2426de1501b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:40.161585 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713ebcf-0ec0-4109-9a98-e2426de1501b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:40.188965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e713ebcf-0ec0-4109-9a98-e2426de1501b None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:40.190560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e713ebcf-0ec0-4109-9a98-e2426de1501b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:40.200336 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1280/2549] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:37:40.204861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b21a43-c0e6-47cb-9900-41c8bf5b0e0a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:40.224052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b21a43-c0e6-47cb-9900-41c8bf5b0e0a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:40.229550 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9202f-3de6-46e6-9ca3-e1a1ff54c030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:40.230291 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9202f-3de6-46e6-9ca3-e1a1ff54c030 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:40.230576 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9202f-3de6-46e6-9ca3-e1a1ff54c030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:40.230852 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9202f-3de6-46e6-9ca3-e1a1ff54c030 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:40.231510 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9202f-3de6-46e6-9ca3-e1a1ff54c030 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:40.231815 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9202f-3de6-46e6-9ca3-e1a1ff54c030 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:40.233513 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9202f-3de6-46e6-9ca3-e1a1ff54c030 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:40.247506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1270/2550] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:40.251821 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713ebcf-0ec0-4109-9a98-e2426de1501b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:40.262636 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713ebcf-0ec0-4109-9a98-e2426de1501b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:40.269562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed79ba9-9fcb-4230-b8ea-fec30a2a67d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:40.270338 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed79ba9-9fcb-4230-b8ea-fec30a2a67d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:40.270699 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed79ba9-9fcb-4230-b8ea-fec30a2a67d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:40.270981 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed79ba9-9fcb-4230-b8ea-fec30a2a67d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:40.271633 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed79ba9-9fcb-4230-b8ea-fec30a2a67d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:40.273639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed79ba9-9fcb-4230-b8ea-fec30a2a67d1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:40.303308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1281/2551] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:37:40 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:37:40.307648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9202f-3de6-46e6-9ca3-e1a1ff54c030 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:40.318879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9202f-3de6-46e6-9ca3-e1a1ff54c030 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:40.381235 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e74d03-c051-4f50-91ec-6a01c1b7bb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:40.381893 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e74d03-c051-4f50-91ec-6a01c1b7bb57 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:40.382185 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e74d03-c051-4f50-91ec-6a01c1b7bb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:40.382512 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e74d03-c051-4f50-91ec-6a01c1b7bb57 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:40.383148 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e74d03-c051-4f50-91ec-6a01c1b7bb57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:40.385152 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e74d03-c051-4f50-91ec-6a01c1b7bb57 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:40.408438 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1271/2552] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:37:40 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:40.412879 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed79ba9-9fcb-4230-b8ea-fec30a2a67d1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:40.423440 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed79ba9-9fcb-4230-b8ea-fec30a2a67d1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:40.428308 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75a6b4-5f4a-4faf-a657-a4a3aac2340a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:40.429010 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75a6b4-5f4a-4faf-a657-a4a3aac2340a admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:40.429296 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75a6b4-5f4a-4faf-a657-a4a3aac2340a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:40.429570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75a6b4-5f4a-4faf-a657-a4a3aac2340a admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:40.430222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75a6b4-5f4a-4faf-a657-a4a3aac2340a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:40.431833 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75a6b4-5f4a-4faf-a657-a4a3aac2340a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:40.447341 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1282/2553] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:37:40.448597 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e74d03-c051-4f50-91ec-6a01c1b7bb57 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:40.459615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e74d03-c051-4f50-91ec-6a01c1b7bb57 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:40.465279 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d0a33-5965-438a-8b0a-47dc0fcee27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:40.465929 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d0a33-5965-438a-8b0a-47dc0fcee27f admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:40.466214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d0a33-5965-438a-8b0a-47dc0fcee27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:40.466493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d0a33-5965-438a-8b0a-47dc0fcee27f admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:40.467152 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d0a33-5965-438a-8b0a-47dc0fcee27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:40.468856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d0a33-5965-438a-8b0a-47dc0fcee27f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:40.480377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1272/2554] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:37:40.484743 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75a6b4-5f4a-4faf-a657-a4a3aac2340a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:40.495953 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75a6b4-5f4a-4faf-a657-a4a3aac2340a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:40.500711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e852e0-d894-4278-acf3-0e55f3c332a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:40.501442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e852e0-d894-4278-acf3-0e55f3c332a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:40.501726 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e852e0-d894-4278-acf3-0e55f3c332a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:40.502577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e852e0-d894-4278-acf3-0e55f3c332a1 admin admin] PATH_INFO: `/v3/projects/42aa34ccc8324530be50906a4347076c/users/03df87ad17b5421f9c48ddf9d4e0eac9/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:40.519274 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e852e0-d894-4278-acf3-0e55f3c332a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42aa34ccc8324530be50906a4347076c, user_id=03df87ad17b5421f9c48ddf9d4e0eac9, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:40.522076 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e852e0-d894-4278-acf3-0e55f3c332a1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:40.536899 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1283/2555] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:37:40 2022] PUT /identity/v3/projects/42aa34ccc8324530be50906a4347076c/users/03df87ad17b5421f9c48ddf9d4e0eac9/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:37:40.547199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd8424-ee8d-443c-82f6-4664d29ac8cb None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:40.547487 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd8424-ee8d-443c-82f6-4664d29ac8cb None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:40.547769 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd8424-ee8d-443c-82f6-4664d29ac8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:40.576819 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-90cd8424-ee8d-443c-82f6-4664d29ac8cb None None] MFA Rules not processed for user `03df87ad17b5421f9c48ddf9d4e0eac9`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:40.578001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-90cd8424-ee8d-443c-82f6-4664d29ac8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:40.645750 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1273/2556] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:37:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:37:40.656302 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e852e0-d894-4278-acf3-0e55f3c332a1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:40.658155 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-78e852e0-d894-4278-acf3-0e55f3c332a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:40.716824 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e852e0-d894-4278-acf3-0e55f3c332a1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:40.720638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9834fca-d11f-4ba3-9d15-5f92723fe774 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:40.721621 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9834fca-d11f-4ba3-9d15-5f92723fe774 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:40.721964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9834fca-d11f-4ba3-9d15-5f92723fe774 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:40.722243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9834fca-d11f-4ba3-9d15-5f92723fe774 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:40.730650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9834fca-d11f-4ba3-9d15-5f92723fe774 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:40.732073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9834fca-d11f-4ba3-9d15-5f92723fe774 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:40.741677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1284/2557] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:37:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:37:43.790174 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd8424-ee8d-443c-82f6-4664d29ac8cb None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:43.809265 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:43.859904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd8424-ee8d-443c-82f6-4664d29ac8cb None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:43.864735 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a2056-0397-4365-a243-61db112ffe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:43.865491 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a2056-0397-4365-a243-61db112ffe67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:43.865781 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a2056-0397-4365-a243-61db112ffe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:43.866109 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a2056-0397-4365-a243-61db112ffe67 admin admin] PATH_INFO: `/v3/users/03df87ad17b5421f9c48ddf9d4e0eac9` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:43.867206 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a2056-0397-4365-a243-61db112ffe67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03df87ad17b5421f9c48ddf9d4e0eac9)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:43.869179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a2056-0397-4365-a243-61db112ffe67 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:43.928974 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1d6a2056-0397-4365-a243-61db112ffe67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03df87ad17b5421f9c48ddf9d4e0eac9'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:43.929684 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1d6a2056-0397-4365-a243-61db112ffe67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03df87ad17b5421f9c48ddf9d4e0eac9'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:43.937270 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1d6a2056-0397-4365-a243-61db112ffe67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03df87ad17b5421f9c48ddf9d4e0eac9'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:43.937932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1d6a2056-0397-4365-a243-61db112ffe67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03df87ad17b5421f9c48ddf9d4e0eac9'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:43.946151 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1d6a2056-0397-4365-a243-61db112ffe67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03df87ad17b5421f9c48ddf9d4e0eac9'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:43.968186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1274/2558] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:37:43 2022] DELETE /identity/v3/users/03df87ad17b5421f9c48ddf9d4e0eac9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:37:43.969927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46292e-4878-4d65-baa7-89d2f3599176 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:43.970412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46292e-4878-4d65-baa7-89d2f3599176 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:43.970657 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46292e-4878-4d65-baa7-89d2f3599176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:43.991023 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9b46292e-4878-4d65-baa7-89d2f3599176 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:43.992274 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9b46292e-4878-4d65-baa7-89d2f3599176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:44.048040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:44.058044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1285/2559] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:37:44.068523 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a2056-0397-4365-a243-61db112ffe67 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:44.070226 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1d6a2056-0397-4365-a243-61db112ffe67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:44.137033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a2056-0397-4365-a243-61db112ffe67 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:44.140834 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfcdd6-97e0-4b0e-ba8a-cd172c873cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:44.141456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfcdd6-97e0-4b0e-ba8a-cd172c873cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:44.141742 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfcdd6-97e0-4b0e-ba8a-cd172c873cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:44.142022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfcdd6-97e0-4b0e-ba8a-cd172c873cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:44.154750 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfcdd6-97e0-4b0e-ba8a-cd172c873cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:44.156510 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfcdd6-97e0-4b0e-ba8a-cd172c873cf2 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:44.168055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1275/2560] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:37:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:37:44.464526 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46292e-4878-4d65-baa7-89d2f3599176 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:44.466319 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9b46292e-4878-4d65-baa7-89d2f3599176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:44.479346 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46292e-4878-4d65-baa7-89d2f3599176 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:44.485620 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319c896-4c91-42b6-8b93-455c9ead1ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:44.486942 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319c896-4c91-42b6-8b93-455c9ead1ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:44.487293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319c896-4c91-42b6-8b93-455c9ead1ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:44.487639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319c896-4c91-42b6-8b93-455c9ead1ff7 admin admin] PATH_INFO: `/v3/projects/42aa34ccc8324530be50906a4347076c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:44.488926 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319c896-4c91-42b6-8b93-455c9ead1ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42aa34ccc8324530be50906a4347076c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:44.490864 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319c896-4c91-42b6-8b93-455c9ead1ff7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:44.545954 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6319c896-4c91-42b6-8b93-455c9ead1ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42aa34ccc8324530be50906a4347076c', 'request_id': 'req-6319c896-4c91-42b6-8b93-455c9ead1ff7'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:44.554682 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6319c896-4c91-42b6-8b93-455c9ead1ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42aa34ccc8324530be50906a4347076c', 'request_id': 'req-6319c896-4c91-42b6-8b93-455c9ead1ff7'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:44.560379 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6319c896-4c91-42b6-8b93-455c9ead1ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42aa34ccc8324530be50906a4347076c', 'request_id': 'req-6319c896-4c91-42b6-8b93-455c9ead1ff7'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:44.572138 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6319c896-4c91-42b6-8b93-455c9ead1ff7 admin admin] The token cache is being invalidate because project 42aa34ccc8324530be50906a4347076c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:37:44.572428 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6319c896-4c91-42b6-8b93-455c9ead1ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:44.573089 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6319c896-4c91-42b6-8b93-455c9ead1ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:37:44.574574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1286/2561] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:37:44 2022] DELETE /identity/v3/projects/42aa34ccc8324530be50906a4347076c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:37:44.579364 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cd4e7-7297-4d62-8aa6-01e6ca681449 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:44.579656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cd4e7-7297-4d62-8aa6-01e6ca681449 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:44.579938 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cd4e7-7297-4d62-8aa6-01e6ca681449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:44.599834 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-2f4cd4e7-7297-4d62-8aa6-01e6ca681449 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:44.601109 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2f4cd4e7-7297-4d62-8aa6-01e6ca681449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:44.635258 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:44.661751 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1276/2562] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:37:44.670714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642d03a-ed6d-41ec-8399-f9cba957d159 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:44.671010 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642d03a-ed6d-41ec-8399-f9cba957d159 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:44.671297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642d03a-ed6d-41ec-8399-f9cba957d159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:44.692407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a642d03a-ed6d-41ec-8399-f9cba957d159 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:44.693672 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a642d03a-ed6d-41ec-8399-f9cba957d159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:44.701586 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1287/2563] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:37:44.705823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4cd4e7-7297-4d62-8aa6-01e6ca681449 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:44.716152 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4cd4e7-7297-4d62-8aa6-01e6ca681449 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:44.720810 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbe771-6335-4236-ab45-6cbb53d6a0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:44.721495 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbe771-6335-4236-ab45-6cbb53d6a0ab admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:44.721891 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbe771-6335-4236-ab45-6cbb53d6a0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:44.722178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbe771-6335-4236-ab45-6cbb53d6a0ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:44.722838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbe771-6335-4236-ab45-6cbb53d6a0ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:44.723155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbe771-6335-4236-ab45-6cbb53d6a0ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:44.724822 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbe771-6335-4236-ab45-6cbb53d6a0ab admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:44.737311 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1277/2564] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:44.741566 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642d03a-ed6d-41ec-8399-f9cba957d159 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:44.750703 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642d03a-ed6d-41ec-8399-f9cba957d159 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:44.756204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af8cfa-018d-4d10-92b6-a3405bebd1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:44.756835 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af8cfa-018d-4d10-92b6-a3405bebd1ea admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:44.757137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af8cfa-018d-4d10-92b6-a3405bebd1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:44.757411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af8cfa-018d-4d10-92b6-a3405bebd1ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:44.758031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af8cfa-018d-4d10-92b6-a3405bebd1ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:44.759930 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af8cfa-018d-4d10-92b6-a3405bebd1ea admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:44.788980 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1288/2565] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:37:44 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:44.793173 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbe771-6335-4236-ab45-6cbb53d6a0ab admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:44.804224 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbe771-6335-4236-ab45-6cbb53d6a0ab admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:44.863355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a514a0-b972-45ff-867f-bafb2b90f433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:44.863968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a514a0-b972-45ff-867f-bafb2b90f433 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:44.864255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a514a0-b972-45ff-867f-bafb2b90f433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:44.864536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a514a0-b972-45ff-867f-bafb2b90f433 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:44.865225 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a514a0-b972-45ff-867f-bafb2b90f433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:44.867155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a514a0-b972-45ff-867f-bafb2b90f433 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:44.888865 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1278/2566] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:37:44 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:44.893148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af8cfa-018d-4d10-92b6-a3405bebd1ea admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:44.903497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af8cfa-018d-4d10-92b6-a3405bebd1ea admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:44.908782 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b71f7b-5666-4f39-8576-3d21ea3804f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:44.909386 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b71f7b-5666-4f39-8576-3d21ea3804f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:44.909670 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b71f7b-5666-4f39-8576-3d21ea3804f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:44.909946 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b71f7b-5666-4f39-8576-3d21ea3804f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:44.910591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b71f7b-5666-4f39-8576-3d21ea3804f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:44.912190 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b71f7b-5666-4f39-8576-3d21ea3804f7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:44.922368 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1289/2567] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:37:44.927111 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a514a0-b972-45ff-867f-bafb2b90f433 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:44.937277 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a514a0-b972-45ff-867f-bafb2b90f433 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:44.942270 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666c5eb-ea9d-49ee-8c36-3743095f421b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:44.942884 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666c5eb-ea9d-49ee-8c36-3743095f421b admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:44.943183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666c5eb-ea9d-49ee-8c36-3743095f421b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:44.943468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666c5eb-ea9d-49ee-8c36-3743095f421b admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:44.944115 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666c5eb-ea9d-49ee-8c36-3743095f421b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:44.945733 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666c5eb-ea9d-49ee-8c36-3743095f421b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:44.956751 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1279/2568] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:37:44.961134 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b71f7b-5666-4f39-8576-3d21ea3804f7 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:44.971933 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b71f7b-5666-4f39-8576-3d21ea3804f7 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:44.976494 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957b22c-f693-44a2-9aeb-b4ac8c842804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:44.977252 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957b22c-f693-44a2-9aeb-b4ac8c842804 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:44.977540 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957b22c-f693-44a2-9aeb-b4ac8c842804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:44.977821 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957b22c-f693-44a2-9aeb-b4ac8c842804 admin admin] PATH_INFO: `/v3/projects/490fb535b74d41b49aed2135b3c9a5d2/users/f9557a01aa7c43e2a7e6ceafae5ca26d/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:44.992991 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957b22c-f693-44a2-9aeb-b4ac8c842804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=490fb535b74d41b49aed2135b3c9a5d2, user_id=f9557a01aa7c43e2a7e6ceafae5ca26d, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:44.995656 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957b22c-f693-44a2-9aeb-b4ac8c842804 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:45.009646 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1290/2569] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:37:44 2022] PUT /identity/v3/projects/490fb535b74d41b49aed2135b3c9a5d2/users/f9557a01aa7c43e2a7e6ceafae5ca26d/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:37:45.020417 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625df41b-adea-4931-baec-62f2573bcdf5 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:45.021016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625df41b-adea-4931-baec-62f2573bcdf5 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:45.021138 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625df41b-adea-4931-baec-62f2573bcdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:45.051332 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-625df41b-adea-4931-baec-62f2573bcdf5 None None] MFA Rules not processed for user `f9557a01aa7c43e2a7e6ceafae5ca26d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:45.052588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-625df41b-adea-4931-baec-62f2573bcdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:45.120743 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1280/2570] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:37:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:37:45.132574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957b22c-f693-44a2-9aeb-b4ac8c842804 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:45.134357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-1957b22c-f693-44a2-9aeb-b4ac8c842804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:45.191557 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957b22c-f693-44a2-9aeb-b4ac8c842804 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:45.195206 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db79567-779d-4b15-98dc-67c12102f8c2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6106a46199b74f649cd29a0d02610049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:45.195814 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db79567-779d-4b15-98dc-67c12102f8c2 service glance] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:45.196098 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db79567-779d-4b15-98dc-67c12102f8c2 service glance] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:45.196373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db79567-779d-4b15-98dc-67c12102f8c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:45.205772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db79567-779d-4b15-98dc-67c12102f8c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:45.207250 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db79567-779d-4b15-98dc-67c12102f8c2 service glance] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:45.216411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1291/2571] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:37:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:37:53.260237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625df41b-adea-4931-baec-62f2573bcdf5 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:53.261781 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-625df41b-adea-4931-baec-62f2573bcdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:53.313421 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:53.341993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625df41b-adea-4931-baec-62f2573bcdf5 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:53.346864 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8199108-b95c-4efd-9303-c3730e3eb63d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:53.347907 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8199108-b95c-4efd-9303-c3730e3eb63d service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:53.348354 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8199108-b95c-4efd-9303-c3730e3eb63d service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:53.348858 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8199108-b95c-4efd-9303-c3730e3eb63d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:53.351585 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c8199108-b95c-4efd-9303-c3730e3eb63d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:53.449624 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8199108-b95c-4efd-9303-c3730e3eb63d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:53.451717 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8199108-b95c-4efd-9303-c3730e3eb63d service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:53.464275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1281/2572] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:37:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:37:54.742655 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db79567-779d-4b15-98dc-67c12102f8c2 service glance] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:54.747801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0db79567-779d-4b15-98dc-67c12102f8c2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:54.794942 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:54.897217 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db79567-779d-4b15-98dc-67c12102f8c2 service glance] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:54.903349 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec02874-7886-4892-a662-dd80044e83f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:54.904004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec02874-7886-4892-a662-dd80044e83f8 service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:54.904311 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec02874-7886-4892-a662-dd80044e83f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:54.904594 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec02874-7886-4892-a662-dd80044e83f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:54.906670 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0ec02874-7886-4892-a662-dd80044e83f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:54.921141 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec02874-7886-4892-a662-dd80044e83f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:54.923054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec02874-7886-4892-a662-dd80044e83f8 service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:54.937168 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1292/2573] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:37:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:37:58.944375 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8199108-b95c-4efd-9303-c3730e3eb63d service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:58.953795 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8199108-b95c-4efd-9303-c3730e3eb63d service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:58.958497 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf00051-c512-40be-9403-b5edce35e5b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:58.959141 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf00051-c512-40be-9403-b5edce35e5b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:58.959422 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf00051-c512-40be-9403-b5edce35e5b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:58.959696 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf00051-c512-40be-9403-b5edce35e5b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:58.961616 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-fcf00051-c512-40be-9403-b5edce35e5b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:59.035720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf00051-c512-40be-9403-b5edce35e5b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:59.037280 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf00051-c512-40be-9403-b5edce35e5b2 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:59.054656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1282/2574] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:37:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:38:00.387848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec02874-7886-4892-a662-dd80044e83f8 service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:00.389804 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0ec02874-7886-4892-a662-dd80044e83f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:00.408143 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec02874-7886-4892-a662-dd80044e83f8 service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:00.415521 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f603b-7bfe-4b39-a835-f11025048428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:00.416565 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f603b-7bfe-4b39-a835-f11025048428 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:00.417049 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f603b-7bfe-4b39-a835-f11025048428 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:00.417618 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f603b-7bfe-4b39-a835-f11025048428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:00.421041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a71f603b-7bfe-4b39-a835-f11025048428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:00.443213 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f603b-7bfe-4b39-a835-f11025048428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:00.445096 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f603b-7bfe-4b39-a835-f11025048428 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:00.458736 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1293/2575] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:38:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:38:03.921042 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf00051-c512-40be-9403-b5edce35e5b2 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:03.923364 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-fcf00051-c512-40be-9403-b5edce35e5b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:04.058669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf00051-c512-40be-9403-b5edce35e5b2 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:04.069287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c0f30-a68e-4df5-aa47-0de762374ef6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f7fe9af30947dbae1f2334b18f630d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:04.070650 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c0f30-a68e-4df5-aa47-0de762374ef6 service placement] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:04.071433 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c0f30-a68e-4df5-aa47-0de762374ef6 service placement] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:04.072129 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c0f30-a68e-4df5-aa47-0de762374ef6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:04.075545 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c90c0f30-a68e-4df5-aa47-0de762374ef6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:04.099989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c0f30-a68e-4df5-aa47-0de762374ef6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:04.103490 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c0f30-a68e-4df5-aa47-0de762374ef6 service placement] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:04.122635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1283/2576] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:38:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:38:05.901582 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f603b-7bfe-4b39-a835-f11025048428 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:05.918445 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f603b-7bfe-4b39-a835-f11025048428 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:05.924754 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097620cb-1b39-41df-bf20-9e1be030ebea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f7fe9af30947dbae1f2334b18f630d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:05.925862 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097620cb-1b39-41df-bf20-9e1be030ebea service placement] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:05.926153 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097620cb-1b39-41df-bf20-9e1be030ebea service placement] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:05.926466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097620cb-1b39-41df-bf20-9e1be030ebea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:05.928374 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-097620cb-1b39-41df-bf20-9e1be030ebea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:05.943306 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097620cb-1b39-41df-bf20-9e1be030ebea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:05.945002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097620cb-1b39-41df-bf20-9e1be030ebea service placement] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:05.958535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1294/2577] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:38:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:38:05.995821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c0f30-a68e-4df5-aa47-0de762374ef6 service placement] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:06.001100 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c90c0f30-a68e-4df5-aa47-0de762374ef6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:06.015364 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c0f30-a68e-4df5-aa47-0de762374ef6 service placement] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:06.020359 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6100ae-22b2-4552-9d82-63d45e2f374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:06.021306 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6100ae-22b2-4552-9d82-63d45e2f374d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:06.021750 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6100ae-22b2-4552-9d82-63d45e2f374d admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:06.022216 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6100ae-22b2-4552-9d82-63d45e2f374d admin admin] PATH_INFO: `/v3/users/67bfd102d61945519b8480abb37f305a` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:06.023394 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6100ae-22b2-4552-9d82-63d45e2f374d admin admin] RBAC: Authorizing `identity:delete_user(user_id=67bfd102d61945519b8480abb37f305a)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:06.025420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6100ae-22b2-4552-9d82-63d45e2f374d admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:06.032062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:06.091932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ca6100ae-22b2-4552-9d82-63d45e2f374d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67bfd102d61945519b8480abb37f305a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:06.092641 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ca6100ae-22b2-4552-9d82-63d45e2f374d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67bfd102d61945519b8480abb37f305a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:06.102132 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ca6100ae-22b2-4552-9d82-63d45e2f374d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67bfd102d61945519b8480abb37f305a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:06.102889 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ca6100ae-22b2-4552-9d82-63d45e2f374d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67bfd102d61945519b8480abb37f305a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:06.111179 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ca6100ae-22b2-4552-9d82-63d45e2f374d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67bfd102d61945519b8480abb37f305a'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:06.139285 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1284/2578] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:38:05 2022] DELETE /identity/v3/users/67bfd102d61945519b8480abb37f305a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:38:06.525271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097620cb-1b39-41df-bf20-9e1be030ebea service placement] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:06.538338 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097620cb-1b39-41df-bf20-9e1be030ebea service placement] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:06.673662 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237504ca-d3d5-421b-86b3-39072aae448a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:06.676541 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237504ca-d3d5-421b-86b3-39072aae448a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:06.677081 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237504ca-d3d5-421b-86b3-39072aae448a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:06.678215 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237504ca-d3d5-421b-86b3-39072aae448a admin admin] PATH_INFO: `/v3/projects/71a53a013d9b4829ac710ceda464fd6b` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:06.680291 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237504ca-d3d5-421b-86b3-39072aae448a admin admin] RBAC: Authorizing `identity:delete_project(project_id=71a53a013d9b4829ac710ceda464fd6b)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:06.683305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237504ca-d3d5-421b-86b3-39072aae448a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:06.776247 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-237504ca-d3d5-421b-86b3-39072aae448a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71a53a013d9b4829ac710ceda464fd6b', 'request_id': 'req-237504ca-d3d5-421b-86b3-39072aae448a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:06.787559 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-237504ca-d3d5-421b-86b3-39072aae448a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71a53a013d9b4829ac710ceda464fd6b', 'request_id': 'req-237504ca-d3d5-421b-86b3-39072aae448a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:06.797040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-237504ca-d3d5-421b-86b3-39072aae448a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71a53a013d9b4829ac710ceda464fd6b', 'request_id': 'req-237504ca-d3d5-421b-86b3-39072aae448a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:06.817244 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-237504ca-d3d5-421b-86b3-39072aae448a admin admin] The token cache is being invalidate because project 71a53a013d9b4829ac710ceda464fd6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:38:06.817599 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-237504ca-d3d5-421b-86b3-39072aae448a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:06.818256 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-237504ca-d3d5-421b-86b3-39072aae448a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:06.820122 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1295/2579] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:38:06 2022] DELETE /identity/v3/projects/71a53a013d9b4829ac710ceda464fd6b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:38:06.824982 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc56a6-2b4d-4c84-9c74-b24ed9e3fd10 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:06.825342 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc56a6-2b4d-4c84-9c74-b24ed9e3fd10 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:06.825706 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc56a6-2b4d-4c84-9c74-b24ed9e3fd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:06.868921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-eecc56a6-2b4d-4c84-9c74-b24ed9e3fd10 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:06.871117 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-eecc56a6-2b4d-4c84-9c74-b24ed9e3fd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:06.957183 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1285/2580] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:38:06.966953 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435fc9b-9997-48b4-bf56-49ae3e11ed30 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:06.967876 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435fc9b-9997-48b4-bf56-49ae3e11ed30 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:06.967876 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435fc9b-9997-48b4-bf56-49ae3e11ed30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:07.008407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6435fc9b-9997-48b4-bf56-49ae3e11ed30 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:07.010808 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6435fc9b-9997-48b4-bf56-49ae3e11ed30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:07.029893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1296/2581] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:38:07.032243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc56a6-2b4d-4c84-9c74-b24ed9e3fd10 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:07.051584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc56a6-2b4d-4c84-9c74-b24ed9e3fd10 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:07.059712 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a9baf-a348-4f1a-a30e-2ffc3e370a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:07.060802 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a9baf-a348-4f1a-a30e-2ffc3e370a47 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:07.061842 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a9baf-a348-4f1a-a30e-2ffc3e370a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:07.062806 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a9baf-a348-4f1a-a30e-2ffc3e370a47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:07.065165 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a9baf-a348-4f1a-a30e-2ffc3e370a47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:38:07.066285 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a9baf-a348-4f1a-a30e-2ffc3e370a47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:07.069030 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4a9baf-a348-4f1a-a30e-2ffc3e370a47 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:07.090128 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1286/2582] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:07.097102 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435fc9b-9997-48b4-bf56-49ae3e11ed30 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:07.103816 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:07.111127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435fc9b-9997-48b4-bf56-49ae3e11ed30 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:07.118384 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f35be9-e08a-4e56-955b-cd1e85b02c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:07.119120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f35be9-e08a-4e56-955b-cd1e85b02c4a admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:07.119484 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f35be9-e08a-4e56-955b-cd1e85b02c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:07.120085 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f35be9-e08a-4e56-955b-cd1e85b02c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:07.120915 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f35be9-e08a-4e56-955b-cd1e85b02c4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:07.123125 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f35be9-e08a-4e56-955b-cd1e85b02c4a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:07.168760 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1297/2583] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:38:07 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:38:07.169825 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a9baf-a348-4f1a-a30e-2ffc3e370a47 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:07.181430 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a9baf-a348-4f1a-a30e-2ffc3e370a47 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:07.250514 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40bbde-8127-4971-8bac-c8dc4c061763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:07.251277 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40bbde-8127-4971-8bac-c8dc4c061763 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:07.251576 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40bbde-8127-4971-8bac-c8dc4c061763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:07.251858 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40bbde-8127-4971-8bac-c8dc4c061763 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:07.252565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40bbde-8127-4971-8bac-c8dc4c061763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:07.254616 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40bbde-8127-4971-8bac-c8dc4c061763 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:07.283098 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1287/2584] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:38:07 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:38:07.285071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f35be9-e08a-4e56-955b-cd1e85b02c4a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:07.295900 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f35be9-e08a-4e56-955b-cd1e85b02c4a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:07.301391 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688dd59-4460-4f4b-be44-149cf57486c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:07.302032 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688dd59-4460-4f4b-be44-149cf57486c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:07.302320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688dd59-4460-4f4b-be44-149cf57486c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:07.302622 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688dd59-4460-4f4b-be44-149cf57486c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:07.303283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688dd59-4460-4f4b-be44-149cf57486c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:07.304935 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688dd59-4460-4f4b-be44-149cf57486c1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:07.317217 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1298/2585] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:38:07.322745 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40bbde-8127-4971-8bac-c8dc4c061763 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:07.328262 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:07.338379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40bbde-8127-4971-8bac-c8dc4c061763 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:07.349088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ae2eb-dcad-4195-a5fc-22bc811680a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:07.350080 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ae2eb-dcad-4195-a5fc-22bc811680a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:07.350521 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ae2eb-dcad-4195-a5fc-22bc811680a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:07.350923 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ae2eb-dcad-4195-a5fc-22bc811680a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:07.351710 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ae2eb-dcad-4195-a5fc-22bc811680a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:07.354834 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ae2eb-dcad-4195-a5fc-22bc811680a4 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:07.370171 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1288/2586] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:38:07.374607 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688dd59-4460-4f4b-be44-149cf57486c1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:07.389335 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688dd59-4460-4f4b-be44-149cf57486c1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:07.395170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dadecd-f065-483b-9e1e-be1a010b571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:07.396015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dadecd-f065-483b-9e1e-be1a010b571b admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:07.396307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dadecd-f065-483b-9e1e-be1a010b571b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:07.396592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dadecd-f065-483b-9e1e-be1a010b571b admin admin] PATH_INFO: `/v3/projects/39460d8652714b658648354b818f435f/users/383a0c7b4e574409b477fa61581e63bf/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:07.414369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dadecd-f065-483b-9e1e-be1a010b571b admin admin] RBAC: Authorizing `identity:create_grant(project_id=39460d8652714b658648354b818f435f, user_id=383a0c7b4e574409b477fa61581e63bf, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:07.417177 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dadecd-f065-483b-9e1e-be1a010b571b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:07.434983 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1299/2587] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:38:07 2022] PUT /identity/v3/projects/39460d8652714b658648354b818f435f/users/383a0c7b4e574409b477fa61581e63bf/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:38:07.444515 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e47fa-9837-46a2-944f-62a98dbe3397 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:07.445887 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e47fa-9837-46a2-944f-62a98dbe3397 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:07.446685 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e47fa-9837-46a2-944f-62a98dbe3397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:07.483299 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-f85e47fa-9837-46a2-944f-62a98dbe3397 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:07.484878 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f85e47fa-9837-46a2-944f-62a98dbe3397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:07.603021 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1289/2588] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:38:07.616599 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dadecd-f065-483b-9e1e-be1a010b571b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:07.618399 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-13dadecd-f065-483b-9e1e-be1a010b571b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:07.684839 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dadecd-f065-483b-9e1e-be1a010b571b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:07.689400 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3907f1d-391f-48d3-ba19-f07b0f8e7743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:07.690279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3907f1d-391f-48d3-ba19-f07b0f8e7743 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:07.690813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3907f1d-391f-48d3-ba19-f07b0f8e7743 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:07.691170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3907f1d-391f-48d3-ba19-f07b0f8e7743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:07.702842 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3907f1d-391f-48d3-ba19-f07b0f8e7743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:07.704531 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3907f1d-391f-48d3-ba19-f07b0f8e7743 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:07.716875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1300/2589] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:38:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:38:09.017616 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e47fa-9837-46a2-944f-62a98dbe3397 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:09.019291 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f85e47fa-9837-46a2-944f-62a98dbe3397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:09.032985 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e47fa-9837-46a2-944f-62a98dbe3397 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:09.039077 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d49baf-b709-4a88-bc8e-b4b1e201f094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:09.039699 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d49baf-b709-4a88-bc8e-b4b1e201f094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:09.039991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d49baf-b709-4a88-bc8e-b4b1e201f094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:09.040310 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d49baf-b709-4a88-bc8e-b4b1e201f094 admin admin] PATH_INFO: `/v3/users/a4eb634ea0334064a29d5c2ddc9d16ac` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:09.042428 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d49baf-b709-4a88-bc8e-b4b1e201f094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4eb634ea0334064a29d5c2ddc9d16ac)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:09.043695 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d49baf-b709-4a88-bc8e-b4b1e201f094 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:09.118650 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-07d49baf-b709-4a88-bc8e-b4b1e201f094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4eb634ea0334064a29d5c2ddc9d16ac'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:09.119731 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-07d49baf-b709-4a88-bc8e-b4b1e201f094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4eb634ea0334064a29d5c2ddc9d16ac'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:09.133893 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-07d49baf-b709-4a88-bc8e-b4b1e201f094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4eb634ea0334064a29d5c2ddc9d16ac'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:09.134795 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-07d49baf-b709-4a88-bc8e-b4b1e201f094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4eb634ea0334064a29d5c2ddc9d16ac'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:09.155298 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-07d49baf-b709-4a88-bc8e-b4b1e201f094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4eb634ea0334064a29d5c2ddc9d16ac'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:09.202139 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1290/2590] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:38:09 2022] DELETE /identity/v3/users/a4eb634ea0334064a29d5c2ddc9d16ac => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:38:09.576032 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3907f1d-391f-48d3-ba19-f07b0f8e7743 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:09.598280 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3907f1d-391f-48d3-ba19-f07b0f8e7743 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:09.715021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328b467-a929-40c3-bef4-28fbefc5ea59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:09.716802 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328b467-a929-40c3-bef4-28fbefc5ea59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:09.717323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328b467-a929-40c3-bef4-28fbefc5ea59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:09.717834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328b467-a929-40c3-bef4-28fbefc5ea59 admin admin] PATH_INFO: `/v3/projects/d270b000824749209b3b804d7c412f33` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:09.719869 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328b467-a929-40c3-bef4-28fbefc5ea59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d270b000824749209b3b804d7c412f33)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:09.724329 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328b467-a929-40c3-bef4-28fbefc5ea59 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:09.820872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3328b467-a929-40c3-bef4-28fbefc5ea59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd270b000824749209b3b804d7c412f33', 'request_id': 'req-3328b467-a929-40c3-bef4-28fbefc5ea59'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:09.836102 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:09.846744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3328b467-a929-40c3-bef4-28fbefc5ea59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd270b000824749209b3b804d7c412f33', 'request_id': 'req-3328b467-a929-40c3-bef4-28fbefc5ea59'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:09.858701 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3328b467-a929-40c3-bef4-28fbefc5ea59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd270b000824749209b3b804d7c412f33', 'request_id': 'req-3328b467-a929-40c3-bef4-28fbefc5ea59'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:09.877204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3328b467-a929-40c3-bef4-28fbefc5ea59 admin admin] The token cache is being invalidate because project d270b000824749209b3b804d7c412f33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:38:09.877543 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3328b467-a929-40c3-bef4-28fbefc5ea59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:09.878245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-3328b467-a929-40c3-bef4-28fbefc5ea59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:09.879884 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1301/2591] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:38:09 2022] DELETE /identity/v3/projects/d270b000824749209b3b804d7c412f33 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:38:09.884269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d49baf-b709-4a88-bc8e-b4b1e201f094 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:09.886444 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-07d49baf-b709-4a88-bc8e-b4b1e201f094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:09.911844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d49baf-b709-4a88-bc8e-b4b1e201f094 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:09.996838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd085da-90a8-4c74-b614-2ca329b5970e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:09.997425 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd085da-90a8-4c74-b614-2ca329b5970e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:09.997747 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd085da-90a8-4c74-b614-2ca329b5970e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:09.998035 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd085da-90a8-4c74-b614-2ca329b5970e admin admin] PATH_INFO: `/v3/users/33bb6f22057f47c1810d352c337fd9df` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:09.999427 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd085da-90a8-4c74-b614-2ca329b5970e admin admin] RBAC: Authorizing `identity:delete_user(user_id=33bb6f22057f47c1810d352c337fd9df)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:10.001624 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd085da-90a8-4c74-b614-2ca329b5970e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:10.008580 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:10.108292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7dd085da-90a8-4c74-b614-2ca329b5970e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33bb6f22057f47c1810d352c337fd9df'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:10.111224 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7dd085da-90a8-4c74-b614-2ca329b5970e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33bb6f22057f47c1810d352c337fd9df'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:10.126531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7dd085da-90a8-4c74-b614-2ca329b5970e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33bb6f22057f47c1810d352c337fd9df'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:10.128391 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7dd085da-90a8-4c74-b614-2ca329b5970e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33bb6f22057f47c1810d352c337fd9df'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:10.141449 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7dd085da-90a8-4c74-b614-2ca329b5970e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33bb6f22057f47c1810d352c337fd9df'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:10.183410 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1291/2592] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:38:09 2022] DELETE /identity/v3/users/33bb6f22057f47c1810d352c337fd9df => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:38:10.371711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328b467-a929-40c3-bef4-28fbefc5ea59 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:10.373657 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3328b467-a929-40c3-bef4-28fbefc5ea59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:10.394587 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328b467-a929-40c3-bef4-28fbefc5ea59 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:10.437967 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd085da-90a8-4c74-b614-2ca329b5970e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:10.440066 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7dd085da-90a8-4c74-b614-2ca329b5970e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:10.560874 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1f48e-1f51-4513-9292-ab61d7a464d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:10.565494 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1f48e-1f51-4513-9292-ab61d7a464d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:10.565815 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1f48e-1f51-4513-9292-ab61d7a464d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:10.566135 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1f48e-1f51-4513-9292-ab61d7a464d0 admin admin] PATH_INFO: `/v3/users/f9557a01aa7c43e2a7e6ceafae5ca26d` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:10.567574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1f48e-1f51-4513-9292-ab61d7a464d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9557a01aa7c43e2a7e6ceafae5ca26d)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:10.569658 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1f48e-1f51-4513-9292-ab61d7a464d0 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:10.630688 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd085da-90a8-4c74-b614-2ca329b5970e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:10.636000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a46b1e-5cf9-4ecc-9599-68cb283649d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:10.636982 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a46b1e-5cf9-4ecc-9599-68cb283649d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:10.637447 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a46b1e-5cf9-4ecc-9599-68cb283649d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:10.637880 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a46b1e-5cf9-4ecc-9599-68cb283649d5 admin admin] PATH_INFO: `/v3/projects/d3ce362c36804500afd2cc344cc7edca` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:10.639299 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a46b1e-5cf9-4ecc-9599-68cb283649d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ce362c36804500afd2cc344cc7edca)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:10.642044 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a46b1e-5cf9-4ecc-9599-68cb283649d5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:10.727637 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c6c1f48e-1f51-4513-9292-ab61d7a464d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9557a01aa7c43e2a7e6ceafae5ca26d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:10.729062 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c6c1f48e-1f51-4513-9292-ab61d7a464d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9557a01aa7c43e2a7e6ceafae5ca26d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:10.733853 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-76a46b1e-5cf9-4ecc-9599-68cb283649d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ce362c36804500afd2cc344cc7edca', 'request_id': 'req-76a46b1e-5cf9-4ecc-9599-68cb283649d5'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:10.743647 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-76a46b1e-5cf9-4ecc-9599-68cb283649d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ce362c36804500afd2cc344cc7edca', 'request_id': 'req-76a46b1e-5cf9-4ecc-9599-68cb283649d5'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:10.745287 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c6c1f48e-1f51-4513-9292-ab61d7a464d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9557a01aa7c43e2a7e6ceafae5ca26d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:10.746426 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c6c1f48e-1f51-4513-9292-ab61d7a464d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9557a01aa7c43e2a7e6ceafae5ca26d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:10.759730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-76a46b1e-5cf9-4ecc-9599-68cb283649d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ce362c36804500afd2cc344cc7edca', 'request_id': 'req-76a46b1e-5cf9-4ecc-9599-68cb283649d5'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:10.774144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c6c1f48e-1f51-4513-9292-ab61d7a464d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9557a01aa7c43e2a7e6ceafae5ca26d'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:10.788854 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-76a46b1e-5cf9-4ecc-9599-68cb283649d5 admin admin] The token cache is being invalidate because project d3ce362c36804500afd2cc344cc7edca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:38:10.789998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-76a46b1e-5cf9-4ecc-9599-68cb283649d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:10.791933 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-76a46b1e-5cf9-4ecc-9599-68cb283649d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:10.796229 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1302/2593] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:38:10 2022] DELETE /identity/v3/users/f9557a01aa7c43e2a7e6ceafae5ca26d => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:38:10.796865 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1292/2594] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:38:10 2022] DELETE /identity/v3/projects/d3ce362c36804500afd2cc344cc7edca => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:38:10.801231 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d0b67-0ba6-4ef1-9b76-5190875cf41f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:10.801587 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d0b67-0ba6-4ef1-9b76-5190875cf41f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:10.801968 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d0b67-0ba6-4ef1-9b76-5190875cf41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:10.823881 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-f47d0b67-0ba6-4ef1-9b76-5190875cf41f None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:10.828823 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f47d0b67-0ba6-4ef1-9b76-5190875cf41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:10.916022 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:10.949631 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1303/2595] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:38:10.977898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a46b1e-5cf9-4ecc-9599-68cb283649d5 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:10.982366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-76a46b1e-5cf9-4ecc-9599-68cb283649d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:11.042914 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:11.118206 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a46b1e-5cf9-4ecc-9599-68cb283649d5 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:11.237614 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f2757-b01a-4074-a4d9-aaf8f7c7689f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:11.239357 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f2757-b01a-4074-a4d9-aaf8f7c7689f service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:11.239854 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f2757-b01a-4074-a4d9-aaf8f7c7689f service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:11.240307 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f2757-b01a-4074-a4d9-aaf8f7c7689f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:11.255058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f2757-b01a-4074-a4d9-aaf8f7c7689f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:11.256449 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f2757-b01a-4074-a4d9-aaf8f7c7689f service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:11.270827 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1293/2596] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:38:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:38:11.865671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d0b67-0ba6-4ef1-9b76-5190875cf41f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:11.867222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-f47d0b67-0ba6-4ef1-9b76-5190875cf41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:11.894989 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d0b67-0ba6-4ef1-9b76-5190875cf41f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:11.907080 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705553a0-08ab-4d3a-8c83-44b6b6ccc6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:11.907748 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705553a0-08ab-4d3a-8c83-44b6b6ccc6d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:11.908030 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705553a0-08ab-4d3a-8c83-44b6b6ccc6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:11.908972 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705553a0-08ab-4d3a-8c83-44b6b6ccc6d9 admin admin] PATH_INFO: `/v3/projects/490fb535b74d41b49aed2135b3c9a5d2` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:11.910461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705553a0-08ab-4d3a-8c83-44b6b6ccc6d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=490fb535b74d41b49aed2135b3c9a5d2)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:11.912412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705553a0-08ab-4d3a-8c83-44b6b6ccc6d9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:12.014108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-705553a0-08ab-4d3a-8c83-44b6b6ccc6d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '490fb535b74d41b49aed2135b3c9a5d2', 'request_id': 'req-705553a0-08ab-4d3a-8c83-44b6b6ccc6d9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:12.031412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-705553a0-08ab-4d3a-8c83-44b6b6ccc6d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '490fb535b74d41b49aed2135b3c9a5d2', 'request_id': 'req-705553a0-08ab-4d3a-8c83-44b6b6ccc6d9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:12.048209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-705553a0-08ab-4d3a-8c83-44b6b6ccc6d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '490fb535b74d41b49aed2135b3c9a5d2', 'request_id': 'req-705553a0-08ab-4d3a-8c83-44b6b6ccc6d9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:12.083154 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-705553a0-08ab-4d3a-8c83-44b6b6ccc6d9 admin admin] The token cache is being invalidate because project 490fb535b74d41b49aed2135b3c9a5d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:38:12.083780 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-705553a0-08ab-4d3a-8c83-44b6b6ccc6d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:12.085191 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-705553a0-08ab-4d3a-8c83-44b6b6ccc6d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:12.088254 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1304/2597] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:38:11 2022] DELETE /identity/v3/projects/490fb535b74d41b49aed2135b3c9a5d2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:38:12.093754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500980d-a257-4661-8d0c-2ef34a36b0f6 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:12.094363 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500980d-a257-4661-8d0c-2ef34a36b0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:12.094809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500980d-a257-4661-8d0c-2ef34a36b0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:12.133774 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6500980d-a257-4661-8d0c-2ef34a36b0f6 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:12.135045 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6500980d-a257-4661-8d0c-2ef34a36b0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:12.289174 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1294/2598] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:38:12.297655 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a71c27-bead-463e-9dab-46e79633fa2a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:12.297945 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a71c27-bead-463e-9dab-46e79633fa2a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:12.298153 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a71c27-bead-463e-9dab-46e79633fa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:12.328805 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-20a71c27-bead-463e-9dab-46e79633fa2a None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:12.332375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-20a71c27-bead-463e-9dab-46e79633fa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:12.352954 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1305/2599] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:38:12.354398 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500980d-a257-4661-8d0c-2ef34a36b0f6 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:12.389078 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500980d-a257-4661-8d0c-2ef34a36b0f6 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:12.405949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b486b-dac3-4ae2-b136-ce4bfa0a924a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:12.407232 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b486b-dac3-4ae2-b136-ce4bfa0a924a admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:12.409506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b486b-dac3-4ae2-b136-ce4bfa0a924a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:12.410118 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b486b-dac3-4ae2-b136-ce4bfa0a924a admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:12.411742 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b486b-dac3-4ae2-b136-ce4bfa0a924a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:38:12.412613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b486b-dac3-4ae2-b136-ce4bfa0a924a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:12.417160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b486b-dac3-4ae2-b136-ce4bfa0a924a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:12.468732 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1295/2600] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:12.479072 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a71c27-bead-463e-9dab-46e79633fa2a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:12.506915 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a71c27-bead-463e-9dab-46e79633fa2a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:12.519969 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03fc91-c64f-455e-852e-544cdbad5f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:12.521272 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03fc91-c64f-455e-852e-544cdbad5f4c admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:12.523516 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03fc91-c64f-455e-852e-544cdbad5f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:12.524251 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03fc91-c64f-455e-852e-544cdbad5f4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:12.525667 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03fc91-c64f-455e-852e-544cdbad5f4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:12.530550 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03fc91-c64f-455e-852e-544cdbad5f4c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:12.576812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1306/2601] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:38:12 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:38:12.581811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b486b-dac3-4ae2-b136-ce4bfa0a924a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:12.610968 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b486b-dac3-4ae2-b136-ce4bfa0a924a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:12.757202 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076984f-fad1-442b-9aea-2ef280bc0cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:12.757854 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076984f-fad1-442b-9aea-2ef280bc0cfc admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:12.758140 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076984f-fad1-442b-9aea-2ef280bc0cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:12.758653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076984f-fad1-442b-9aea-2ef280bc0cfc admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:12.759392 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076984f-fad1-442b-9aea-2ef280bc0cfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:12.761534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076984f-fad1-442b-9aea-2ef280bc0cfc admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:12.795467 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:12.829686 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1296/2602] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:38:12 2022] POST /identity/v3/users => generated 287 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:38:12.832071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03fc91-c64f-455e-852e-544cdbad5f4c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:12.872893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03fc91-c64f-455e-852e-544cdbad5f4c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:12.887414 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29371a55-92dc-46df-ac70-a3b1816d406c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:12.888457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29371a55-92dc-46df-ac70-a3b1816d406c admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:12.888985 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29371a55-92dc-46df-ac70-a3b1816d406c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:12.889627 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29371a55-92dc-46df-ac70-a3b1816d406c admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:12.890530 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29371a55-92dc-46df-ac70-a3b1816d406c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:12.895426 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29371a55-92dc-46df-ac70-a3b1816d406c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:12.923794 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1307/2603] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:38:12.926526 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076984f-fad1-442b-9aea-2ef280bc0cfc admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:12.942478 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076984f-fad1-442b-9aea-2ef280bc0cfc admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:12.957258 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435bd29-ec41-4181-8559-1c74467b7503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:12.957907 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435bd29-ec41-4181-8559-1c74467b7503 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:12.958193 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435bd29-ec41-4181-8559-1c74467b7503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:12.958479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435bd29-ec41-4181-8559-1c74467b7503 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:12.960891 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435bd29-ec41-4181-8559-1c74467b7503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:12.962651 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435bd29-ec41-4181-8559-1c74467b7503 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:13.000282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1297/2604] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:38:13.001473 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29371a55-92dc-46df-ac70-a3b1816d406c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:13.019114 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29371a55-92dc-46df-ac70-a3b1816d406c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:13.068455 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09310e-3349-4cfb-95a0-c543531ab999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:13.069323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09310e-3349-4cfb-95a0-c543531ab999 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:13.069832 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09310e-3349-4cfb-95a0-c543531ab999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:13.070327 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09310e-3349-4cfb-95a0-c543531ab999 admin admin] PATH_INFO: `/v3/projects/9285b96c0d7544bf9efd333a8cfbe19d/users/771eb330b52d4f4a9dffb15cc429e965/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:13.167689 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09310e-3349-4cfb-95a0-c543531ab999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9285b96c0d7544bf9efd333a8cfbe19d, user_id=771eb330b52d4f4a9dffb15cc429e965, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:13.172216 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09310e-3349-4cfb-95a0-c543531ab999 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:13.221393 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1308/2605] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:38:13 2022] PUT /identity/v3/projects/9285b96c0d7544bf9efd333a8cfbe19d/users/771eb330b52d4f4a9dffb15cc429e965/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:38:13.285158 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b38ce-f630-4395-a641-42aef6c8d10b None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:13.285653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b38ce-f630-4395-a641-42aef6c8d10b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:13.285735 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b38ce-f630-4395-a641-42aef6c8d10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:13.332355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-728b38ce-f630-4395-a641-42aef6c8d10b None None] MFA Rules not processed for user `771eb330b52d4f4a9dffb15cc429e965`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:13.333805 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-728b38ce-f630-4395-a641-42aef6c8d10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:13.447605 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1298/2606] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:38:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:38:13.461527 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09310e-3349-4cfb-95a0-c543531ab999 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:13.463569 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6b09310e-3349-4cfb-95a0-c543531ab999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:13.594514 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09310e-3349-4cfb-95a0-c543531ab999 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:13.600129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142b652-9755-4d52-96c1-90b170c48298 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:13.600563 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142b652-9755-4d52-96c1-90b170c48298 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:13.600905 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142b652-9755-4d52-96c1-90b170c48298 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:13.601188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142b652-9755-4d52-96c1-90b170c48298 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:13.619672 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142b652-9755-4d52-96c1-90b170c48298 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:13.621224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142b652-9755-4d52-96c1-90b170c48298 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:13.646231 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1309/2607] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:38:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:38:14.704135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a778392-1988-44f9-91f6-c164929c570f None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:14.706266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a778392-1988-44f9-91f6-c164929c570f None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:14.706980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a778392-1988-44f9-91f6-c164929c570f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:14.757257 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-2a778392-1988-44f9-91f6-c164929c570f None None] MFA Rules not processed for user `383a0c7b4e574409b477fa61581e63bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:14.759547 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2a778392-1988-44f9-91f6-c164929c570f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:14.894658 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1299/2608] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:38:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:38:14.915134 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142b652-9755-4d52-96c1-90b170c48298 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:14.917405 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9142b652-9755-4d52-96c1-90b170c48298 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:14.967076 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:15.037370 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142b652-9755-4d52-96c1-90b170c48298 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:15.043781 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22e910-8416-4a4a-98c6-3ec4f8caeddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:15.044680 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22e910-8416-4a4a-98c6-3ec4f8caeddb service nova] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:15.045000 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22e910-8416-4a4a-98c6-3ec4f8caeddb service nova] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:15.045283 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22e910-8416-4a4a-98c6-3ec4f8caeddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:15.055135 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22e910-8416-4a4a-98c6-3ec4f8caeddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:15.056773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22e910-8416-4a4a-98c6-3ec4f8caeddb service nova] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:15.073625 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1310/2609] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:38:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:38:17.144995 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3dfd2-5454-44b8-86d5-b48397585236 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:17.145632 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3dfd2-5454-44b8-86d5-b48397585236 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:17.145788 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3dfd2-5454-44b8-86d5-b48397585236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:17.166789 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-dae3dfd2-5454-44b8-86d5-b48397585236 None None] MFA Rules not processed for user `383a0c7b4e574409b477fa61581e63bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:17.168011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-dae3dfd2-5454-44b8-86d5-b48397585236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:17.176656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1300/2610] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:38:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:38:17.697321 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22e910-8416-4a4a-98c6-3ec4f8caeddb service nova] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:17.699362 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0f22e910-8416-4a4a-98c6-3ec4f8caeddb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:17.785974 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22e910-8416-4a4a-98c6-3ec4f8caeddb service nova] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:17.797724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c76c55-d860-4bba-a627-fdd1d6d944dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:17.798830 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c76c55-d860-4bba-a627-fdd1d6d944dd service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:17.800334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c76c55-d860-4bba-a627-fdd1d6d944dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:17.801121 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c76c55-d860-4bba-a627-fdd1d6d944dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:17.804610 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b7c76c55-d860-4bba-a627-fdd1d6d944dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:17.823569 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c76c55-d860-4bba-a627-fdd1d6d944dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:17.825338 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c76c55-d860-4bba-a627-fdd1d6d944dd service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:17.857349 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1311/2611] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:38:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:38:19.313617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3dfd2-5454-44b8-86d5-b48397585236 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:19.329028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3dfd2-5454-44b8-86d5-b48397585236 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:19.333698 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b47861-a1cc-4d75-ad01-f368381361f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:19.334325 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b47861-a1cc-4d75-ad01-f368381361f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:19.334615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b47861-a1cc-4d75-ad01-f368381361f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:19.334899 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b47861-a1cc-4d75-ad01-f368381361f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:19.336848 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-58b47861-a1cc-4d75-ad01-f368381361f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:19.411578 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:19.431310 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b47861-a1cc-4d75-ad01-f368381361f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:19.432913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b47861-a1cc-4d75-ad01-f368381361f3 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:19.446228 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1301/2612] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:38:24.520460 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c76c55-d860-4bba-a627-fdd1d6d944dd service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:24.522133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b7c76c55-d860-4bba-a627-fdd1d6d944dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:24.540194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c76c55-d860-4bba-a627-fdd1d6d944dd service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:24.545569 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a23d3-e045-42ca-ab9e-ad3ecacdf887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:24.546307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a23d3-e045-42ca-ab9e-ad3ecacdf887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:24.546633 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a23d3-e045-42ca-ab9e-ad3ecacdf887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:24.546954 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a23d3-e045-42ca-ab9e-ad3ecacdf887 admin admin] PATH_INFO: `/v3/users/eb97bbb6260a45f3bfeb404b8c9fa815` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:24.548321 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a23d3-e045-42ca-ab9e-ad3ecacdf887 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb97bbb6260a45f3bfeb404b8c9fa815)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:24.551208 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a23d3-e045-42ca-ab9e-ad3ecacdf887 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:24.605683 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7e2a23d3-e045-42ca-ab9e-ad3ecacdf887 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb97bbb6260a45f3bfeb404b8c9fa815'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:24.606719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7e2a23d3-e045-42ca-ab9e-ad3ecacdf887 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb97bbb6260a45f3bfeb404b8c9fa815'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:24.618712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7e2a23d3-e045-42ca-ab9e-ad3ecacdf887 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb97bbb6260a45f3bfeb404b8c9fa815'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:24.619524 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7e2a23d3-e045-42ca-ab9e-ad3ecacdf887 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb97bbb6260a45f3bfeb404b8c9fa815'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:24.639635 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-7e2a23d3-e045-42ca-ab9e-ad3ecacdf887 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb97bbb6260a45f3bfeb404b8c9fa815'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:24.658760 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1312/2613] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:38:24 2022] DELETE /identity/v3/users/eb97bbb6260a45f3bfeb404b8c9fa815 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:38:24.849452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b47861-a1cc-4d75-ad01-f368381361f3 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:24.866127 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b47861-a1cc-4d75-ad01-f368381361f3 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:24.929653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8131c53-9f25-4d42-b9cf-761d0d0ee759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:24.930299 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8131c53-9f25-4d42-b9cf-761d0d0ee759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:24.930587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8131c53-9f25-4d42-b9cf-761d0d0ee759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:24.930871 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8131c53-9f25-4d42-b9cf-761d0d0ee759 admin admin] PATH_INFO: `/v3/projects/fdb28ea39dab4188b02b498378fe37d6` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:24.932024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8131c53-9f25-4d42-b9cf-761d0d0ee759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdb28ea39dab4188b02b498378fe37d6)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:24.933978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8131c53-9f25-4d42-b9cf-761d0d0ee759 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:24.987682 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e8131c53-9f25-4d42-b9cf-761d0d0ee759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdb28ea39dab4188b02b498378fe37d6', 'request_id': 'req-e8131c53-9f25-4d42-b9cf-761d0d0ee759'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:24.993352 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e8131c53-9f25-4d42-b9cf-761d0d0ee759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdb28ea39dab4188b02b498378fe37d6', 'request_id': 'req-e8131c53-9f25-4d42-b9cf-761d0d0ee759'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:25.000076 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e8131c53-9f25-4d42-b9cf-761d0d0ee759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdb28ea39dab4188b02b498378fe37d6', 'request_id': 'req-e8131c53-9f25-4d42-b9cf-761d0d0ee759'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:25.019400 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e8131c53-9f25-4d42-b9cf-761d0d0ee759 admin admin] The token cache is being invalidate because project fdb28ea39dab4188b02b498378fe37d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:38:25.019887 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e8131c53-9f25-4d42-b9cf-761d0d0ee759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:25.024143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e8131c53-9f25-4d42-b9cf-761d0d0ee759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:25.024143 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1302/2614] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:38:24 2022] DELETE /identity/v3/projects/fdb28ea39dab4188b02b498378fe37d6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:38:25.027194 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915a0af-c222-48bf-bfa4-fefeb1ac5a21 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:25.027493 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915a0af-c222-48bf-bfa4-fefeb1ac5a21 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:25.027769 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915a0af-c222-48bf-bfa4-fefeb1ac5a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:25.056875 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-a915a0af-c222-48bf-bfa4-fefeb1ac5a21 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:25.058857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a915a0af-c222-48bf-bfa4-fefeb1ac5a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:25.087960 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:25.162253 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1313/2615] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:38:25.170691 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc5349-de99-444d-95d3-3a2900a47d44 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:25.170962 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc5349-de99-444d-95d3-3a2900a47d44 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:25.171242 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc5349-de99-444d-95d3-3a2900a47d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:25.195053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-36fc5349-de99-444d-95d3-3a2900a47d44 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:25.196481 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-36fc5349-de99-444d-95d3-3a2900a47d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:25.205184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1303/2616] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:38:25.209995 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915a0af-c222-48bf-bfa4-fefeb1ac5a21 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:25.222245 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915a0af-c222-48bf-bfa4-fefeb1ac5a21 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:25.227381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603a09a-bd99-410f-9c29-8e6d8a8944ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:25.228072 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603a09a-bd99-410f-9c29-8e6d8a8944ed admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:25.228429 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603a09a-bd99-410f-9c29-8e6d8a8944ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:25.228774 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603a09a-bd99-410f-9c29-8e6d8a8944ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:25.229545 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603a09a-bd99-410f-9c29-8e6d8a8944ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:38:25.229852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603a09a-bd99-410f-9c29-8e6d8a8944ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:25.231570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603a09a-bd99-410f-9c29-8e6d8a8944ed admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:25.248413 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1314/2617] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:25.254451 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc5349-de99-444d-95d3-3a2900a47d44 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:25.265304 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc5349-de99-444d-95d3-3a2900a47d44 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:25.272461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b7c61-6a03-42ed-a036-9b36b7c863d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:25.273382 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b7c61-6a03-42ed-a036-9b36b7c863d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:25.273902 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b7c61-6a03-42ed-a036-9b36b7c863d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:25.274402 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b7c61-6a03-42ed-a036-9b36b7c863d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:25.275499 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b7c61-6a03-42ed-a036-9b36b7c863d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:25.277975 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b7c61-6a03-42ed-a036-9b36b7c863d3 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:25.318760 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1304/2618] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:38:25 2022] POST /identity/v3/projects => generated 403 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:38:25.323392 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603a09a-bd99-410f-9c29-8e6d8a8944ed admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:25.336070 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603a09a-bd99-410f-9c29-8e6d8a8944ed admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:25.412634 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ce738-a59d-4a75-b1e0-1747108b038b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:25.413212 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ce738-a59d-4a75-b1e0-1747108b038b admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:25.413499 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ce738-a59d-4a75-b1e0-1747108b038b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:25.413779 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ce738-a59d-4a75-b1e0-1747108b038b admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:25.414445 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ce738-a59d-4a75-b1e0-1747108b038b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:25.416430 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ce738-a59d-4a75-b1e0-1747108b038b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:25.442878 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1315/2619] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:38:25 2022] POST /identity/v3/users => generated 302 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:38:25.447125 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b7c61-6a03-42ed-a036-9b36b7c863d3 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:25.460001 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b7c61-6a03-42ed-a036-9b36b7c863d3 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:25.469741 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64c4ce-7ce5-44b0-a154-ad0c4ee08ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:25.471946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64c4ce-7ce5-44b0-a154-ad0c4ee08ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:25.473008 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64c4ce-7ce5-44b0-a154-ad0c4ee08ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:25.476418 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64c4ce-7ce5-44b0-a154-ad0c4ee08ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:25.477965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64c4ce-7ce5-44b0-a154-ad0c4ee08ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:25.481229 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64c4ce-7ce5-44b0-a154-ad0c4ee08ca8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:25.507324 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1305/2620] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:38:25.524755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ce738-a59d-4a75-b1e0-1747108b038b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:25.541517 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ce738-a59d-4a75-b1e0-1747108b038b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:25.548177 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd34b77-15ca-4eec-85c2-c7fc7c66bc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:25.549408 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd34b77-15ca-4eec-85c2-c7fc7c66bc6c admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:25.549686 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd34b77-15ca-4eec-85c2-c7fc7c66bc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:25.550269 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd34b77-15ca-4eec-85c2-c7fc7c66bc6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:25.550938 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd34b77-15ca-4eec-85c2-c7fc7c66bc6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:25.552590 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd34b77-15ca-4eec-85c2-c7fc7c66bc6c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:25.565014 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1316/2621] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:38:25.570426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64c4ce-7ce5-44b0-a154-ad0c4ee08ca8 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:25.585568 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64c4ce-7ce5-44b0-a154-ad0c4ee08ca8 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:25.590385 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efefc9-0f6c-4a36-b0aa-dc6139323040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:25.591346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efefc9-0f6c-4a36-b0aa-dc6139323040 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:25.591881 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efefc9-0f6c-4a36-b0aa-dc6139323040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:25.591881 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efefc9-0f6c-4a36-b0aa-dc6139323040 admin admin] PATH_INFO: `/v3/projects/d21f3404fb4b42c3ac5bf25f6a309486/users/6bba756309174d4bb528f4ca9a4bc5e1/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:25.609507 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efefc9-0f6c-4a36-b0aa-dc6139323040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d21f3404fb4b42c3ac5bf25f6a309486, user_id=6bba756309174d4bb528f4ca9a4bc5e1, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:25.613113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efefc9-0f6c-4a36-b0aa-dc6139323040 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:25.633756 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1306/2622] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:38:25 2022] PUT /identity/v3/projects/d21f3404fb4b42c3ac5bf25f6a309486/users/6bba756309174d4bb528f4ca9a4bc5e1/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:38:25.641492 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ed4ab-ae13-4068-8cd3-59b3c6ff6cf8 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:25.641994 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ed4ab-ae13-4068-8cd3-59b3c6ff6cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:25.643109 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ed4ab-ae13-4068-8cd3-59b3c6ff6cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:25.675579 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-4d4ed4ab-ae13-4068-8cd3-59b3c6ff6cf8 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:25.677626 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4d4ed4ab-ae13-4068-8cd3-59b3c6ff6cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:25.754780 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1317/2623] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:38:25.763247 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efefc9-0f6c-4a36-b0aa-dc6139323040 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:25.765842 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-84efefc9-0f6c-4a36-b0aa-dc6139323040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:25.783635 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:25.844310 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efefc9-0f6c-4a36-b0aa-dc6139323040 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:25.852133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c66714-4878-4a22-9fd2-d0ab48c8c15f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:25.852857 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c66714-4878-4a22-9fd2-d0ab48c8c15f service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:25.853070 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c66714-4878-4a22-9fd2-d0ab48c8c15f service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:25.853373 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c66714-4878-4a22-9fd2-d0ab48c8c15f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:25.865638 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c66714-4878-4a22-9fd2-d0ab48c8c15f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:25.867166 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c66714-4878-4a22-9fd2-d0ab48c8c15f service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:25.878342 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1307/2624] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:38:26.209343 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ed4ab-ae13-4068-8cd3-59b3c6ff6cf8 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:26.211932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-4d4ed4ab-ae13-4068-8cd3-59b3c6ff6cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:26.236023 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ed4ab-ae13-4068-8cd3-59b3c6ff6cf8 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:26.242538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76151246-1870-4f76-8366-91f85622aa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:26.243198 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76151246-1870-4f76-8366-91f85622aa37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:26.243488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76151246-1870-4f76-8366-91f85622aa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:26.243758 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76151246-1870-4f76-8366-91f85622aa37 admin admin] PATH_INFO: `/v3/users/771eb330b52d4f4a9dffb15cc429e965` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:26.245607 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76151246-1870-4f76-8366-91f85622aa37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=771eb330b52d4f4a9dffb15cc429e965)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:26.249927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76151246-1870-4f76-8366-91f85622aa37 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:26.298917 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:26.350371 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-76151246-1870-4f76-8366-91f85622aa37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771eb330b52d4f4a9dffb15cc429e965'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:26.351616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-76151246-1870-4f76-8366-91f85622aa37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771eb330b52d4f4a9dffb15cc429e965'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:26.367802 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-76151246-1870-4f76-8366-91f85622aa37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771eb330b52d4f4a9dffb15cc429e965'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:26.368593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-76151246-1870-4f76-8366-91f85622aa37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771eb330b52d4f4a9dffb15cc429e965'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:26.389045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-76151246-1870-4f76-8366-91f85622aa37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771eb330b52d4f4a9dffb15cc429e965'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:26.405341 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1318/2625] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:38:26 2022] DELETE /identity/v3/users/771eb330b52d4f4a9dffb15cc429e965 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:38:26.413468 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f96ae7-3b7f-498a-b6f0-be7174da8cc4 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:26.414059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f96ae7-3b7f-498a-b6f0-be7174da8cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:26.414814 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f96ae7-3b7f-498a-b6f0-be7174da8cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:26.463024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-35f96ae7-3b7f-498a-b6f0-be7174da8cc4 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:26.465923 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-35f96ae7-3b7f-498a-b6f0-be7174da8cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:26.562904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1308/2626] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:38:26.573982 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76151246-1870-4f76-8366-91f85622aa37 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:26.577948 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-76151246-1870-4f76-8366-91f85622aa37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:26.690035 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76151246-1870-4f76-8366-91f85622aa37 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:26.697509 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1023a-41da-4650-9047-5f411e7aa0b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:26.698526 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1023a-41da-4650-9047-5f411e7aa0b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:26.699031 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1023a-41da-4650-9047-5f411e7aa0b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:26.699565 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1023a-41da-4650-9047-5f411e7aa0b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:26.717626 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1023a-41da-4650-9047-5f411e7aa0b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:26.721647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1023a-41da-4650-9047-5f411e7aa0b0 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:26.740847 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1319/2627] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:38:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:38:26.777694 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2ed88-6a4b-4395-89ad-abcbab698316 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:26.778358 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2ed88-6a4b-4395-89ad-abcbab698316 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:26.779180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2ed88-6a4b-4395-89ad-abcbab698316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:26.815572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-20e2ed88-6a4b-4395-89ad-abcbab698316 None None] MFA Rules not processed for user `6bba756309174d4bb528f4ca9a4bc5e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:26.817839 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-20e2ed88-6a4b-4395-89ad-abcbab698316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:26.946055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1309/2628] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:38:26 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:38:26.951257 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1023a-41da-4650-9047-5f411e7aa0b0 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:26.953940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d5b1023a-41da-4650-9047-5f411e7aa0b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:26.973599 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1023a-41da-4650-9047-5f411e7aa0b0 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:26.979909 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d512730-6633-4830-afb8-aa368cd17753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:26.980999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d512730-6633-4830-afb8-aa368cd17753 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:26.981467 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d512730-6633-4830-afb8-aa368cd17753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:26.981929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d512730-6633-4830-afb8-aa368cd17753 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:26.982902 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d512730-6633-4830-afb8-aa368cd17753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:26.985373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d512730-6633-4830-afb8-aa368cd17753 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:27.037318 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1320/2629] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:38:26 2022] POST /identity/v3/projects => generated 405 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:38:27.041510 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2ed88-6a4b-4395-89ad-abcbab698316 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:27.059310 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2ed88-6a4b-4395-89ad-abcbab698316 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:27.124952 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:27.146556 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfcf3d-3cb1-4a6a-a231-c708e41e0722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:27.147808 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfcf3d-3cb1-4a6a-a231-c708e41e0722 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:27.148544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfcf3d-3cb1-4a6a-a231-c708e41e0722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:27.149078 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfcf3d-3cb1-4a6a-a231-c708e41e0722 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:27.150304 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfcf3d-3cb1-4a6a-a231-c708e41e0722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:27.154297 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfcf3d-3cb1-4a6a-a231-c708e41e0722 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:27.187859 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1310/2630] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:38:27 2022] POST /identity/v3/users => generated 309 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:38:27.193276 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d512730-6633-4830-afb8-aa368cd17753 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:27.197290 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfcf3d-3cb1-4a6a-a231-c708e41e0722 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:27.199854 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-bbcfcf3d-3cb1-4a6a-a231-c708e41e0722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:27.213429 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d512730-6633-4830-afb8-aa368cd17753 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:27.222800 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfcf3d-3cb1-4a6a-a231-c708e41e0722 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:27.229871 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db070652-7996-47af-ad07-e475c85c6196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:27.230532 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db070652-7996-47af-ad07-e475c85c6196 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:27.230811 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db070652-7996-47af-ad07-e475c85c6196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:27.231109 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db070652-7996-47af-ad07-e475c85c6196 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:27.231719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db070652-7996-47af-ad07-e475c85c6196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:27.233472 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db070652-7996-47af-ad07-e475c85c6196 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:27.234103 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d8aca-ec53-435b-8210-4813bee98578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:27.235345 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d8aca-ec53-435b-8210-4813bee98578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:27.235915 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d8aca-ec53-435b-8210-4813bee98578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:27.237152 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d8aca-ec53-435b-8210-4813bee98578 admin admin] PATH_INFO: `/v3/projects/9285b96c0d7544bf9efd333a8cfbe19d` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:27.239355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d8aca-ec53-435b-8210-4813bee98578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9285b96c0d7544bf9efd333a8cfbe19d)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:27.243352 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d8aca-ec53-435b-8210-4813bee98578 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:27.245880 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1321/2631] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:38:27.250181 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db070652-7996-47af-ad07-e475c85c6196 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:27.260535 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db070652-7996-47af-ad07-e475c85c6196 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:27.277378 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8dc6d1-cedc-466d-a6d4-e4c1bc9f9890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:27.278528 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dc6d1-cedc-466d-a6d4-e4c1bc9f9890 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:27.279004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dc6d1-cedc-466d-a6d4-e4c1bc9f9890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:27.279479 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dc6d1-cedc-466d-a6d4-e4c1bc9f9890 admin admin] PATH_INFO: `/v3/projects/94d174cbc1d5499d85dc7fdf5cbd1a2e/users/4bbc9356af0d4ac580bda96b06869d68/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:27.306793 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8dc6d1-cedc-466d-a6d4-e4c1bc9f9890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d174cbc1d5499d85dc7fdf5cbd1a2e, user_id=4bbc9356af0d4ac580bda96b06869d68, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:27.308787 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-af7d8aca-ec53-435b-8210-4813bee98578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9285b96c0d7544bf9efd333a8cfbe19d', 'request_id': 'req-af7d8aca-ec53-435b-8210-4813bee98578'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:27.309644 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8dc6d1-cedc-466d-a6d4-e4c1bc9f9890 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:27.315381 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-af7d8aca-ec53-435b-8210-4813bee98578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9285b96c0d7544bf9efd333a8cfbe19d', 'request_id': 'req-af7d8aca-ec53-435b-8210-4813bee98578'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:27.324981 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1322/2632] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:38:27 2022] PUT /identity/v3/projects/94d174cbc1d5499d85dc7fdf5cbd1a2e/users/4bbc9356af0d4ac580bda96b06869d68/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:38:27.327138 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-af7d8aca-ec53-435b-8210-4813bee98578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9285b96c0d7544bf9efd333a8cfbe19d', 'request_id': 'req-af7d8aca-ec53-435b-8210-4813bee98578'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:27.328858 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8dc6d1-cedc-466d-a6d4-e4c1bc9f9890 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:27.345305 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-af7d8aca-ec53-435b-8210-4813bee98578 admin admin] The token cache is being invalidate because project 9285b96c0d7544bf9efd333a8cfbe19d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:38:27.346545 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-af7d8aca-ec53-435b-8210-4813bee98578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:27.347521 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-af7d8aca-ec53-435b-8210-4813bee98578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:27.349490 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1311/2633] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:38:27 2022] DELETE /identity/v3/projects/9285b96c0d7544bf9efd333a8cfbe19d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:38:27.416429 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:27.436507 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8dc6d1-cedc-466d-a6d4-e4c1bc9f9890 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:27.441936 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440bee1-a5a9-43f6-b2eb-b85f870c78d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:27.442584 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440bee1-a5a9-43f6-b2eb-b85f870c78d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:27.442871 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440bee1-a5a9-43f6-b2eb-b85f870c78d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:27.443147 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440bee1-a5a9-43f6-b2eb-b85f870c78d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:27.443820 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440bee1-a5a9-43f6-b2eb-b85f870c78d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:27.445639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440bee1-a5a9-43f6-b2eb-b85f870c78d0 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:27.458206 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1323/2634] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:38:27.463241 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d8aca-ec53-435b-8210-4813bee98578 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:27.466906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-af7d8aca-ec53-435b-8210-4813bee98578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:27.586332 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d8aca-ec53-435b-8210-4813bee98578 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:27.593688 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439da585-92b8-42ce-9bb4-c05c7f00ac8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:27.595293 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439da585-92b8-42ce-9bb4-c05c7f00ac8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:27.595293 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439da585-92b8-42ce-9bb4-c05c7f00ac8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:27.595852 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439da585-92b8-42ce-9bb4-c05c7f00ac8a admin admin] PATH_INFO: `/v3/projects/94d174cbc1d5499d85dc7fdf5cbd1a2e/users/4bbc9356af0d4ac580bda96b06869d68/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:27.599240 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439da585-92b8-42ce-9bb4-c05c7f00ac8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d174cbc1d5499d85dc7fdf5cbd1a2e, user_id=4bbc9356af0d4ac580bda96b06869d68, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:27.604476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439da585-92b8-42ce-9bb4-c05c7f00ac8a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:27.627466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1312/2635] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:38:27 2022] PUT /identity/v3/projects/94d174cbc1d5499d85dc7fdf5cbd1a2e/users/4bbc9356af0d4ac580bda96b06869d68/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:38:28.496271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6956db-e25f-4475-9536-717a4a9301eb None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:28.497041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6956db-e25f-4475-9536-717a4a9301eb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:28.497041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6956db-e25f-4475-9536-717a4a9301eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:28.533314 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9c6956db-e25f-4475-9536-717a4a9301eb None None] MFA Rules not processed for user `4bbc9356af0d4ac580bda96b06869d68`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:28.534945 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9c6956db-e25f-4475-9536-717a4a9301eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:28.628892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1324/2636] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:38:28 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:38:29.849313 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439da585-92b8-42ce-9bb4-c05c7f00ac8a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:29.932406 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:29.950980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439da585-92b8-42ce-9bb4-c05c7f00ac8a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:29.959099 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf0c2d-9673-41da-95b1-ec9ea2ea36e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:29.960200 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf0c2d-9673-41da-95b1-ec9ea2ea36e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:29.960753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf0c2d-9673-41da-95b1-ec9ea2ea36e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:29.961277 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf0c2d-9673-41da-95b1-ec9ea2ea36e7 admin admin] PATH_INFO: `/v3/users/6bba756309174d4bb528f4ca9a4bc5e1` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:29.963366 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf0c2d-9673-41da-95b1-ec9ea2ea36e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bba756309174d4bb528f4ca9a4bc5e1)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:29.967580 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf0c2d-9673-41da-95b1-ec9ea2ea36e7 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:30.023298 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e8cf0c2d-9673-41da-95b1-ec9ea2ea36e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bba756309174d4bb528f4ca9a4bc5e1'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:30.023981 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e8cf0c2d-9673-41da-95b1-ec9ea2ea36e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bba756309174d4bb528f4ca9a4bc5e1'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:30.031377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e8cf0c2d-9673-41da-95b1-ec9ea2ea36e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bba756309174d4bb528f4ca9a4bc5e1'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:30.032063 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e8cf0c2d-9673-41da-95b1-ec9ea2ea36e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bba756309174d4bb528f4ca9a4bc5e1'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:30.041064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-e8cf0c2d-9673-41da-95b1-ec9ea2ea36e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bba756309174d4bb528f4ca9a4bc5e1'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:30.064258 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1313/2637] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:38:29 2022] DELETE /identity/v3/users/6bba756309174d4bb528f4ca9a4bc5e1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:38:30.263629 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6956db-e25f-4475-9536-717a4a9301eb None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:30.276413 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6956db-e25f-4475-9536-717a4a9301eb None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:30.344073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba13d9-a5f7-407b-9cf1-1a2c23d9fa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:30.344814 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba13d9-a5f7-407b-9cf1-1a2c23d9fa0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:30.345108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba13d9-a5f7-407b-9cf1-1a2c23d9fa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:30.345375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba13d9-a5f7-407b-9cf1-1a2c23d9fa0a admin admin] PATH_INFO: `/v3/projects/d21f3404fb4b42c3ac5bf25f6a309486` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:30.347589 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba13d9-a5f7-407b-9cf1-1a2c23d9fa0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d21f3404fb4b42c3ac5bf25f6a309486)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:30.349574 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba13d9-a5f7-407b-9cf1-1a2c23d9fa0a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:30.403437 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0fba13d9-a5f7-407b-9cf1-1a2c23d9fa0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd21f3404fb4b42c3ac5bf25f6a309486', 'request_id': 'req-0fba13d9-a5f7-407b-9cf1-1a2c23d9fa0a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:30.413433 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0fba13d9-a5f7-407b-9cf1-1a2c23d9fa0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd21f3404fb4b42c3ac5bf25f6a309486', 'request_id': 'req-0fba13d9-a5f7-407b-9cf1-1a2c23d9fa0a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:30.420674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0fba13d9-a5f7-407b-9cf1-1a2c23d9fa0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd21f3404fb4b42c3ac5bf25f6a309486', 'request_id': 'req-0fba13d9-a5f7-407b-9cf1-1a2c23d9fa0a'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:30.429426 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:30.434195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0fba13d9-a5f7-407b-9cf1-1a2c23d9fa0a admin admin] The token cache is being invalidate because project d21f3404fb4b42c3ac5bf25f6a309486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:38:30.434490 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0fba13d9-a5f7-407b-9cf1-1a2c23d9fa0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:30.435246 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-0fba13d9-a5f7-407b-9cf1-1a2c23d9fa0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:30.437596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1325/2638] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:38:30 2022] DELETE /identity/v3/projects/d21f3404fb4b42c3ac5bf25f6a309486 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:38:30.442142 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf0c2d-9673-41da-95b1-ec9ea2ea36e7 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:30.443701 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-e8cf0c2d-9673-41da-95b1-ec9ea2ea36e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:30.467466 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf0c2d-9673-41da-95b1-ec9ea2ea36e7 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:30.555726 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d140211-c1d3-42c1-a65e-470e67dbedea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:30.556885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d140211-c1d3-42c1-a65e-470e67dbedea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:30.557368 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d140211-c1d3-42c1-a65e-470e67dbedea admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:30.557851 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d140211-c1d3-42c1-a65e-470e67dbedea admin admin] PATH_INFO: `/v3/users/4bbc9356af0d4ac580bda96b06869d68` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:30.559919 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d140211-c1d3-42c1-a65e-470e67dbedea admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bbc9356af0d4ac580bda96b06869d68)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:30.563839 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d140211-c1d3-42c1-a65e-470e67dbedea admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:30.631615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-4d140211-c1d3-42c1-a65e-470e67dbedea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bbc9356af0d4ac580bda96b06869d68'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:30.632445 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-4d140211-c1d3-42c1-a65e-470e67dbedea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bbc9356af0d4ac580bda96b06869d68'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:30.641719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-4d140211-c1d3-42c1-a65e-470e67dbedea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bbc9356af0d4ac580bda96b06869d68'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:30.642683 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-4d140211-c1d3-42c1-a65e-470e67dbedea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bbc9356af0d4ac580bda96b06869d68'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:30.652012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-4d140211-c1d3-42c1-a65e-470e67dbedea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bbc9356af0d4ac580bda96b06869d68'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:30.662435 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:30.682214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1314/2639] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:38:30 2022] DELETE /identity/v3/users/4bbc9356af0d4ac580bda96b06869d68 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:38:30.886086 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba13d9-a5f7-407b-9cf1-1a2c23d9fa0a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:30.887798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0fba13d9-a5f7-407b-9cf1-1a2c23d9fa0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:30.904369 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba13d9-a5f7-407b-9cf1-1a2c23d9fa0a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:30.982440 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972322d0-a981-415b-b52c-6197ceff3907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:30.983354 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972322d0-a981-415b-b52c-6197ceff3907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:30.983639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972322d0-a981-415b-b52c-6197ceff3907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:30.983921 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972322d0-a981-415b-b52c-6197ceff3907 admin admin] PATH_INFO: `/v3/projects/94d174cbc1d5499d85dc7fdf5cbd1a2e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:30.985135 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972322d0-a981-415b-b52c-6197ceff3907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d174cbc1d5499d85dc7fdf5cbd1a2e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:30.987470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972322d0-a981-415b-b52c-6197ceff3907 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:31.056645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-972322d0-a981-415b-b52c-6197ceff3907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d174cbc1d5499d85dc7fdf5cbd1a2e', 'request_id': 'req-972322d0-a981-415b-b52c-6197ceff3907'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:31.070676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-972322d0-a981-415b-b52c-6197ceff3907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d174cbc1d5499d85dc7fdf5cbd1a2e', 'request_id': 'req-972322d0-a981-415b-b52c-6197ceff3907'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:31.081498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-972322d0-a981-415b-b52c-6197ceff3907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d174cbc1d5499d85dc7fdf5cbd1a2e', 'request_id': 'req-972322d0-a981-415b-b52c-6197ceff3907'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:31.102408 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-972322d0-a981-415b-b52c-6197ceff3907 admin admin] The token cache is being invalidate because project 94d174cbc1d5499d85dc7fdf5cbd1a2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:38:31.102920 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-972322d0-a981-415b-b52c-6197ceff3907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:31.103999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-972322d0-a981-415b-b52c-6197ceff3907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:38:31.106502 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1326/2640] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:38:30 2022] DELETE /identity/v3/projects/94d174cbc1d5499d85dc7fdf5cbd1a2e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:38:31.114441 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e072c0c-702c-4d69-916c-68e3f8f35049 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:31.114958 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e072c0c-702c-4d69-916c-68e3f8f35049 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:31.115416 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e072c0c-702c-4d69-916c-68e3f8f35049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:31.156623 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9e072c0c-702c-4d69-916c-68e3f8f35049 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:31.158785 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9e072c0c-702c-4d69-916c-68e3f8f35049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:31.229583 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1315/2641] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:38:31.238765 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32fb5f-0187-49e8-b189-aef0d0a332fd None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:31.238996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32fb5f-0187-49e8-b189-aef0d0a332fd None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:31.239228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32fb5f-0187-49e8-b189-aef0d0a332fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:31.260954 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-aa32fb5f-0187-49e8-b189-aef0d0a332fd None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:31.262199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-aa32fb5f-0187-49e8-b189-aef0d0a332fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:31.271248 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1327/2642] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:38:31.275469 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e072c0c-702c-4d69-916c-68e3f8f35049 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:31.286768 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e072c0c-702c-4d69-916c-68e3f8f35049 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:31.291624 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a81da-0ea9-4f39-af51-0759ba21180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:31.292337 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a81da-0ea9-4f39-af51-0759ba21180b admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:31.292671 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a81da-0ea9-4f39-af51-0759ba21180b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:31.293047 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a81da-0ea9-4f39-af51-0759ba21180b admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:31.293795 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a81da-0ea9-4f39-af51-0759ba21180b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:38:31.294184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a81da-0ea9-4f39-af51-0759ba21180b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:31.295917 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a81da-0ea9-4f39-af51-0759ba21180b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:31.310184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1316/2643] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:31.316104 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32fb5f-0187-49e8-b189-aef0d0a332fd None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:31.325961 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32fb5f-0187-49e8-b189-aef0d0a332fd None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:31.334144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8a78a-463e-4005-a565-e724b4cc1796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:31.334795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8a78a-463e-4005-a565-e724b4cc1796 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:31.335080 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8a78a-463e-4005-a565-e724b4cc1796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:31.335356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8a78a-463e-4005-a565-e724b4cc1796 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:31.336004 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8a78a-463e-4005-a565-e724b4cc1796 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:31.337979 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8a78a-463e-4005-a565-e724b4cc1796 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:31.369727 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1328/2644] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:38:31 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:38:31.374499 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a81da-0ea9-4f39-af51-0759ba21180b admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:31.387266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a81da-0ea9-4f39-af51-0759ba21180b admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:31.457710 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a6875-a1cd-4e44-b583-fe420272924b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:31.458347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a6875-a1cd-4e44-b583-fe420272924b admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:31.458633 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a6875-a1cd-4e44-b583-fe420272924b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:31.458913 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a6875-a1cd-4e44-b583-fe420272924b admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:31.459552 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a6875-a1cd-4e44-b583-fe420272924b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:31.461578 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a6875-a1cd-4e44-b583-fe420272924b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:31.489787 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1317/2645] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:38:31 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:38:31.493941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8a78a-463e-4005-a565-e724b4cc1796 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:31.504872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8a78a-463e-4005-a565-e724b4cc1796 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:31.509825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99e0cc-8dd1-4fe9-b14b-66efa8d0351e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:31.510446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99e0cc-8dd1-4fe9-b14b-66efa8d0351e admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:31.510730 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99e0cc-8dd1-4fe9-b14b-66efa8d0351e admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:31.511012 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99e0cc-8dd1-4fe9-b14b-66efa8d0351e admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:31.511708 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99e0cc-8dd1-4fe9-b14b-66efa8d0351e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:31.513384 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99e0cc-8dd1-4fe9-b14b-66efa8d0351e admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:31.527846 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1329/2646] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:38:31.532735 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a6875-a1cd-4e44-b583-fe420272924b admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:31.544796 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a6875-a1cd-4e44-b583-fe420272924b admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:31.552492 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff3187-1c64-46b1-817c-0313e20b4d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:31.553158 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff3187-1c64-46b1-817c-0313e20b4d74 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:31.553438 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff3187-1c64-46b1-817c-0313e20b4d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:31.553712 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff3187-1c64-46b1-817c-0313e20b4d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:31.554394 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff3187-1c64-46b1-817c-0313e20b4d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:31.556037 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff3187-1c64-46b1-817c-0313e20b4d74 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:31.567506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1318/2647] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:38:31.571885 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99e0cc-8dd1-4fe9-b14b-66efa8d0351e admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:31.582810 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99e0cc-8dd1-4fe9-b14b-66efa8d0351e admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:31.587723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b3c17-7702-466b-b42c-ef0e146cf182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:31.588422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b3c17-7702-466b-b42c-ef0e146cf182 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:31.588734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b3c17-7702-466b-b42c-ef0e146cf182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:31.589012 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b3c17-7702-466b-b42c-ef0e146cf182 admin admin] PATH_INFO: `/v3/projects/682401a809ff4ec6be8f2c14688cbead/users/e4a767a1415a48e8ab1b9afe415ccfff/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:31.606171 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b3c17-7702-466b-b42c-ef0e146cf182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=682401a809ff4ec6be8f2c14688cbead, user_id=e4a767a1415a48e8ab1b9afe415ccfff, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:31.609458 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b3c17-7702-466b-b42c-ef0e146cf182 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:31.625093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1330/2648] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:38:31 2022] PUT /identity/v3/projects/682401a809ff4ec6be8f2c14688cbead/users/e4a767a1415a48e8ab1b9afe415ccfff/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:38:31.642967 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49a05d-b8c5-4460-bf8d-128ffbfe2385 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:31.643522 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49a05d-b8c5-4460-bf8d-128ffbfe2385 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:31.643978 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49a05d-b8c5-4460-bf8d-128ffbfe2385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:31.692342 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-ba49a05d-b8c5-4460-bf8d-128ffbfe2385 None None] MFA Rules not processed for user `e4a767a1415a48e8ab1b9afe415ccfff`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:31.693617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ba49a05d-b8c5-4460-bf8d-128ffbfe2385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:31.771737 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:31.812755 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1319/2649] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:38:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:38:31.820125 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b3c17-7702-466b-b42c-ef0e146cf182 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:31.887461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:31.956326 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b3c17-7702-466b-b42c-ef0e146cf182 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:31.962741 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5a76e-452a-4237-9dd6-ce30407f6901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:31.964473 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5a76e-452a-4237-9dd6-ce30407f6901 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:31.964473 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5a76e-452a-4237-9dd6-ce30407f6901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:31.964473 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5a76e-452a-4237-9dd6-ce30407f6901 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:31.964992 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5a76e-452a-4237-9dd6-ce30407f6901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:31.967270 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5a76e-452a-4237-9dd6-ce30407f6901 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:32.003102 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1331/2650] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:38:31 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:38:32.004626 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49a05d-b8c5-4460-bf8d-128ffbfe2385 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:32.016941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49a05d-b8c5-4460-bf8d-128ffbfe2385 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:32.113641 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7706984-40a1-427d-8ec8-08b23bd9f7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:32.114282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7706984-40a1-427d-8ec8-08b23bd9f7e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:32.114573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7706984-40a1-427d-8ec8-08b23bd9f7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:32.115536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7706984-40a1-427d-8ec8-08b23bd9f7e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:32.115536 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7706984-40a1-427d-8ec8-08b23bd9f7e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:32.117632 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7706984-40a1-427d-8ec8-08b23bd9f7e0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:32.144777 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1320/2651] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:38:32 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:38:32.150276 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5a76e-452a-4237-9dd6-ce30407f6901 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:32.162884 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5a76e-452a-4237-9dd6-ce30407f6901 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:32.168242 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d183d6e-d279-48ff-b8ab-d90347e7290f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:32.169107 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d183d6e-d279-48ff-b8ab-d90347e7290f admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:32.169492 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d183d6e-d279-48ff-b8ab-d90347e7290f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:32.169873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d183d6e-d279-48ff-b8ab-d90347e7290f admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:32.170703 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d183d6e-d279-48ff-b8ab-d90347e7290f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:32.172497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d183d6e-d279-48ff-b8ab-d90347e7290f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:32.191942 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1332/2652] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:38:32.195889 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7706984-40a1-427d-8ec8-08b23bd9f7e0 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:32.217495 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7706984-40a1-427d-8ec8-08b23bd9f7e0 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:32.226087 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca381aa-9ecd-427c-8650-dbdff6aa7d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:32.227357 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca381aa-9ecd-427c-8650-dbdff6aa7d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:32.227875 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca381aa-9ecd-427c-8650-dbdff6aa7d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:32.228387 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca381aa-9ecd-427c-8650-dbdff6aa7d47 admin admin] PATH_INFO: `/v3/projects/4e35ed5245514e358883d46ec2e8bfbe/users/ed6f339292ed48b09514b3df3fce5800/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:32.260314 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca381aa-9ecd-427c-8650-dbdff6aa7d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e35ed5245514e358883d46ec2e8bfbe, user_id=ed6f339292ed48b09514b3df3fce5800, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:32.265493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca381aa-9ecd-427c-8650-dbdff6aa7d47 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:32.287270 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1321/2653] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:38:32 2022] PUT /identity/v3/projects/4e35ed5245514e358883d46ec2e8bfbe/users/ed6f339292ed48b09514b3df3fce5800/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:38:32.291146 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d183d6e-d279-48ff-b8ab-d90347e7290f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:32.301864 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d183d6e-d279-48ff-b8ab-d90347e7290f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:32.385982 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7a144-02b0-441b-af53-b53807764fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:32.387140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7a144-02b0-441b-af53-b53807764fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:32.387756 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7a144-02b0-441b-af53-b53807764fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:32.388370 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7a144-02b0-441b-af53-b53807764fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:32.389744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7a144-02b0-441b-af53-b53807764fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:32.392111 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7a144-02b0-441b-af53-b53807764fd9 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:32.408777 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1333/2654] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:38:32.414418 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca381aa-9ecd-427c-8650-dbdff6aa7d47 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:32.431052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca381aa-9ecd-427c-8650-dbdff6aa7d47 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:32.436799 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2de05-9450-4c2f-9c6d-4764be5cc085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:32.437562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2de05-9450-4c2f-9c6d-4764be5cc085 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:32.437888 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2de05-9450-4c2f-9c6d-4764be5cc085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:32.439297 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2de05-9450-4c2f-9c6d-4764be5cc085 admin admin] PATH_INFO: `/v3/projects/4e35ed5245514e358883d46ec2e8bfbe/users/ed6f339292ed48b09514b3df3fce5800/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:32.441801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2de05-9450-4c2f-9c6d-4764be5cc085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e35ed5245514e358883d46ec2e8bfbe, user_id=ed6f339292ed48b09514b3df3fce5800, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:32.444109 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2de05-9450-4c2f-9c6d-4764be5cc085 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:32.459206 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1322/2655] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:38:32 2022] PUT /identity/v3/projects/4e35ed5245514e358883d46ec2e8bfbe/users/ed6f339292ed48b09514b3df3fce5800/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:38:32.472123 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9584f35-0d6d-4be2-ba94-eb2fb4eccea5 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:32.472766 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9584f35-0d6d-4be2-ba94-eb2fb4eccea5 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:32.473640 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9584f35-0d6d-4be2-ba94-eb2fb4eccea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:32.529594 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-c9584f35-0d6d-4be2-ba94-eb2fb4eccea5 None None] MFA Rules not processed for user `ed6f339292ed48b09514b3df3fce5800`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:32.531950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c9584f35-0d6d-4be2-ba94-eb2fb4eccea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:32.623747 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1334/2656] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:38:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:38:32.636924 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2de05-9450-4c2f-9c6d-4764be5cc085 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:32.639270 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5ee2de05-9450-4c2f-9c6d-4764be5cc085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:32.706730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2de05-9450-4c2f-9c6d-4764be5cc085 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:32.710833 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82e1bb-5d5b-4ee4-bef3-fc5287ff10b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:32.711479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82e1bb-5d5b-4ee4-bef3-fc5287ff10b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:32.711766 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82e1bb-5d5b-4ee4-bef3-fc5287ff10b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:32.712050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82e1bb-5d5b-4ee4-bef3-fc5287ff10b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:32.724441 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82e1bb-5d5b-4ee4-bef3-fc5287ff10b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:32.726003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82e1bb-5d5b-4ee4-bef3-fc5287ff10b9 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:32.737979 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1323/2657] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:38:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:38:32.844719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9584f35-0d6d-4be2-ba94-eb2fb4eccea5 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:32.856115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9584f35-0d6d-4be2-ba94-eb2fb4eccea5 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:32.860593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08324cd2-c8d7-451e-86d7-c347f6091dca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:32.861962 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08324cd2-c8d7-451e-86d7-c347f6091dca service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:32.862303 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08324cd2-c8d7-451e-86d7-c347f6091dca service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:32.862580 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08324cd2-c8d7-451e-86d7-c347f6091dca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:32.884639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:32.947201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08324cd2-c8d7-451e-86d7-c347f6091dca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:32.948901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08324cd2-c8d7-451e-86d7-c347f6091dca service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:32.964676 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1335/2658] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:38:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:38:42.732089 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=77,keystone:INSERT=5 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:42.957137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=19 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:02.709190 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82e1bb-5d5b-4ee4-bef3-fc5287ff10b9 service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:02.773610 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82e1bb-5d5b-4ee4-bef3-fc5287ff10b9 service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:02.778231 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa035bf-5b4f-42f3-92ad-c065753e27ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:02.778871 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa035bf-5b4f-42f3-92ad-c065753e27ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:02.779158 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa035bf-5b4f-42f3-92ad-c065753e27ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:02.779439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa035bf-5b4f-42f3-92ad-c065753e27ca admin admin] PATH_INFO: `/v3/users/e4a767a1415a48e8ab1b9afe415ccfff` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:02.780583 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa035bf-5b4f-42f3-92ad-c065753e27ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4a767a1415a48e8ab1b9afe415ccfff)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:02.783171 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa035bf-5b4f-42f3-92ad-c065753e27ca admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:02.831269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3aa035bf-5b4f-42f3-92ad-c065753e27ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4a767a1415a48e8ab1b9afe415ccfff'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:02.831965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3aa035bf-5b4f-42f3-92ad-c065753e27ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4a767a1415a48e8ab1b9afe415ccfff'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:02.840024 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3aa035bf-5b4f-42f3-92ad-c065753e27ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4a767a1415a48e8ab1b9afe415ccfff'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:02.840785 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3aa035bf-5b4f-42f3-92ad-c065753e27ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4a767a1415a48e8ab1b9afe415ccfff'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:02.849608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-3aa035bf-5b4f-42f3-92ad-c065753e27ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4a767a1415a48e8ab1b9afe415ccfff'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:02.867533 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1324/2659] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:39:02 2022] DELETE /identity/v3/users/e4a767a1415a48e8ab1b9afe415ccfff => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:02.872021 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc4480-90a6-4b8d-ba91-c10fb9ae4240 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:02.872551 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc4480-90a6-4b8d-ba91-c10fb9ae4240 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:02.872657 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc4480-90a6-4b8d-ba91-c10fb9ae4240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:02.891515 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-55cc4480-90a6-4b8d-ba91-c10fb9ae4240 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:02.893042 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-55cc4480-90a6-4b8d-ba91-c10fb9ae4240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:02.952479 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1336/2660] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:39:02.962319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa035bf-5b4f-42f3-92ad-c065753e27ca admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:02.963762 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-3aa035bf-5b4f-42f3-92ad-c065753e27ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:03.021731 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa035bf-5b4f-42f3-92ad-c065753e27ca admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:03.025420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24919bb7-0842-4f2d-9e61-91dd8a555cd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:03.026028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24919bb7-0842-4f2d-9e61-91dd8a555cd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:03.026309 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24919bb7-0842-4f2d-9e61-91dd8a555cd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:03.026583 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24919bb7-0842-4f2d-9e61-91dd8a555cd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:03.036045 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24919bb7-0842-4f2d-9e61-91dd8a555cd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:03.037507 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24919bb7-0842-4f2d-9e61-91dd8a555cd4 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:03.046844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1325/2661] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:39:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:39:03.324437 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc4480-90a6-4b8d-ba91-c10fb9ae4240 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:03.326273 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-55cc4480-90a6-4b8d-ba91-c10fb9ae4240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:03.339697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc4480-90a6-4b8d-ba91-c10fb9ae4240 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:03.344658 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dac8c-9db3-4164-ac63-c831fad28b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:03.346339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dac8c-9db3-4164-ac63-c831fad28b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:03.346727 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dac8c-9db3-4164-ac63-c831fad28b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:03.347009 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dac8c-9db3-4164-ac63-c831fad28b9f admin admin] PATH_INFO: `/v3/projects/682401a809ff4ec6be8f2c14688cbead` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:03.348603 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dac8c-9db3-4164-ac63-c831fad28b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=682401a809ff4ec6be8f2c14688cbead)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:03.351286 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dac8c-9db3-4164-ac63-c831fad28b9f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:03.399405 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-627dac8c-9db3-4164-ac63-c831fad28b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '682401a809ff4ec6be8f2c14688cbead', 'request_id': 'req-627dac8c-9db3-4164-ac63-c831fad28b9f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:03.406874 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-627dac8c-9db3-4164-ac63-c831fad28b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '682401a809ff4ec6be8f2c14688cbead', 'request_id': 'req-627dac8c-9db3-4164-ac63-c831fad28b9f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:03.413451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-627dac8c-9db3-4164-ac63-c831fad28b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '682401a809ff4ec6be8f2c14688cbead', 'request_id': 'req-627dac8c-9db3-4164-ac63-c831fad28b9f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:03.424974 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-627dac8c-9db3-4164-ac63-c831fad28b9f admin admin] The token cache is being invalidate because project 682401a809ff4ec6be8f2c14688cbead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:39:03.425274 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-627dac8c-9db3-4164-ac63-c831fad28b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:03.425944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-627dac8c-9db3-4164-ac63-c831fad28b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:03.427462 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1337/2662] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:39:03 2022] DELETE /identity/v3/projects/682401a809ff4ec6be8f2c14688cbead => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:03.431420 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24919bb7-0842-4f2d-9e61-91dd8a555cd4 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:03.446619 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24919bb7-0842-4f2d-9e61-91dd8a555cd4 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:03.465666 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:03.518141 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364c5b1-f3fb-4626-9151-c3e570e0c9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:03.518962 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364c5b1-f3fb-4626-9151-c3e570e0c9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:03.519249 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364c5b1-f3fb-4626-9151-c3e570e0c9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:03.519558 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364c5b1-f3fb-4626-9151-c3e570e0c9a6 admin admin] PATH_INFO: `/v3/users/ed6f339292ed48b09514b3df3fce5800` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:03.520793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364c5b1-f3fb-4626-9151-c3e570e0c9a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed6f339292ed48b09514b3df3fce5800)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:03.522753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364c5b1-f3fb-4626-9151-c3e570e0c9a6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:03.570432 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8364c5b1-f3fb-4626-9151-c3e570e0c9a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed6f339292ed48b09514b3df3fce5800'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:03.571079 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8364c5b1-f3fb-4626-9151-c3e570e0c9a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed6f339292ed48b09514b3df3fce5800'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:03.578195 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8364c5b1-f3fb-4626-9151-c3e570e0c9a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed6f339292ed48b09514b3df3fce5800'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:03.578844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8364c5b1-f3fb-4626-9151-c3e570e0c9a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed6f339292ed48b09514b3df3fce5800'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:03.587608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-8364c5b1-f3fb-4626-9151-c3e570e0c9a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed6f339292ed48b09514b3df3fce5800'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:03.605707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1326/2663] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:39:03 2022] DELETE /identity/v3/users/ed6f339292ed48b09514b3df3fce5800 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:03.894162 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dac8c-9db3-4164-ac63-c831fad28b9f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:03.895699 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-627dac8c-9db3-4164-ac63-c831fad28b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:03.909663 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dac8c-9db3-4164-ac63-c831fad28b9f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:03.967583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa0f18-13ba-4e3c-bab3-b6ed4ab57be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:03.968138 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa0f18-13ba-4e3c-bab3-b6ed4ab57be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:03.968425 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa0f18-13ba-4e3c-bab3-b6ed4ab57be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:03.968729 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa0f18-13ba-4e3c-bab3-b6ed4ab57be4 admin admin] PATH_INFO: `/v3/projects/4e35ed5245514e358883d46ec2e8bfbe` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:03.969864 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa0f18-13ba-4e3c-bab3-b6ed4ab57be4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e35ed5245514e358883d46ec2e8bfbe)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:03.972422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa0f18-13ba-4e3c-bab3-b6ed4ab57be4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:04.002829 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:04.020893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-30aa0f18-13ba-4e3c-bab3-b6ed4ab57be4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e35ed5245514e358883d46ec2e8bfbe', 'request_id': 'req-30aa0f18-13ba-4e3c-bab3-b6ed4ab57be4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:04.028231 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-30aa0f18-13ba-4e3c-bab3-b6ed4ab57be4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e35ed5245514e358883d46ec2e8bfbe', 'request_id': 'req-30aa0f18-13ba-4e3c-bab3-b6ed4ab57be4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:04.034633 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-30aa0f18-13ba-4e3c-bab3-b6ed4ab57be4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e35ed5245514e358883d46ec2e8bfbe', 'request_id': 'req-30aa0f18-13ba-4e3c-bab3-b6ed4ab57be4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:04.045603 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-30aa0f18-13ba-4e3c-bab3-b6ed4ab57be4 admin admin] The token cache is being invalidate because project 4e35ed5245514e358883d46ec2e8bfbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:39:04.045899 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-30aa0f18-13ba-4e3c-bab3-b6ed4ab57be4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:04.046537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-30aa0f18-13ba-4e3c-bab3-b6ed4ab57be4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:04.048070 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1338/2664] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:39:03 2022] DELETE /identity/v3/projects/4e35ed5245514e358883d46ec2e8bfbe => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:39:04.053148 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4793d-b774-4db3-9271-16b7448ca2d9 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:04.053623 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4793d-b774-4db3-9271-16b7448ca2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:04.053720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4793d-b774-4db3-9271-16b7448ca2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:04.073255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-60b4793d-b774-4db3-9271-16b7448ca2d9 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:04.074467 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-60b4793d-b774-4db3-9271-16b7448ca2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:04.137141 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1327/2665] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:39:04.145595 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac2f3f-7f68-453c-bfaa-81c1f3256646 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:04.145888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac2f3f-7f68-453c-bfaa-81c1f3256646 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:04.146172 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac2f3f-7f68-453c-bfaa-81c1f3256646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:04.166516 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6eac2f3f-7f68-453c-bfaa-81c1f3256646 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:04.167743 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6eac2f3f-7f68-453c-bfaa-81c1f3256646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:04.175774 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1339/2666] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:39:04.180060 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4793d-b774-4db3-9271-16b7448ca2d9 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:04.189969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4793d-b774-4db3-9271-16b7448ca2d9 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:04.194596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee36265-8ce7-45e9-a1f2-641840375ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:04.195226 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee36265-8ce7-45e9-a1f2-641840375ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:04.195506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee36265-8ce7-45e9-a1f2-641840375ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:04.195778 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee36265-8ce7-45e9-a1f2-641840375ae0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:04.196424 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee36265-8ce7-45e9-a1f2-641840375ae0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:04.196755 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee36265-8ce7-45e9-a1f2-641840375ae0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:04.198365 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee36265-8ce7-45e9-a1f2-641840375ae0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:04.210531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1328/2667] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:04.214901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac2f3f-7f68-453c-bfaa-81c1f3256646 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:04.225413 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac2f3f-7f68-453c-bfaa-81c1f3256646 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:04.229984 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfe132-ed13-4ee8-9ba4-c8f46b4f15dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:04.230582 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfe132-ed13-4ee8-9ba4-c8f46b4f15dd admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:04.230869 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfe132-ed13-4ee8-9ba4-c8f46b4f15dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:04.231142 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfe132-ed13-4ee8-9ba4-c8f46b4f15dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:04.231762 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfe132-ed13-4ee8-9ba4-c8f46b4f15dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:04.233710 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfe132-ed13-4ee8-9ba4-c8f46b4f15dd admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:04.261690 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1340/2668] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:39:04 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:04.265925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee36265-8ce7-45e9-a1f2-641840375ae0 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:04.276924 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee36265-8ce7-45e9-a1f2-641840375ae0 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:04.304543 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:04.338751 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069202d0-8ad2-4395-a3ae-0e85608789cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:04.339370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069202d0-8ad2-4395-a3ae-0e85608789cf admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:04.339654 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069202d0-8ad2-4395-a3ae-0e85608789cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:04.339934 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069202d0-8ad2-4395-a3ae-0e85608789cf admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:04.340566 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069202d0-8ad2-4395-a3ae-0e85608789cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:04.342808 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069202d0-8ad2-4395-a3ae-0e85608789cf admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:04.363980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1329/2669] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:39:04 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:04.368142 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfe132-ed13-4ee8-9ba4-c8f46b4f15dd admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:04.379373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfe132-ed13-4ee8-9ba4-c8f46b4f15dd admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:04.384156 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52423c-bf05-44fb-a04e-aebb7a9329f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:04.384863 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52423c-bf05-44fb-a04e-aebb7a9329f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:04.385169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52423c-bf05-44fb-a04e-aebb7a9329f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:04.385583 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52423c-bf05-44fb-a04e-aebb7a9329f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:04.386297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52423c-bf05-44fb-a04e-aebb7a9329f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:04.387943 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52423c-bf05-44fb-a04e-aebb7a9329f0 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:04.398979 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1341/2670] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:39:04.403216 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069202d0-8ad2-4395-a3ae-0e85608789cf admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:04.413515 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069202d0-8ad2-4395-a3ae-0e85608789cf admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:04.418217 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d22a1-c9bb-4b26-8174-6721d55734bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:04.418831 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d22a1-c9bb-4b26-8174-6721d55734bf admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:04.419121 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d22a1-c9bb-4b26-8174-6721d55734bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:04.419402 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d22a1-c9bb-4b26-8174-6721d55734bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:04.420065 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d22a1-c9bb-4b26-8174-6721d55734bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:04.421689 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d22a1-c9bb-4b26-8174-6721d55734bf admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:04.432588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1330/2671] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:39:04.436868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52423c-bf05-44fb-a04e-aebb7a9329f0 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:04.447901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52423c-bf05-44fb-a04e-aebb7a9329f0 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:04.452938 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15efcc-dccf-4418-9b34-0bf1c7258c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:04.453603 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15efcc-dccf-4418-9b34-0bf1c7258c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:04.453884 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15efcc-dccf-4418-9b34-0bf1c7258c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:04.454178 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15efcc-dccf-4418-9b34-0bf1c7258c5a admin admin] PATH_INFO: `/v3/projects/11ba6649fc2645afafb63b3c468146c7/users/70765307f07644bbaf41c17b36baa08f/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:04.471195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15efcc-dccf-4418-9b34-0bf1c7258c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ba6649fc2645afafb63b3c468146c7, user_id=70765307f07644bbaf41c17b36baa08f, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:04.478203 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15efcc-dccf-4418-9b34-0bf1c7258c5a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:04.496360 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1342/2672] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:39:04 2022] PUT /identity/v3/projects/11ba6649fc2645afafb63b3c468146c7/users/70765307f07644bbaf41c17b36baa08f/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:04.509661 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269f07c-a93e-4e82-b8b7-5b5af4aeec0a None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:04.509954 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269f07c-a93e-4e82-b8b7-5b5af4aeec0a None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:04.510238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269f07c-a93e-4e82-b8b7-5b5af4aeec0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:04.540188 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-2269f07c-a93e-4e82-b8b7-5b5af4aeec0a None None] MFA Rules not processed for user `70765307f07644bbaf41c17b36baa08f`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:04.541495 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2269f07c-a93e-4e82-b8b7-5b5af4aeec0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:04.614596 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1331/2673] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:39:04.619270 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15efcc-dccf-4418-9b34-0bf1c7258c5a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:04.680181 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15efcc-dccf-4418-9b34-0bf1c7258c5a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:04.684855 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b9e06-31e3-4268-9f79-4a6236d932fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:04.685456 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9e06-31e3-4268-9f79-4a6236d932fd admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:04.685740 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9e06-31e3-4268-9f79-4a6236d932fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:04.686018 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9e06-31e3-4268-9f79-4a6236d932fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:04.686653 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b9e06-31e3-4268-9f79-4a6236d932fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:04.688562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b9e06-31e3-4268-9f79-4a6236d932fd admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:04.739257 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1343/2674] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:39:04 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:04.743310 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269f07c-a93e-4e82-b8b7-5b5af4aeec0a None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:04.754244 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269f07c-a93e-4e82-b8b7-5b5af4aeec0a None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:04.852438 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:04.855373 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3217ef-7c23-492f-a0a0-b4a6808ec734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:04.856221 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3217ef-7c23-492f-a0a0-b4a6808ec734 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:04.856679 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3217ef-7c23-492f-a0a0-b4a6808ec734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:04.857026 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3217ef-7c23-492f-a0a0-b4a6808ec734 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:04.857678 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3217ef-7c23-492f-a0a0-b4a6808ec734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:04.859995 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3217ef-7c23-492f-a0a0-b4a6808ec734 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:04.881415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1332/2675] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:39:04 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:04.885631 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b9e06-31e3-4268-9f79-4a6236d932fd admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:04.903928 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:04.932122 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b9e06-31e3-4268-9f79-4a6236d932fd admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:04.936845 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7cc54-28b9-4689-87c3-e284dc70c4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:04.937448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7cc54-28b9-4689-87c3-e284dc70c4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:04.937736 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7cc54-28b9-4689-87c3-e284dc70c4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:04.938013 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7cc54-28b9-4689-87c3-e284dc70c4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:04.938658 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7cc54-28b9-4689-87c3-e284dc70c4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:04.940378 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7cc54-28b9-4689-87c3-e284dc70c4e8 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:04.950147 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1344/2676] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:39:04.954881 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3217ef-7c23-492f-a0a0-b4a6808ec734 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:04.965465 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3217ef-7c23-492f-a0a0-b4a6808ec734 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:04.971694 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b6cee-f9ff-46df-85df-27bb0cb6e8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:04.972350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b6cee-f9ff-46df-85df-27bb0cb6e8a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:04.972639 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b6cee-f9ff-46df-85df-27bb0cb6e8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:04.972953 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b6cee-f9ff-46df-85df-27bb0cb6e8a7 admin admin] PATH_INFO: `/v3/projects/66207c60d78940a08270d1ee79c21d18/users/fb49f9e200904aaa982cafddd3c198d5/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:04.987756 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b6cee-f9ff-46df-85df-27bb0cb6e8a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66207c60d78940a08270d1ee79c21d18, user_id=fb49f9e200904aaa982cafddd3c198d5, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:04.990524 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b6cee-f9ff-46df-85df-27bb0cb6e8a7 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:05.003695 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1333/2677] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:39:04 2022] PUT /identity/v3/projects/66207c60d78940a08270d1ee79c21d18/users/fb49f9e200904aaa982cafddd3c198d5/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:05.007772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7cc54-28b9-4689-87c3-e284dc70c4e8 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:05.018700 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7cc54-28b9-4689-87c3-e284dc70c4e8 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:05.074946 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed38d8-7a5a-4ccf-bb27-9facb459f1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:05.075551 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed38d8-7a5a-4ccf-bb27-9facb459f1df admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:05.075830 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed38d8-7a5a-4ccf-bb27-9facb459f1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:05.076107 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed38d8-7a5a-4ccf-bb27-9facb459f1df admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:05.076801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed38d8-7a5a-4ccf-bb27-9facb459f1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:05.078386 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed38d8-7a5a-4ccf-bb27-9facb459f1df admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:05.089003 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1345/2678] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:39:05.093182 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b6cee-f9ff-46df-85df-27bb0cb6e8a7 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:05.103668 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b6cee-f9ff-46df-85df-27bb0cb6e8a7 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:05.108255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77134fa-4169-403b-ab1d-887068dd276e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:05.108936 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77134fa-4169-403b-ab1d-887068dd276e admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:05.109219 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77134fa-4169-403b-ab1d-887068dd276e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:05.109497 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77134fa-4169-403b-ab1d-887068dd276e admin admin] PATH_INFO: `/v3/projects/66207c60d78940a08270d1ee79c21d18/users/fb49f9e200904aaa982cafddd3c198d5/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:05.111711 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77134fa-4169-403b-ab1d-887068dd276e admin admin] RBAC: Authorizing `identity:create_grant(project_id=66207c60d78940a08270d1ee79c21d18, user_id=fb49f9e200904aaa982cafddd3c198d5, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:05.115520 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77134fa-4169-403b-ab1d-887068dd276e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:05.126931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1334/2679] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:39:05 2022] PUT /identity/v3/projects/66207c60d78940a08270d1ee79c21d18/users/fb49f9e200904aaa982cafddd3c198d5/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:39:05.137554 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9833e4d-74ef-4f16-94c2-dba5b0c8e720 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:05.137874 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9833e4d-74ef-4f16-94c2-dba5b0c8e720 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:05.138155 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9833e4d-74ef-4f16-94c2-dba5b0c8e720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:05.166626 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e9833e4d-74ef-4f16-94c2-dba5b0c8e720 None None] MFA Rules not processed for user `fb49f9e200904aaa982cafddd3c198d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:05.167859 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e9833e4d-74ef-4f16-94c2-dba5b0c8e720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:05.237111 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1346/2680] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:39:05.248789 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77134fa-4169-403b-ab1d-887068dd276e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:05.250542 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f77134fa-4169-403b-ab1d-887068dd276e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:05.325293 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77134fa-4169-403b-ab1d-887068dd276e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:05.329194 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2eddb9-9037-47bb-9c8d-aa9a25d43941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:05.330619 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eddb9-9037-47bb-9c8d-aa9a25d43941 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:05.330992 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eddb9-9037-47bb-9c8d-aa9a25d43941 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:05.331271 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eddb9-9037-47bb-9c8d-aa9a25d43941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:05.340346 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2eddb9-9037-47bb-9c8d-aa9a25d43941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:05.342080 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2eddb9-9037-47bb-9c8d-aa9a25d43941 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:05.352030 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1335/2681] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:39:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:39:05.744976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9833e4d-74ef-4f16-94c2-dba5b0c8e720 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:05.799451 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:05.810616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9833e4d-74ef-4f16-94c2-dba5b0c8e720 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:05.815284 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bec1e6-5f11-4bfa-98c2-3e62e0ef87cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:05.815923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bec1e6-5f11-4bfa-98c2-3e62e0ef87cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:05.816208 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bec1e6-5f11-4bfa-98c2-3e62e0ef87cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:05.816486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bec1e6-5f11-4bfa-98c2-3e62e0ef87cf admin admin] PATH_INFO: `/v3/users/70765307f07644bbaf41c17b36baa08f` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:05.817667 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bec1e6-5f11-4bfa-98c2-3e62e0ef87cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=70765307f07644bbaf41c17b36baa08f)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:05.819590 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bec1e6-5f11-4bfa-98c2-3e62e0ef87cf admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:05.871782 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a6bec1e6-5f11-4bfa-98c2-3e62e0ef87cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70765307f07644bbaf41c17b36baa08f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:05.872470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a6bec1e6-5f11-4bfa-98c2-3e62e0ef87cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70765307f07644bbaf41c17b36baa08f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:05.881674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a6bec1e6-5f11-4bfa-98c2-3e62e0ef87cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70765307f07644bbaf41c17b36baa08f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:05.882273 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a6bec1e6-5f11-4bfa-98c2-3e62e0ef87cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70765307f07644bbaf41c17b36baa08f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:05.896475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-a6bec1e6-5f11-4bfa-98c2-3e62e0ef87cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70765307f07644bbaf41c17b36baa08f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:05.909652 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1347/2682] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:39:05 2022] DELETE /identity/v3/users/70765307f07644bbaf41c17b36baa08f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:05.914181 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4107e6-2a66-4b05-931b-6614397d2ac4 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:05.914476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4107e6-2a66-4b05-931b-6614397d2ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:05.914760 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4107e6-2a66-4b05-931b-6614397d2ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:05.943869 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4f4107e6-2a66-4b05-931b-6614397d2ac4 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:05.945157 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4f4107e6-2a66-4b05-931b-6614397d2ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:06.005109 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1336/2683] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:39:06.014873 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bec1e6-5f11-4bfa-98c2-3e62e0ef87cf admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:06.016867 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-a6bec1e6-5f11-4bfa-98c2-3e62e0ef87cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:06.077399 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bec1e6-5f11-4bfa-98c2-3e62e0ef87cf admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:06.082301 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57630be7-396e-4a49-9117-e5a6a519dd16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:06.082919 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57630be7-396e-4a49-9117-e5a6a519dd16 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:06.083203 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57630be7-396e-4a49-9117-e5a6a519dd16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:06.083485 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57630be7-396e-4a49-9117-e5a6a519dd16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:06.092969 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57630be7-396e-4a49-9117-e5a6a519dd16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:06.094400 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57630be7-396e-4a49-9117-e5a6a519dd16 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:06.104518 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1348/2684] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:39:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:39:06.382980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4107e6-2a66-4b05-931b-6614397d2ac4 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:06.384756 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4f4107e6-2a66-4b05-931b-6614397d2ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:06.398313 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4107e6-2a66-4b05-931b-6614397d2ac4 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:06.403226 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb131a1-b659-4caa-8604-2c2683815d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:06.403884 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb131a1-b659-4caa-8604-2c2683815d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:06.404170 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb131a1-b659-4caa-8604-2c2683815d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:06.404446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb131a1-b659-4caa-8604-2c2683815d92 admin admin] PATH_INFO: `/v3/projects/11ba6649fc2645afafb63b3c468146c7` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:06.405631 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb131a1-b659-4caa-8604-2c2683815d92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11ba6649fc2645afafb63b3c468146c7)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:06.408313 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb131a1-b659-4caa-8604-2c2683815d92 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:06.436203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:06.463569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5eb131a1-b659-4caa-8604-2c2683815d92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11ba6649fc2645afafb63b3c468146c7', 'request_id': 'req-5eb131a1-b659-4caa-8604-2c2683815d92'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:06.469995 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5eb131a1-b659-4caa-8604-2c2683815d92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11ba6649fc2645afafb63b3c468146c7', 'request_id': 'req-5eb131a1-b659-4caa-8604-2c2683815d92'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:06.477461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5eb131a1-b659-4caa-8604-2c2683815d92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11ba6649fc2645afafb63b3c468146c7', 'request_id': 'req-5eb131a1-b659-4caa-8604-2c2683815d92'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:06.497370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5eb131a1-b659-4caa-8604-2c2683815d92 admin admin] The token cache is being invalidate because project 11ba6649fc2645afafb63b3c468146c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:39:06.498018 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5eb131a1-b659-4caa-8604-2c2683815d92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:06.499223 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5eb131a1-b659-4caa-8604-2c2683815d92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:06.501492 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1337/2685] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:39:06 2022] DELETE /identity/v3/projects/11ba6649fc2645afafb63b3c468146c7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:06.507731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57630be7-396e-4a49-9117-e5a6a519dd16 service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:06.528288 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57630be7-396e-4a49-9117-e5a6a519dd16 service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:06.600709 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c6f70-65d2-4cc0-be3a-ef17b1eac98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:06.602626 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c6f70-65d2-4cc0-be3a-ef17b1eac98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:06.602917 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c6f70-65d2-4cc0-be3a-ef17b1eac98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:06.603203 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c6f70-65d2-4cc0-be3a-ef17b1eac98c admin admin] PATH_INFO: `/v3/users/fb49f9e200904aaa982cafddd3c198d5` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:06.604599 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c6f70-65d2-4cc0-be3a-ef17b1eac98c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb49f9e200904aaa982cafddd3c198d5)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:06.606656 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c6f70-65d2-4cc0-be3a-ef17b1eac98c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:06.626344 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:06.661672 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-038c6f70-65d2-4cc0-be3a-ef17b1eac98c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb49f9e200904aaa982cafddd3c198d5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:06.662346 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-038c6f70-65d2-4cc0-be3a-ef17b1eac98c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb49f9e200904aaa982cafddd3c198d5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:06.670896 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-038c6f70-65d2-4cc0-be3a-ef17b1eac98c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb49f9e200904aaa982cafddd3c198d5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:06.671507 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-038c6f70-65d2-4cc0-be3a-ef17b1eac98c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb49f9e200904aaa982cafddd3c198d5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:06.685964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-038c6f70-65d2-4cc0-be3a-ef17b1eac98c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb49f9e200904aaa982cafddd3c198d5'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:06.699339 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1349/2686] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:39:06 2022] DELETE /identity/v3/users/fb49f9e200904aaa982cafddd3c198d5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:06.997234 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb131a1-b659-4caa-8604-2c2683815d92 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:06.999252 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5eb131a1-b659-4caa-8604-2c2683815d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:07.015233 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb131a1-b659-4caa-8604-2c2683815d92 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:07.074323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832742db-8bf6-480e-951b-906625f2bc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:07.074961 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832742db-8bf6-480e-951b-906625f2bc93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:07.075246 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832742db-8bf6-480e-951b-906625f2bc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:07.075525 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832742db-8bf6-480e-951b-906625f2bc93 admin admin] PATH_INFO: `/v3/projects/66207c60d78940a08270d1ee79c21d18` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:07.076657 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832742db-8bf6-480e-951b-906625f2bc93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66207c60d78940a08270d1ee79c21d18)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:07.078605 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832742db-8bf6-480e-951b-906625f2bc93 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:07.126802 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-832742db-8bf6-480e-951b-906625f2bc93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66207c60d78940a08270d1ee79c21d18', 'request_id': 'req-832742db-8bf6-480e-951b-906625f2bc93'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:07.132955 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-832742db-8bf6-480e-951b-906625f2bc93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66207c60d78940a08270d1ee79c21d18', 'request_id': 'req-832742db-8bf6-480e-951b-906625f2bc93'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:07.139271 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-832742db-8bf6-480e-951b-906625f2bc93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66207c60d78940a08270d1ee79c21d18', 'request_id': 'req-832742db-8bf6-480e-951b-906625f2bc93'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:07.153389 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-832742db-8bf6-480e-951b-906625f2bc93 admin admin] The token cache is being invalidate because project 66207c60d78940a08270d1ee79c21d18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:39:07.153686 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-832742db-8bf6-480e-951b-906625f2bc93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:07.154338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-832742db-8bf6-480e-951b-906625f2bc93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:07.155831 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1338/2687] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:39:06 2022] DELETE /identity/v3/projects/66207c60d78940a08270d1ee79c21d18 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:07.161396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd011395-1d36-4cea-bc6d-6b4421f230f9 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:07.161871 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd011395-1d36-4cea-bc6d-6b4421f230f9 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:07.161970 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd011395-1d36-4cea-bc6d-6b4421f230f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:07.212346 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-dd011395-1d36-4cea-bc6d-6b4421f230f9 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:07.213524 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-dd011395-1d36-4cea-bc6d-6b4421f230f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:07.276164 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1350/2688] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:39:07.284418 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65be82-6593-490d-87e4-3f7738c02a95 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:07.284823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65be82-6593-490d-87e4-3f7738c02a95 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:07.285194 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65be82-6593-490d-87e4-3f7738c02a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:07.305195 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-4b65be82-6593-490d-87e4-3f7738c02a95 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:07.306434 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4b65be82-6593-490d-87e4-3f7738c02a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:07.315011 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1339/2689] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:39:07.319566 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd011395-1d36-4cea-bc6d-6b4421f230f9 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:07.330085 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd011395-1d36-4cea-bc6d-6b4421f230f9 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:07.334766 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a928633-c51b-4c66-b6d2-e6d5791e5d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:07.335375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a928633-c51b-4c66-b6d2-e6d5791e5d88 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:07.335664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a928633-c51b-4c66-b6d2-e6d5791e5d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:07.335943 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a928633-c51b-4c66-b6d2-e6d5791e5d88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:07.336600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a928633-c51b-4c66-b6d2-e6d5791e5d88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:07.336947 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a928633-c51b-4c66-b6d2-e6d5791e5d88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:07.338563 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a928633-c51b-4c66-b6d2-e6d5791e5d88 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:07.351054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1351/2690] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:07.355497 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65be82-6593-490d-87e4-3f7738c02a95 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:07.365104 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65be82-6593-490d-87e4-3f7738c02a95 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:07.369986 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2872d-8e90-4030-9dad-84563e5afe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:07.370604 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2872d-8e90-4030-9dad-84563e5afe3a admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:07.370891 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2872d-8e90-4030-9dad-84563e5afe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:07.371169 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2872d-8e90-4030-9dad-84563e5afe3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:07.371815 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2872d-8e90-4030-9dad-84563e5afe3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:07.373818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2872d-8e90-4030-9dad-84563e5afe3a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:07.405928 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1340/2691] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:39:07 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:07.407051 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a928633-c51b-4c66-b6d2-e6d5791e5d88 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:07.417616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a928633-c51b-4c66-b6d2-e6d5791e5d88 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:07.469448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:07.479739 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7443b29-136c-41d2-9091-bb45c1e90ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:07.480381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7443b29-136c-41d2-9091-bb45c1e90ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:07.480938 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7443b29-136c-41d2-9091-bb45c1e90ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:07.481426 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7443b29-136c-41d2-9091-bb45c1e90ef5 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:07.482148 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7443b29-136c-41d2-9091-bb45c1e90ef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:07.484289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7443b29-136c-41d2-9091-bb45c1e90ef5 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:07.506476 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1352/2692] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:39:07 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:07.510981 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2872d-8e90-4030-9dad-84563e5afe3a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:07.522460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2872d-8e90-4030-9dad-84563e5afe3a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:07.527282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615b28c-b304-4c18-bc71-5dd1afb24cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:07.527890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615b28c-b304-4c18-bc71-5dd1afb24cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:07.528174 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615b28c-b304-4c18-bc71-5dd1afb24cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:07.528453 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615b28c-b304-4c18-bc71-5dd1afb24cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:07.529141 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615b28c-b304-4c18-bc71-5dd1afb24cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:07.530740 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615b28c-b304-4c18-bc71-5dd1afb24cf4 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:07.540931 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1341/2693] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:39:07.544940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7443b29-136c-41d2-9091-bb45c1e90ef5 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:07.554997 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7443b29-136c-41d2-9091-bb45c1e90ef5 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:07.559582 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffaabf-2954-4240-b41c-055d031b2cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:07.560184 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffaabf-2954-4240-b41c-055d031b2cda admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:07.560470 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffaabf-2954-4240-b41c-055d031b2cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:07.560827 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffaabf-2954-4240-b41c-055d031b2cda admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:07.561434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffaabf-2954-4240-b41c-055d031b2cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:07.563026 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffaabf-2954-4240-b41c-055d031b2cda admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:07.574138 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1353/2694] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:39:07.578198 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615b28c-b304-4c18-bc71-5dd1afb24cf4 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:07.584151 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:07.590767 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615b28c-b304-4c18-bc71-5dd1afb24cf4 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:07.596935 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4bd9d-f670-48e7-8a30-b54d68803809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:07.597633 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4bd9d-f670-48e7-8a30-b54d68803809 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:07.597920 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4bd9d-f670-48e7-8a30-b54d68803809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:07.598202 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4bd9d-f670-48e7-8a30-b54d68803809 admin admin] PATH_INFO: `/v3/projects/1f826d84c84a4a1187e93de061506ab4/users/1914eb47e11440029852649e5c608bd3/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:07.613246 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4bd9d-f670-48e7-8a30-b54d68803809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f826d84c84a4a1187e93de061506ab4, user_id=1914eb47e11440029852649e5c608bd3, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:07.615898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4bd9d-f670-48e7-8a30-b54d68803809 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:07.630395 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1342/2695] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:39:07 2022] PUT /identity/v3/projects/1f826d84c84a4a1187e93de061506ab4/users/1914eb47e11440029852649e5c608bd3/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:07.641457 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c5a3a-80dd-47af-afc2-8bfbdc4adf9a None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:07.641749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c5a3a-80dd-47af-afc2-8bfbdc4adf9a None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:07.642621 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c5a3a-80dd-47af-afc2-8bfbdc4adf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:07.669773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-cd5c5a3a-80dd-47af-afc2-8bfbdc4adf9a None None] MFA Rules not processed for user `1914eb47e11440029852649e5c608bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:07.671007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-cd5c5a3a-80dd-47af-afc2-8bfbdc4adf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:07.736848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1354/2696] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:39:07.741153 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4bd9d-f670-48e7-8a30-b54d68803809 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:07.802705 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4bd9d-f670-48e7-8a30-b54d68803809 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:07.807456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b765863-7992-4f9e-ab46-48e92d852700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:07.808065 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b765863-7992-4f9e-ab46-48e92d852700 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:07.808344 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b765863-7992-4f9e-ab46-48e92d852700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:07.808629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b765863-7992-4f9e-ab46-48e92d852700 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:07.809280 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b765863-7992-4f9e-ab46-48e92d852700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:07.811178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b765863-7992-4f9e-ab46-48e92d852700 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:07.846006 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1343/2697] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:39:07 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:07.849321 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c5a3a-80dd-47af-afc2-8bfbdc4adf9a None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:07.860390 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c5a3a-80dd-47af-afc2-8bfbdc4adf9a None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:07.917748 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c91c6a-45cf-4426-8204-3f89bde40793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:07.918359 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c91c6a-45cf-4426-8204-3f89bde40793 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:07.918645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c91c6a-45cf-4426-8204-3f89bde40793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:07.918922 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c91c6a-45cf-4426-8204-3f89bde40793 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:07.919558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c91c6a-45cf-4426-8204-3f89bde40793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:07.921562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c91c6a-45cf-4426-8204-3f89bde40793 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:07.944526 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1355/2698] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:39:07 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:39:07.948553 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b765863-7992-4f9e-ab46-48e92d852700 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:07.960123 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b765863-7992-4f9e-ab46-48e92d852700 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:07.965592 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17540e8a-16aa-4801-8821-a26a69beea2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:07.966184 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17540e8a-16aa-4801-8821-a26a69beea2f admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:07.966861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17540e8a-16aa-4801-8821-a26a69beea2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:07.967134 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17540e8a-16aa-4801-8821-a26a69beea2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:07.967783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17540e8a-16aa-4801-8821-a26a69beea2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:07.969430 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17540e8a-16aa-4801-8821-a26a69beea2f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:07.980335 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1344/2699] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:39:07.984506 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c91c6a-45cf-4426-8204-3f89bde40793 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:07.995374 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c91c6a-45cf-4426-8204-3f89bde40793 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:08.000163 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165754a-07cf-4045-960f-870866c6e75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:08.000859 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165754a-07cf-4045-960f-870866c6e75c admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:08.001174 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165754a-07cf-4045-960f-870866c6e75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:08.001986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165754a-07cf-4045-960f-870866c6e75c admin admin] PATH_INFO: `/v3/projects/efcc2663c7994622b122216db3025a56/users/fb82b73081b1429fbf0347ab08d5939f/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:08.017577 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165754a-07cf-4045-960f-870866c6e75c admin admin] RBAC: Authorizing `identity:create_grant(project_id=efcc2663c7994622b122216db3025a56, user_id=fb82b73081b1429fbf0347ab08d5939f, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:08.020409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165754a-07cf-4045-960f-870866c6e75c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:08.034107 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1356/2700] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:39:07 2022] PUT /identity/v3/projects/efcc2663c7994622b122216db3025a56/users/fb82b73081b1429fbf0347ab08d5939f/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:08.038206 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17540e8a-16aa-4801-8821-a26a69beea2f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:08.048355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17540e8a-16aa-4801-8821-a26a69beea2f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:08.109033 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961df38-1e9a-4702-9a0a-a3de714909b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:08.109280 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961df38-1e9a-4702-9a0a-a3de714909b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:08.109562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961df38-1e9a-4702-9a0a-a3de714909b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:08.109840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961df38-1e9a-4702-9a0a-a3de714909b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:08.110523 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961df38-1e9a-4702-9a0a-a3de714909b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:08.112572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961df38-1e9a-4702-9a0a-a3de714909b1 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:08.123370 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1345/2701] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:39:08.128546 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165754a-07cf-4045-960f-870866c6e75c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:08.139221 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165754a-07cf-4045-960f-870866c6e75c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:08.145071 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a179612-2190-479a-b731-1fc5f3061482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:08.145759 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a179612-2190-479a-b731-1fc5f3061482 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:08.146041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a179612-2190-479a-b731-1fc5f3061482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:08.146345 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a179612-2190-479a-b731-1fc5f3061482 admin admin] PATH_INFO: `/v3/projects/efcc2663c7994622b122216db3025a56/users/fb82b73081b1429fbf0347ab08d5939f/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:08.148278 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a179612-2190-479a-b731-1fc5f3061482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efcc2663c7994622b122216db3025a56, user_id=fb82b73081b1429fbf0347ab08d5939f, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:08.150940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a179612-2190-479a-b731-1fc5f3061482 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:08.161806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1357/2702] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:39:08 2022] PUT /identity/v3/projects/efcc2663c7994622b122216db3025a56/users/fb82b73081b1429fbf0347ab08d5939f/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:39:08.172212 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844fe65-ed9f-456a-ae3e-765bf3c5b66b None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:08.172765 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844fe65-ed9f-456a-ae3e-765bf3c5b66b None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:08.173198 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844fe65-ed9f-456a-ae3e-765bf3c5b66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:08.203243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-0844fe65-ed9f-456a-ae3e-765bf3c5b66b None None] MFA Rules not processed for user `fb82b73081b1429fbf0347ab08d5939f`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:08.205224 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-0844fe65-ed9f-456a-ae3e-765bf3c5b66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:08.247101 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:08.285616 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1346/2703] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:39:08.297544 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a179612-2190-479a-b731-1fc5f3061482 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:08.299647 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0a179612-2190-479a-b731-1fc5f3061482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:08.323356 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:08.366940 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a179612-2190-479a-b731-1fc5f3061482 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:08.370794 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce8694-756f-4a10-bb12-19bb058961f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:08.371398 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce8694-756f-4a10-bb12-19bb058961f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:08.371678 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce8694-756f-4a10-bb12-19bb058961f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:08.371953 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce8694-756f-4a10-bb12-19bb058961f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:08.382311 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce8694-756f-4a10-bb12-19bb058961f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:08.383792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce8694-756f-4a10-bb12-19bb058961f9 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:08.395169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1358/2704] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:39:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:39:08.819853 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844fe65-ed9f-456a-ae3e-765bf3c5b66b None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:08.889809 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844fe65-ed9f-456a-ae3e-765bf3c5b66b None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:08.895057 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607d923-5bf8-4611-aa25-699d4ade1735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:08.895719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607d923-5bf8-4611-aa25-699d4ade1735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:08.896000 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607d923-5bf8-4611-aa25-699d4ade1735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:08.896279 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607d923-5bf8-4611-aa25-699d4ade1735 admin admin] PATH_INFO: `/v3/users/1914eb47e11440029852649e5c608bd3` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:08.897754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607d923-5bf8-4611-aa25-699d4ade1735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1914eb47e11440029852649e5c608bd3)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:08.899709 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607d923-5bf8-4611-aa25-699d4ade1735 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:08.952547 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b607d923-5bf8-4611-aa25-699d4ade1735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1914eb47e11440029852649e5c608bd3'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:08.953230 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b607d923-5bf8-4611-aa25-699d4ade1735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1914eb47e11440029852649e5c608bd3'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:08.960304 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b607d923-5bf8-4611-aa25-699d4ade1735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1914eb47e11440029852649e5c608bd3'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:08.960992 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b607d923-5bf8-4611-aa25-699d4ade1735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1914eb47e11440029852649e5c608bd3'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:08.969259 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-b607d923-5bf8-4611-aa25-699d4ade1735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1914eb47e11440029852649e5c608bd3'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:08.988333 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1347/2705] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:39:08 2022] DELETE /identity/v3/users/1914eb47e11440029852649e5c608bd3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:08.992967 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600e2f9-f3d7-42fb-bf04-3cdacfc057be None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:08.993347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600e2f9-f3d7-42fb-bf04-3cdacfc057be None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:08.993695 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600e2f9-f3d7-42fb-bf04-3cdacfc057be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:09.012314 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2600e2f9-f3d7-42fb-bf04-3cdacfc057be None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:09.013491 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2600e2f9-f3d7-42fb-bf04-3cdacfc057be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:09.071915 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1359/2706] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:39:09.081962 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607d923-5bf8-4611-aa25-699d4ade1735 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:09.083377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-b607d923-5bf8-4611-aa25-699d4ade1735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:09.269206 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607d923-5bf8-4611-aa25-699d4ade1735 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:09.272867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef4d63-673d-41cd-807d-4e6d9f0cf11e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:09.273514 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef4d63-673d-41cd-807d-4e6d9f0cf11e service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:09.273801 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef4d63-673d-41cd-807d-4e6d9f0cf11e service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:09.274080 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef4d63-673d-41cd-807d-4e6d9f0cf11e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:09.281599 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:09.285357 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef4d63-673d-41cd-807d-4e6d9f0cf11e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:09.287621 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef4d63-673d-41cd-807d-4e6d9f0cf11e service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:09.299113 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1348/2707] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:39:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:39:09.599012 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600e2f9-f3d7-42fb-bf04-3cdacfc057be None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:09.600555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2600e2f9-f3d7-42fb-bf04-3cdacfc057be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:09.614182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600e2f9-f3d7-42fb-bf04-3cdacfc057be None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:09.619592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2f16e-319c-4c6f-a16d-265fe8b2b253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:09.620320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2f16e-319c-4c6f-a16d-265fe8b2b253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:09.620679 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2f16e-319c-4c6f-a16d-265fe8b2b253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:09.621665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2f16e-319c-4c6f-a16d-265fe8b2b253 admin admin] PATH_INFO: `/v3/projects/1f826d84c84a4a1187e93de061506ab4` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:09.622836 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2f16e-319c-4c6f-a16d-265fe8b2b253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f826d84c84a4a1187e93de061506ab4)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:09.624983 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2f16e-319c-4c6f-a16d-265fe8b2b253 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:09.683672 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ccd2f16e-319c-4c6f-a16d-265fe8b2b253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f826d84c84a4a1187e93de061506ab4', 'request_id': 'req-ccd2f16e-319c-4c6f-a16d-265fe8b2b253'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:09.692921 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ccd2f16e-319c-4c6f-a16d-265fe8b2b253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f826d84c84a4a1187e93de061506ab4', 'request_id': 'req-ccd2f16e-319c-4c6f-a16d-265fe8b2b253'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:09.700576 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ccd2f16e-319c-4c6f-a16d-265fe8b2b253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f826d84c84a4a1187e93de061506ab4', 'request_id': 'req-ccd2f16e-319c-4c6f-a16d-265fe8b2b253'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:09.717088 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ccd2f16e-319c-4c6f-a16d-265fe8b2b253 admin admin] The token cache is being invalidate because project 1f826d84c84a4a1187e93de061506ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:39:09.717592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ccd2f16e-319c-4c6f-a16d-265fe8b2b253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:09.718362 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ccd2f16e-319c-4c6f-a16d-265fe8b2b253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:09.720802 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1360/2708] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:39:09 2022] DELETE /identity/v3/projects/1f826d84c84a4a1187e93de061506ab4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:09.725275 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef4d63-673d-41cd-807d-4e6d9f0cf11e service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:09.735111 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef4d63-673d-41cd-807d-4e6d9f0cf11e service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:09.800662 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de7db9-7d36-40b1-8e84-e687f626dbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:09.801327 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de7db9-7d36-40b1-8e84-e687f626dbde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:09.801613 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de7db9-7d36-40b1-8e84-e687f626dbde admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:09.801889 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de7db9-7d36-40b1-8e84-e687f626dbde admin admin] PATH_INFO: `/v3/users/fb82b73081b1429fbf0347ab08d5939f` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:09.803218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de7db9-7d36-40b1-8e84-e687f626dbde admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb82b73081b1429fbf0347ab08d5939f)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:09.805595 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de7db9-7d36-40b1-8e84-e687f626dbde admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:09.860292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a6de7db9-7d36-40b1-8e84-e687f626dbde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb82b73081b1429fbf0347ab08d5939f'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:09.861279 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a6de7db9-7d36-40b1-8e84-e687f626dbde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb82b73081b1429fbf0347ab08d5939f'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:09.868960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a6de7db9-7d36-40b1-8e84-e687f626dbde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb82b73081b1429fbf0347ab08d5939f'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:09.869662 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a6de7db9-7d36-40b1-8e84-e687f626dbde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb82b73081b1429fbf0347ab08d5939f'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:09.878126 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-a6de7db9-7d36-40b1-8e84-e687f626dbde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb82b73081b1429fbf0347ab08d5939f'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:09.898849 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1349/2709] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:39:09 2022] DELETE /identity/v3/users/fb82b73081b1429fbf0347ab08d5939f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:39:10.183515 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2f16e-319c-4c6f-a16d-265fe8b2b253 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:10.185008 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ccd2f16e-319c-4c6f-a16d-265fe8b2b253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:10.200843 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2f16e-319c-4c6f-a16d-265fe8b2b253 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:10.247137 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:10.264396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb115c55-3e4a-4276-b9ec-6bd32c60c0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:10.265086 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb115c55-3e4a-4276-b9ec-6bd32c60c0dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:10.265371 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb115c55-3e4a-4276-b9ec-6bd32c60c0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:10.265648 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb115c55-3e4a-4276-b9ec-6bd32c60c0dc admin admin] PATH_INFO: `/v3/projects/efcc2663c7994622b122216db3025a56` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:10.267538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb115c55-3e4a-4276-b9ec-6bd32c60c0dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=efcc2663c7994622b122216db3025a56)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:10.269559 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb115c55-3e4a-4276-b9ec-6bd32c60c0dc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:10.324715 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-eb115c55-3e4a-4276-b9ec-6bd32c60c0dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efcc2663c7994622b122216db3025a56', 'request_id': 'req-eb115c55-3e4a-4276-b9ec-6bd32c60c0dc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:10.334395 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-eb115c55-3e4a-4276-b9ec-6bd32c60c0dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efcc2663c7994622b122216db3025a56', 'request_id': 'req-eb115c55-3e4a-4276-b9ec-6bd32c60c0dc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:10.342008 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-eb115c55-3e4a-4276-b9ec-6bd32c60c0dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efcc2663c7994622b122216db3025a56', 'request_id': 'req-eb115c55-3e4a-4276-b9ec-6bd32c60c0dc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:10.357663 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-eb115c55-3e4a-4276-b9ec-6bd32c60c0dc admin admin] The token cache is being invalidate because project efcc2663c7994622b122216db3025a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:39:10.357991 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-eb115c55-3e4a-4276-b9ec-6bd32c60c0dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:10.358772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-eb115c55-3e4a-4276-b9ec-6bd32c60c0dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:10.361080 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1361/2710] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:39:10 2022] DELETE /identity/v3/projects/efcc2663c7994622b122216db3025a56 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:39:10.366292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ce319-d731-4aeb-9c7d-ba72b12778ea None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:10.366698 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ce319-d731-4aeb-9c7d-ba72b12778ea None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:10.366980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ce319-d731-4aeb-9c7d-ba72b12778ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:10.389175 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-793ce319-d731-4aeb-9c7d-ba72b12778ea None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:10.390436 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-793ce319-d731-4aeb-9c7d-ba72b12778ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:10.454429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1350/2711] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:39:10.463890 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b69ec-0d1a-4a8c-ae55-f5bd6d1f9e60 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:10.464175 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b69ec-0d1a-4a8c-ae55-f5bd6d1f9e60 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:10.464450 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b69ec-0d1a-4a8c-ae55-f5bd6d1f9e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:10.484842 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-079b69ec-0d1a-4a8c-ae55-f5bd6d1f9e60 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:10.486067 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-079b69ec-0d1a-4a8c-ae55-f5bd6d1f9e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:10.494041 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1362/2712] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:39:10.498540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ce319-d731-4aeb-9c7d-ba72b12778ea None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:10.509228 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ce319-d731-4aeb-9c7d-ba72b12778ea None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:10.513956 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a8d8a-cfc4-4c7a-b4b0-1a2102b1f771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:10.514573 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a8d8a-cfc4-4c7a-b4b0-1a2102b1f771 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:10.514866 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a8d8a-cfc4-4c7a-b4b0-1a2102b1f771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:10.515136 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a8d8a-cfc4-4c7a-b4b0-1a2102b1f771 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:10.515826 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a8d8a-cfc4-4c7a-b4b0-1a2102b1f771 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:10.516133 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a8d8a-cfc4-4c7a-b4b0-1a2102b1f771 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:10.518418 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a8d8a-cfc4-4c7a-b4b0-1a2102b1f771 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:10.530645 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1351/2713] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:10.535724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b69ec-0d1a-4a8c-ae55-f5bd6d1f9e60 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:10.549557 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b69ec-0d1a-4a8c-ae55-f5bd6d1f9e60 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:10.558357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a3eab-5e20-4ef4-adef-f990aba2826f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:10.558977 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a3eab-5e20-4ef4-adef-f990aba2826f admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:10.559261 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a3eab-5e20-4ef4-adef-f990aba2826f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:10.559540 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a3eab-5e20-4ef4-adef-f990aba2826f admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:10.560188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a3eab-5e20-4ef4-adef-f990aba2826f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:10.562161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a3eab-5e20-4ef4-adef-f990aba2826f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:10.591592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1363/2714] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:39:10 2022] POST /identity/v3/projects => generated 407 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:39:10.595759 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a8d8a-cfc4-4c7a-b4b0-1a2102b1f771 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:10.601298 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:10.607852 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a8d8a-cfc4-4c7a-b4b0-1a2102b1f771 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:10.668129 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9777484-5d76-41da-8f3e-ad7cbf37a99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:10.668853 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9777484-5d76-41da-8f3e-ad7cbf37a99f admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:10.669149 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9777484-5d76-41da-8f3e-ad7cbf37a99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:10.669424 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9777484-5d76-41da-8f3e-ad7cbf37a99f admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:10.670177 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9777484-5d76-41da-8f3e-ad7cbf37a99f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:10.672107 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9777484-5d76-41da-8f3e-ad7cbf37a99f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:10.700062 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1352/2715] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:39:10 2022] POST /identity/v3/users => generated 304 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:39:10.700860 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a3eab-5e20-4ef4-adef-f990aba2826f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:10.711998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a3eab-5e20-4ef4-adef-f990aba2826f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:10.717306 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a282ad2-4753-4684-a346-9b77fa223e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:10.717926 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a282ad2-4753-4684-a346-9b77fa223e58 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:10.718204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a282ad2-4753-4684-a346-9b77fa223e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:10.718488 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a282ad2-4753-4684-a346-9b77fa223e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:10.719140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a282ad2-4753-4684-a346-9b77fa223e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:10.720886 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a282ad2-4753-4684-a346-9b77fa223e58 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:10.732784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1364/2716] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:39:10.737592 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9777484-5d76-41da-8f3e-ad7cbf37a99f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:10.748139 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9777484-5d76-41da-8f3e-ad7cbf37a99f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:10.754092 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27a96a-f32e-4132-b66b-c3c2aa90f7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:10.754896 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27a96a-f32e-4132-b66b-c3c2aa90f7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:10.755394 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27a96a-f32e-4132-b66b-c3c2aa90f7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:10.755663 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27a96a-f32e-4132-b66b-c3c2aa90f7d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:10.756333 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27a96a-f32e-4132-b66b-c3c2aa90f7d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:10.757980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27a96a-f32e-4132-b66b-c3c2aa90f7d8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:10.769605 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1353/2717] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:39:10.773805 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a282ad2-4753-4684-a346-9b77fa223e58 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:10.784509 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a282ad2-4753-4684-a346-9b77fa223e58 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:10.789306 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f943d-78c9-4988-8f43-e95d8d55122b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:10.789983 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f943d-78c9-4988-8f43-e95d8d55122b admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:10.790276 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f943d-78c9-4988-8f43-e95d8d55122b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:10.790557 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f943d-78c9-4988-8f43-e95d8d55122b admin admin] PATH_INFO: `/v3/projects/5e0917b94d20459eb316b10d136a151e/users/5a27591634af46ca80399e365a53f861/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:10.806719 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f943d-78c9-4988-8f43-e95d8d55122b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0917b94d20459eb316b10d136a151e, user_id=5a27591634af46ca80399e365a53f861, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:10.809442 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f943d-78c9-4988-8f43-e95d8d55122b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:10.824135 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1365/2718] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:39:10 2022] PUT /identity/v3/projects/5e0917b94d20459eb316b10d136a151e/users/5a27591634af46ca80399e365a53f861/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:10.835928 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd00bc7-2b11-4ee1-8fd5-297094f3fd60 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:10.836242 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd00bc7-2b11-4ee1-8fd5-297094f3fd60 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:10.836519 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd00bc7-2b11-4ee1-8fd5-297094f3fd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:10.866242 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-bdd00bc7-2b11-4ee1-8fd5-297094f3fd60 None None] MFA Rules not processed for user `5a27591634af46ca80399e365a53f861`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:10.867491 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-bdd00bc7-2b11-4ee1-8fd5-297094f3fd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:10.935465 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1354/2719] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:10 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:39:10.940167 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f943d-78c9-4988-8f43-e95d8d55122b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:11.008279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f943d-78c9-4988-8f43-e95d8d55122b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:11.013520 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b74db-7500-44a0-b6fd-f667878fc94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:11.014223 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b74db-7500-44a0-b6fd-f667878fc94c admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:11.014592 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b74db-7500-44a0-b6fd-f667878fc94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:11.014877 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b74db-7500-44a0-b6fd-f667878fc94c admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:11.015531 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b74db-7500-44a0-b6fd-f667878fc94c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:11.018236 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b74db-7500-44a0-b6fd-f667878fc94c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:11.035020 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:11.049121 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1366/2720] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:39:10 2022] POST /identity/v3/projects => generated 409 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:39:11.053239 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd00bc7-2b11-4ee1-8fd5-297094f3fd60 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:11.064648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd00bc7-2b11-4ee1-8fd5-297094f3fd60 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:11.127365 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f983403-2ad2-494d-9c48-c7ff73b50372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:11.128105 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f983403-2ad2-494d-9c48-c7ff73b50372 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:11.128470 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f983403-2ad2-494d-9c48-c7ff73b50372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:11.128777 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f983403-2ad2-494d-9c48-c7ff73b50372 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:11.129427 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f983403-2ad2-494d-9c48-c7ff73b50372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:11.131381 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f983403-2ad2-494d-9c48-c7ff73b50372 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:11.149110 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:11.158341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1355/2721] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:39:11 2022] POST /identity/v3/users => generated 311 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:39:11.160784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b74db-7500-44a0-b6fd-f667878fc94c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:11.172408 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b74db-7500-44a0-b6fd-f667878fc94c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:11.178370 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c9860-16bc-4021-8084-37c6e803c413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:11.179188 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c9860-16bc-4021-8084-37c6e803c413 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:11.179539 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c9860-16bc-4021-8084-37c6e803c413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:11.179887 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c9860-16bc-4021-8084-37c6e803c413 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:11.180611 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c9860-16bc-4021-8084-37c6e803c413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:11.182374 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c9860-16bc-4021-8084-37c6e803c413 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:11.194675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1367/2722] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:39:11.199020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f983403-2ad2-494d-9c48-c7ff73b50372 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:11.210757 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f983403-2ad2-494d-9c48-c7ff73b50372 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:11.215839 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ae0da-da4f-4116-88c6-745770faffe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:11.216811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ae0da-da4f-4116-88c6-745770faffe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:11.217099 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ae0da-da4f-4116-88c6-745770faffe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:11.217421 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ae0da-da4f-4116-88c6-745770faffe2 admin admin] PATH_INFO: `/v3/projects/ef2bae2b5d664475a9312e92dd126594/users/577e9f7f68cd44cba9e0e9d26b252401/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:11.233530 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ae0da-da4f-4116-88c6-745770faffe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2bae2b5d664475a9312e92dd126594, user_id=577e9f7f68cd44cba9e0e9d26b252401, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:11.237156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ae0da-da4f-4116-88c6-745770faffe2 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:11.251047 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1356/2723] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:39:11 2022] PUT /identity/v3/projects/ef2bae2b5d664475a9312e92dd126594/users/577e9f7f68cd44cba9e0e9d26b252401/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:11.256302 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c9860-16bc-4021-8084-37c6e803c413 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:11.267562 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c9860-16bc-4021-8084-37c6e803c413 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:11.332620 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8008d9b-df70-4087-bdd2-7c4f83bd6410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:11.333282 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8008d9b-df70-4087-bdd2-7c4f83bd6410 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:11.333730 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8008d9b-df70-4087-bdd2-7c4f83bd6410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:11.333861 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8008d9b-df70-4087-bdd2-7c4f83bd6410 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:11.334519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8008d9b-df70-4087-bdd2-7c4f83bd6410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:11.336268 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8008d9b-df70-4087-bdd2-7c4f83bd6410 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:11.347805 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1368/2724] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:39:11.352303 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ae0da-da4f-4116-88c6-745770faffe2 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:11.364582 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ae0da-da4f-4116-88c6-745770faffe2 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:11.369729 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e638e9-0ad6-41fe-b0d5-1ff672c5f08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:11.370449 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e638e9-0ad6-41fe-b0d5-1ff672c5f08a admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:11.370723 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e638e9-0ad6-41fe-b0d5-1ff672c5f08a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:11.371004 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e638e9-0ad6-41fe-b0d5-1ff672c5f08a admin admin] PATH_INFO: `/v3/projects/ef2bae2b5d664475a9312e92dd126594/users/577e9f7f68cd44cba9e0e9d26b252401/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:11.373256 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e638e9-0ad6-41fe-b0d5-1ff672c5f08a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2bae2b5d664475a9312e92dd126594, user_id=577e9f7f68cd44cba9e0e9d26b252401, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:11.377216 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e638e9-0ad6-41fe-b0d5-1ff672c5f08a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:11.388187 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1357/2725] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:39:11 2022] PUT /identity/v3/projects/ef2bae2b5d664475a9312e92dd126594/users/577e9f7f68cd44cba9e0e9d26b252401/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:11.399445 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4c65c-3da0-4990-b258-0f7802b659f4 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:11.399744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4c65c-3da0-4990-b258-0f7802b659f4 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:11.400027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4c65c-3da0-4990-b258-0f7802b659f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:11.430060 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2af4c65c-3da0-4990-b258-0f7802b659f4 None None] MFA Rules not processed for user `577e9f7f68cd44cba9e0e9d26b252401`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:11.431319 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2af4c65c-3da0-4990-b258-0f7802b659f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:11.513119 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1369/2726] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:11 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:39:11.524509 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e638e9-0ad6-41fe-b0d5-1ff672c5f08a admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:11.526278 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-78e638e9-0ad6-41fe-b0d5-1ff672c5f08a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:11.589558 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e638e9-0ad6-41fe-b0d5-1ff672c5f08a admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:11.593760 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fb1b0-7d94-4976-9e5a-e3aded4bcc67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:11.594376 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fb1b0-7d94-4976-9e5a-e3aded4bcc67 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:11.594679 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fb1b0-7d94-4976-9e5a-e3aded4bcc67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:11.595582 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fb1b0-7d94-4976-9e5a-e3aded4bcc67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:11.605608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fb1b0-7d94-4976-9e5a-e3aded4bcc67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:11.607037 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fb1b0-7d94-4976-9e5a-e3aded4bcc67 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:11.617677 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1358/2727] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:39:11 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:39:11.779037 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4c65c-3da0-4990-b258-0f7802b659f4 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:11.789888 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4c65c-3da0-4990-b258-0f7802b659f4 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:11.794095 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66525646-6cff-4943-aed2-73c2d0074771 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:11.794724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66525646-6cff-4943-aed2-73c2d0074771 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:11.795008 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66525646-6cff-4943-aed2-73c2d0074771 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:11.795287 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66525646-6cff-4943-aed2-73c2d0074771 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:11.869240 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66525646-6cff-4943-aed2-73c2d0074771 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:11.870718 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66525646-6cff-4943-aed2-73c2d0074771 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:11.882563 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1370/2728] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:39:11 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:39:12.287318 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce36f0-cbfc-4b51-a5df-f97960492ff8 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:12.287895 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce36f0-cbfc-4b51-a5df-f97960492ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:12.287895 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce36f0-cbfc-4b51-a5df-f97960492ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:12.306941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-1cce36f0-cbfc-4b51-a5df-f97960492ff8 None None] MFA Rules not processed for user `383a0c7b4e574409b477fa61581e63bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:12.308156 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1cce36f0-cbfc-4b51-a5df-f97960492ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:12.368628 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1359/2729] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:39:13.601908 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66525646-6cff-4943-aed2-73c2d0074771 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:13.603397 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-66525646-6cff-4943-aed2-73c2d0074771 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:13.608235 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=100 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:13.700900 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66525646-6cff-4943-aed2-73c2d0074771 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:13.705999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d0b50-e7c2-4425-9da3-8494f1fc8c1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f7fe9af30947dbae1f2334b18f630d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:13.706608 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d0b50-e7c2-4425-9da3-8494f1fc8c1e service placement] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:13.706893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d0b50-e7c2-4425-9da3-8494f1fc8c1e service placement] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:13.707171 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d0b50-e7c2-4425-9da3-8494f1fc8c1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:13.708996 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-df1d0b50-e7c2-4425-9da3-8494f1fc8c1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:13.721720 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d0b50-e7c2-4425-9da3-8494f1fc8c1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:13.723314 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d0b50-e7c2-4425-9da3-8494f1fc8c1e service placement] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:13.733686 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1371/2730] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:39:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:39:17.354609 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce36f0-cbfc-4b51-a5df-f97960492ff8 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:17.468938 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce36f0-cbfc-4b51-a5df-f97960492ff8 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:17.477598 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b183a-572a-47b1-99b1-777da038c8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:17.478719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b183a-572a-47b1-99b1-777da038c8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:17.479233 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b183a-572a-47b1-99b1-777da038c8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:17.479743 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b183a-572a-47b1-99b1-777da038c8ff admin admin] PATH_INFO: `/v3/users/5a27591634af46ca80399e365a53f861` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:17.481690 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b183a-572a-47b1-99b1-777da038c8ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a27591634af46ca80399e365a53f861)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:17.486002 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b183a-572a-47b1-99b1-777da038c8ff admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:17.509974 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:17.568716 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-052b183a-572a-47b1-99b1-777da038c8ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a27591634af46ca80399e365a53f861'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:17.569823 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-052b183a-572a-47b1-99b1-777da038c8ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a27591634af46ca80399e365a53f861'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:17.592589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-052b183a-572a-47b1-99b1-777da038c8ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a27591634af46ca80399e365a53f861'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:17.592589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-052b183a-572a-47b1-99b1-777da038c8ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a27591634af46ca80399e365a53f861'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:17.607160 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-052b183a-572a-47b1-99b1-777da038c8ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a27591634af46ca80399e365a53f861'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:17.637051 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1360/2731] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:39:17 2022] DELETE /identity/v3/users/5a27591634af46ca80399e365a53f861 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:17.641763 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94aa44-c604-41a9-88d9-3e76281f53f3 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:17.642563 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94aa44-c604-41a9-88d9-3e76281f53f3 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:17.642563 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94aa44-c604-41a9-88d9-3e76281f53f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:17.664373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9a94aa44-c604-41a9-88d9-3e76281f53f3 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:17.665925 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9a94aa44-c604-41a9-88d9-3e76281f53f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:17.750639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1372/2732] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:39:17.765941 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b183a-572a-47b1-99b1-777da038c8ff admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:17.768506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-052b183a-572a-47b1-99b1-777da038c8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:17.875958 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b183a-572a-47b1-99b1-777da038c8ff admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:17.880464 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cef94e-0b38-4e10-ba9c-5270fab0523e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:17.881203 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cef94e-0b38-4e10-ba9c-5270fab0523e service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:17.881628 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cef94e-0b38-4e10-ba9c-5270fab0523e service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:17.882102 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cef94e-0b38-4e10-ba9c-5270fab0523e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:17.893954 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cef94e-0b38-4e10-ba9c-5270fab0523e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:17.895776 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cef94e-0b38-4e10-ba9c-5270fab0523e service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:17.908292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1361/2733] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:39:18.494259 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94aa44-c604-41a9-88d9-3e76281f53f3 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:18.496186 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9a94aa44-c604-41a9-88d9-3e76281f53f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:18.510469 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94aa44-c604-41a9-88d9-3e76281f53f3 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:18.515876 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de7a30-cebd-4873-bf39-6bc3b2940fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:18.516541 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de7a30-cebd-4873-bf39-6bc3b2940fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:18.517438 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de7a30-cebd-4873-bf39-6bc3b2940fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:18.517989 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de7a30-cebd-4873-bf39-6bc3b2940fa0 admin admin] PATH_INFO: `/v3/projects/5e0917b94d20459eb316b10d136a151e` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:18.519471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de7a30-cebd-4873-bf39-6bc3b2940fa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e0917b94d20459eb316b10d136a151e)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:18.522741 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de7a30-cebd-4873-bf39-6bc3b2940fa0 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:18.578465 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c7de7a30-cebd-4873-bf39-6bc3b2940fa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e0917b94d20459eb316b10d136a151e', 'request_id': 'req-c7de7a30-cebd-4873-bf39-6bc3b2940fa0'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:18.587237 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c7de7a30-cebd-4873-bf39-6bc3b2940fa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e0917b94d20459eb316b10d136a151e', 'request_id': 'req-c7de7a30-cebd-4873-bf39-6bc3b2940fa0'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:18.594073 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c7de7a30-cebd-4873-bf39-6bc3b2940fa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e0917b94d20459eb316b10d136a151e', 'request_id': 'req-c7de7a30-cebd-4873-bf39-6bc3b2940fa0'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:18.603247 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:18.608675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c7de7a30-cebd-4873-bf39-6bc3b2940fa0 admin admin] The token cache is being invalidate because project 5e0917b94d20459eb316b10d136a151e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:39:18.609933 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c7de7a30-cebd-4873-bf39-6bc3b2940fa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:18.610900 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-c7de7a30-cebd-4873-bf39-6bc3b2940fa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:18.613034 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1373/2734] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:39:18 2022] DELETE /identity/v3/projects/5e0917b94d20459eb316b10d136a151e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:18.618841 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cef94e-0b38-4e10-ba9c-5270fab0523e service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:18.643441 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cef94e-0b38-4e10-ba9c-5270fab0523e service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:18.730254 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8fdcc-efc9-42d6-ba16-bec9d19e5417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:18.730901 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8fdcc-efc9-42d6-ba16-bec9d19e5417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:18.731198 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8fdcc-efc9-42d6-ba16-bec9d19e5417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:18.731465 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8fdcc-efc9-42d6-ba16-bec9d19e5417 admin admin] PATH_INFO: `/v3/users/577e9f7f68cd44cba9e0e9d26b252401` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:18.732645 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8fdcc-efc9-42d6-ba16-bec9d19e5417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=577e9f7f68cd44cba9e0e9d26b252401)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:18.734649 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8fdcc-efc9-42d6-ba16-bec9d19e5417 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:18.779031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:18.792339 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d8e8fdcc-efc9-42d6-ba16-bec9d19e5417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '577e9f7f68cd44cba9e0e9d26b252401'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:18.793093 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d8e8fdcc-efc9-42d6-ba16-bec9d19e5417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '577e9f7f68cd44cba9e0e9d26b252401'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:18.800633 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d8e8fdcc-efc9-42d6-ba16-bec9d19e5417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '577e9f7f68cd44cba9e0e9d26b252401'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:18.801375 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d8e8fdcc-efc9-42d6-ba16-bec9d19e5417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '577e9f7f68cd44cba9e0e9d26b252401'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:18.809653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d8e8fdcc-efc9-42d6-ba16-bec9d19e5417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '577e9f7f68cd44cba9e0e9d26b252401'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:18.828344 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1362/2735] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:39:18 2022] DELETE /identity/v3/users/577e9f7f68cd44cba9e0e9d26b252401 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:19.158023 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de7a30-cebd-4873-bf39-6bc3b2940fa0 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:19.164819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c7de7a30-cebd-4873-bf39-6bc3b2940fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:19.182284 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de7a30-cebd-4873-bf39-6bc3b2940fa0 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:19.257187 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8275b0f-636f-4360-a6d4-26ab0e8294a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:19.258352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8275b0f-636f-4360-a6d4-26ab0e8294a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:19.258853 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8275b0f-636f-4360-a6d4-26ab0e8294a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:19.259314 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8275b0f-636f-4360-a6d4-26ab0e8294a4 admin admin] PATH_INFO: `/v3/projects/ef2bae2b5d664475a9312e92dd126594` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:19.262312 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8275b0f-636f-4360-a6d4-26ab0e8294a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef2bae2b5d664475a9312e92dd126594)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:19.266067 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8275b0f-636f-4360-a6d4-26ab0e8294a4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:19.355675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f8275b0f-636f-4360-a6d4-26ab0e8294a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef2bae2b5d664475a9312e92dd126594', 'request_id': 'req-f8275b0f-636f-4360-a6d4-26ab0e8294a4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:19.365459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f8275b0f-636f-4360-a6d4-26ab0e8294a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef2bae2b5d664475a9312e92dd126594', 'request_id': 'req-f8275b0f-636f-4360-a6d4-26ab0e8294a4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:19.372146 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f8275b0f-636f-4360-a6d4-26ab0e8294a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef2bae2b5d664475a9312e92dd126594', 'request_id': 'req-f8275b0f-636f-4360-a6d4-26ab0e8294a4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:19.387171 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f8275b0f-636f-4360-a6d4-26ab0e8294a4 admin admin] The token cache is being invalidate because project ef2bae2b5d664475a9312e92dd126594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:39:19.387619 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f8275b0f-636f-4360-a6d4-26ab0e8294a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:19.389340 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f8275b0f-636f-4360-a6d4-26ab0e8294a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:19.391015 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1374/2736] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:39:19 2022] DELETE /identity/v3/projects/ef2bae2b5d664475a9312e92dd126594 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:19.399050 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59410fc8-2fcc-406b-a0b2-4c66872b874c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:19.400354 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59410fc8-2fcc-406b-a0b2-4c66872b874c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:19.400744 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59410fc8-2fcc-406b-a0b2-4c66872b874c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:19.427105 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-59410fc8-2fcc-406b-a0b2-4c66872b874c None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:19.429037 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-59410fc8-2fcc-406b-a0b2-4c66872b874c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:19.512089 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1363/2737] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:39:19.582633 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c34faa-741e-4db1-a17c-cf065df46fdc None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:19.582916 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c34faa-741e-4db1-a17c-cf065df46fdc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:19.583197 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c34faa-741e-4db1-a17c-cf065df46fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:19.604378 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-70c34faa-741e-4db1-a17c-cf065df46fdc None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:19.605724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-70c34faa-741e-4db1-a17c-cf065df46fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:19.614897 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1375/2738] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:39:19.619631 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59410fc8-2fcc-406b-a0b2-4c66872b874c None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:19.630961 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59410fc8-2fcc-406b-a0b2-4c66872b874c None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:19.635840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff69e6-985b-4c34-8bcb-2b8f0073bdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:19.636476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff69e6-985b-4c34-8bcb-2b8f0073bdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:19.636795 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff69e6-985b-4c34-8bcb-2b8f0073bdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:19.637989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff69e6-985b-4c34-8bcb-2b8f0073bdb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:19.639273 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff69e6-985b-4c34-8bcb-2b8f0073bdb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:19.639783 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff69e6-985b-4c34-8bcb-2b8f0073bdb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:19.643753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff69e6-985b-4c34-8bcb-2b8f0073bdb6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:19.665357 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1364/2739] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:19.670273 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c34faa-741e-4db1-a17c-cf065df46fdc None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:19.680770 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c34faa-741e-4db1-a17c-cf065df46fdc None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:19.685709 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d2dfc-e810-4904-a742-d4204e06bbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:19.686334 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d2dfc-e810-4904-a742-d4204e06bbd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:19.686624 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d2dfc-e810-4904-a742-d4204e06bbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:19.686893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d2dfc-e810-4904-a742-d4204e06bbd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:19.687575 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d2dfc-e810-4904-a742-d4204e06bbd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:19.690553 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d2dfc-e810-4904-a742-d4204e06bbd1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:19.727330 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1376/2740] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:39:19 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:39:19.731849 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff69e6-985b-4c34-8bcb-2b8f0073bdb6 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:19.743761 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff69e6-985b-4c34-8bcb-2b8f0073bdb6 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:19.842719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a5003-ba98-45fd-860c-a7f328fb6415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:19.843507 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a5003-ba98-45fd-860c-a7f328fb6415 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:19.843949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a5003-ba98-45fd-860c-a7f328fb6415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:19.844426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a5003-ba98-45fd-860c-a7f328fb6415 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:19.845588 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a5003-ba98-45fd-860c-a7f328fb6415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:19.848492 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a5003-ba98-45fd-860c-a7f328fb6415 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:19.880003 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1365/2741] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:39:19 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:39:19.884539 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d2dfc-e810-4904-a742-d4204e06bbd1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:19.897650 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d2dfc-e810-4904-a742-d4204e06bbd1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:19.905632 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c708f1e-72a8-4acd-8386-8ab0b557234a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:19.906435 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c708f1e-72a8-4acd-8386-8ab0b557234a admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:19.906821 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c708f1e-72a8-4acd-8386-8ab0b557234a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:19.907201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c708f1e-72a8-4acd-8386-8ab0b557234a admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:19.908007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c708f1e-72a8-4acd-8386-8ab0b557234a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:19.910328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c708f1e-72a8-4acd-8386-8ab0b557234a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:19.924154 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1377/2742] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:39:19.930154 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a5003-ba98-45fd-860c-a7f328fb6415 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:19.942589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a5003-ba98-45fd-860c-a7f328fb6415 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:19.948583 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dd96c-8624-416d-a373-8c6e3a85482a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:19.949269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dd96c-8624-416d-a373-8c6e3a85482a admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:19.949562 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dd96c-8624-416d-a373-8c6e3a85482a admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:19.949850 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dd96c-8624-416d-a373-8c6e3a85482a admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:19.950550 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5dd96c-8624-416d-a373-8c6e3a85482a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:19.952285 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5dd96c-8624-416d-a373-8c6e3a85482a admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:19.967756 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1366/2743] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:39:19.972864 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c708f1e-72a8-4acd-8386-8ab0b557234a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:19.989935 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c708f1e-72a8-4acd-8386-8ab0b557234a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:19.995972 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad44387-28be-461c-9a3a-75d8219978f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:19.996626 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad44387-28be-461c-9a3a-75d8219978f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:19.997179 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad44387-28be-461c-9a3a-75d8219978f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:19.997553 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad44387-28be-461c-9a3a-75d8219978f7 admin admin] PATH_INFO: `/v3/projects/5352c7bd8116437381582243c7c7e86c/users/91cb1ed71dee485e9c51edc73ea5d2eb/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:20.022578 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad44387-28be-461c-9a3a-75d8219978f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5352c7bd8116437381582243c7c7e86c, user_id=91cb1ed71dee485e9c51edc73ea5d2eb, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:20.026795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad44387-28be-461c-9a3a-75d8219978f7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:20.051952 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1378/2744] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:39:19 2022] PUT /identity/v3/projects/5352c7bd8116437381582243c7c7e86c/users/91cb1ed71dee485e9c51edc73ea5d2eb/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:20.071029 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a47a6-118b-4cd1-ba05-916b2f967685 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:20.071706 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a47a6-118b-4cd1-ba05-916b2f967685 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:20.072166 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a47a6-118b-4cd1-ba05-916b2f967685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:20.118886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-669a47a6-118b-4cd1-ba05-916b2f967685 None None] MFA Rules not processed for user `91cb1ed71dee485e9c51edc73ea5d2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:20.121587 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-669a47a6-118b-4cd1-ba05-916b2f967685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:20.129776 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:20.240582 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1367/2745] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:39:20.246134 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad44387-28be-461c-9a3a-75d8219978f7 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:20.296643 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:20.357743 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad44387-28be-461c-9a3a-75d8219978f7 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:20.364044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65440b5d-60f7-4fc3-a033-18d66bff654b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:20.364703 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65440b5d-60f7-4fc3-a033-18d66bff654b admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:20.365020 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65440b5d-60f7-4fc3-a033-18d66bff654b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:20.365303 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65440b5d-60f7-4fc3-a033-18d66bff654b admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:20.365963 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65440b5d-60f7-4fc3-a033-18d66bff654b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:20.368795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65440b5d-60f7-4fc3-a033-18d66bff654b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:20.408374 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1379/2746] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:39:20 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:20.412522 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a47a6-118b-4cd1-ba05-916b2f967685 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:20.427829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a47a6-118b-4cd1-ba05-916b2f967685 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:20.517383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4b6d1-2e9d-47b6-a508-217d6994feae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:20.518308 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4b6d1-2e9d-47b6-a508-217d6994feae admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:20.518766 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4b6d1-2e9d-47b6-a508-217d6994feae admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:20.519248 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4b6d1-2e9d-47b6-a508-217d6994feae admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:20.520380 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4b6d1-2e9d-47b6-a508-217d6994feae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:20.523885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4b6d1-2e9d-47b6-a508-217d6994feae admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:20.555799 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1368/2747] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:39:20 2022] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:39:20.560367 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65440b5d-60f7-4fc3-a033-18d66bff654b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:20.571672 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65440b5d-60f7-4fc3-a033-18d66bff654b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:20.576634 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609b27f-32b0-40c9-9769-d0efface3bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:20.577305 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609b27f-32b0-40c9-9769-d0efface3bcc admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:20.577591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609b27f-32b0-40c9-9769-d0efface3bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:20.577865 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609b27f-32b0-40c9-9769-d0efface3bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:20.578528 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609b27f-32b0-40c9-9769-d0efface3bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:20.580832 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609b27f-32b0-40c9-9769-d0efface3bcc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:20.597155 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1380/2748] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:39:20.598649 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4b6d1-2e9d-47b6-a508-217d6994feae admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:20.610447 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4b6d1-2e9d-47b6-a508-217d6994feae admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:20.616130 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b9a24-ef2f-4cc0-97b9-0d3186183de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:20.616977 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b9a24-ef2f-4cc0-97b9-0d3186183de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:20.617307 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b9a24-ef2f-4cc0-97b9-0d3186183de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:20.617663 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b9a24-ef2f-4cc0-97b9-0d3186183de3 admin admin] PATH_INFO: `/v3/projects/c4fad3c27fa5482cbf2f8bfecbdf5f7f/users/98de1e9bd57e4aeaa1f55e5ab1a361a9/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:20.647142 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b9a24-ef2f-4cc0-97b9-0d3186183de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4fad3c27fa5482cbf2f8bfecbdf5f7f, user_id=98de1e9bd57e4aeaa1f55e5ab1a361a9, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:20.651826 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b9a24-ef2f-4cc0-97b9-0d3186183de3 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:20.669981 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1369/2749] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:39:20 2022] PUT /identity/v3/projects/c4fad3c27fa5482cbf2f8bfecbdf5f7f/users/98de1e9bd57e4aeaa1f55e5ab1a361a9/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:20.676357 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609b27f-32b0-40c9-9769-d0efface3bcc admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:20.696933 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609b27f-32b0-40c9-9769-d0efface3bcc admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:20.800872 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7948ec7-696b-4f7f-a6fd-180e00af62cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:20.801429 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7948ec7-696b-4f7f-a6fd-180e00af62cf admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:20.801754 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7948ec7-696b-4f7f-a6fd-180e00af62cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:20.802040 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7948ec7-696b-4f7f-a6fd-180e00af62cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:20.802860 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7948ec7-696b-4f7f-a6fd-180e00af62cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:20.805766 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7948ec7-696b-4f7f-a6fd-180e00af62cf admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:20.818976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1381/2750] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:39:20.823914 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b9a24-ef2f-4cc0-97b9-0d3186183de3 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:20.846578 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b9a24-ef2f-4cc0-97b9-0d3186183de3 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:20.854074 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd568033-f260-4403-aa70-86d99385e8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:20.855176 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd568033-f260-4403-aa70-86d99385e8d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:20.855656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd568033-f260-4403-aa70-86d99385e8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:20.856135 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd568033-f260-4403-aa70-86d99385e8d2 admin admin] PATH_INFO: `/v3/projects/c4fad3c27fa5482cbf2f8bfecbdf5f7f/users/98de1e9bd57e4aeaa1f55e5ab1a361a9/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:20.859331 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd568033-f260-4403-aa70-86d99385e8d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4fad3c27fa5482cbf2f8bfecbdf5f7f, user_id=98de1e9bd57e4aeaa1f55e5ab1a361a9, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:20.865059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd568033-f260-4403-aa70-86d99385e8d2 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:20.880405 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1370/2751] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:39:20 2022] PUT /identity/v3/projects/c4fad3c27fa5482cbf2f8bfecbdf5f7f/users/98de1e9bd57e4aeaa1f55e5ab1a361a9/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:20.900275 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285e08c-b149-41ad-8938-1f3b62387bfe None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:20.900561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285e08c-b149-41ad-8938-1f3b62387bfe None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:20.900879 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285e08c-b149-41ad-8938-1f3b62387bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:20.943782 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8285e08c-b149-41ad-8938-1f3b62387bfe None None] MFA Rules not processed for user `98de1e9bd57e4aeaa1f55e5ab1a361a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:20.946158 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8285e08c-b149-41ad-8938-1f3b62387bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:21.065206 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1382/2752] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:20 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:39:21.076668 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd568033-f260-4403-aa70-86d99385e8d2 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:21.078719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-dd568033-f260-4403-aa70-86d99385e8d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:21.150327 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd568033-f260-4403-aa70-86d99385e8d2 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:21.156908 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2b3e1-1449-4fc9-b79e-d577ea0932b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:21.158845 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2b3e1-1449-4fc9-b79e-d577ea0932b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:21.159358 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2b3e1-1449-4fc9-b79e-d577ea0932b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:21.159858 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2b3e1-1449-4fc9-b79e-d577ea0932b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:21.173219 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2b3e1-1449-4fc9-b79e-d577ea0932b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:21.174855 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2b3e1-1449-4fc9-b79e-d577ea0932b3 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:21.190872 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1371/2753] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:39:21 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:39:21.854722 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285e08c-b149-41ad-8938-1f3b62387bfe None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:21.882331 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:21.939587 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285e08c-b149-41ad-8938-1f3b62387bfe None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:21.944800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a41623-64ac-4334-8583-973817477ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:21.945677 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a41623-64ac-4334-8583-973817477ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:21.945949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a41623-64ac-4334-8583-973817477ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:21.946296 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a41623-64ac-4334-8583-973817477ae4 admin admin] PATH_INFO: `/v3/users/91cb1ed71dee485e9c51edc73ea5d2eb` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:21.947593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a41623-64ac-4334-8583-973817477ae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91cb1ed71dee485e9c51edc73ea5d2eb)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:21.949702 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a41623-64ac-4334-8583-973817477ae4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:22.020489 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e1a41623-64ac-4334-8583-973817477ae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91cb1ed71dee485e9c51edc73ea5d2eb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:22.021206 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e1a41623-64ac-4334-8583-973817477ae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91cb1ed71dee485e9c51edc73ea5d2eb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:22.031109 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e1a41623-64ac-4334-8583-973817477ae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91cb1ed71dee485e9c51edc73ea5d2eb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:22.031901 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e1a41623-64ac-4334-8583-973817477ae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91cb1ed71dee485e9c51edc73ea5d2eb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:22.059519 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-e1a41623-64ac-4334-8583-973817477ae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91cb1ed71dee485e9c51edc73ea5d2eb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:22.074772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1383/2754] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:39:21 2022] DELETE /identity/v3/users/91cb1ed71dee485e9c51edc73ea5d2eb => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:22.079443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec72e7f-4c57-42a3-a7a9-0409ee442665 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:22.080111 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec72e7f-4c57-42a3-a7a9-0409ee442665 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:22.080381 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec72e7f-4c57-42a3-a7a9-0409ee442665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:22.087731 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:22.102474 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-6ec72e7f-4c57-42a3-a7a9-0409ee442665 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:22.103710 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6ec72e7f-4c57-42a3-a7a9-0409ee442665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:22.168045 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1372/2755] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:39:22.178733 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a41623-64ac-4334-8583-973817477ae4 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:22.180259 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e1a41623-64ac-4334-8583-973817477ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:22.241313 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a41623-64ac-4334-8583-973817477ae4 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:22.245035 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca05259-117d-4bbe-bfb4-f123aa74532d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:22.245656 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca05259-117d-4bbe-bfb4-f123aa74532d service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:22.245980 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca05259-117d-4bbe-bfb4-f123aa74532d service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:22.246252 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca05259-117d-4bbe-bfb4-f123aa74532d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:22.255999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca05259-117d-4bbe-bfb4-f123aa74532d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:22.257485 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca05259-117d-4bbe-bfb4-f123aa74532d service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:22.267869 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1384/2756] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:39:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:39:22.550781 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec72e7f-4c57-42a3-a7a9-0409ee442665 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:22.552253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-6ec72e7f-4c57-42a3-a7a9-0409ee442665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:22.567800 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec72e7f-4c57-42a3-a7a9-0409ee442665 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:22.572543 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c8635-6247-4db6-8797-a0bf6368abfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:22.573238 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c8635-6247-4db6-8797-a0bf6368abfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:22.573518 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c8635-6247-4db6-8797-a0bf6368abfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:22.573793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c8635-6247-4db6-8797-a0bf6368abfa admin admin] PATH_INFO: `/v3/projects/5352c7bd8116437381582243c7c7e86c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:22.574935 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c8635-6247-4db6-8797-a0bf6368abfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5352c7bd8116437381582243c7c7e86c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:22.576970 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c8635-6247-4db6-8797-a0bf6368abfa admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:22.627662 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ec4c8635-6247-4db6-8797-a0bf6368abfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5352c7bd8116437381582243c7c7e86c', 'request_id': 'req-ec4c8635-6247-4db6-8797-a0bf6368abfa'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:22.633836 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ec4c8635-6247-4db6-8797-a0bf6368abfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5352c7bd8116437381582243c7c7e86c', 'request_id': 'req-ec4c8635-6247-4db6-8797-a0bf6368abfa'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:22.640937 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ec4c8635-6247-4db6-8797-a0bf6368abfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5352c7bd8116437381582243c7c7e86c', 'request_id': 'req-ec4c8635-6247-4db6-8797-a0bf6368abfa'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:22.654705 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ec4c8635-6247-4db6-8797-a0bf6368abfa admin admin] The token cache is being invalidate because project 5352c7bd8116437381582243c7c7e86c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:39:22.654998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ec4c8635-6247-4db6-8797-a0bf6368abfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:22.655626 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ec4c8635-6247-4db6-8797-a0bf6368abfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:22.657195 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1373/2757] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:39:22 2022] DELETE /identity/v3/projects/5352c7bd8116437381582243c7c7e86c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:22.662201 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca05259-117d-4bbe-bfb4-f123aa74532d service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:22.672097 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca05259-117d-4bbe-bfb4-f123aa74532d service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:22.724116 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:22.742217 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6f8df-210e-495c-8a04-05a3f926329c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:22.742856 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6f8df-210e-495c-8a04-05a3f926329c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:22.743144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6f8df-210e-495c-8a04-05a3f926329c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:22.743424 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6f8df-210e-495c-8a04-05a3f926329c admin admin] PATH_INFO: `/v3/users/98de1e9bd57e4aeaa1f55e5ab1a361a9` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:22.744558 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6f8df-210e-495c-8a04-05a3f926329c admin admin] RBAC: Authorizing `identity:delete_user(user_id=98de1e9bd57e4aeaa1f55e5ab1a361a9)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:22.746538 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6f8df-210e-495c-8a04-05a3f926329c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:22.793994 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f1c6f8df-210e-495c-8a04-05a3f926329c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98de1e9bd57e4aeaa1f55e5ab1a361a9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:22.794642 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f1c6f8df-210e-495c-8a04-05a3f926329c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98de1e9bd57e4aeaa1f55e5ab1a361a9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:22.802795 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f1c6f8df-210e-495c-8a04-05a3f926329c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98de1e9bd57e4aeaa1f55e5ab1a361a9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:22.803422 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f1c6f8df-210e-495c-8a04-05a3f926329c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98de1e9bd57e4aeaa1f55e5ab1a361a9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:22.816462 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-f1c6f8df-210e-495c-8a04-05a3f926329c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98de1e9bd57e4aeaa1f55e5ab1a361a9'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:22.829082 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1385/2758] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:39:22 2022] DELETE /identity/v3/users/98de1e9bd57e4aeaa1f55e5ab1a361a9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:23.196012 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c8635-6247-4db6-8797-a0bf6368abfa admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:23.197558 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ec4c8635-6247-4db6-8797-a0bf6368abfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:23.213154 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c8635-6247-4db6-8797-a0bf6368abfa admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:23.276036 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dac5f-e7fe-4479-a0fc-deb601ea2db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:23.276709 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dac5f-e7fe-4479-a0fc-deb601ea2db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:23.277009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dac5f-e7fe-4479-a0fc-deb601ea2db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:23.277283 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dac5f-e7fe-4479-a0fc-deb601ea2db6 admin admin] PATH_INFO: `/v3/projects/c4fad3c27fa5482cbf2f8bfecbdf5f7f` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:23.278404 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181dac5f-e7fe-4479-a0fc-deb601ea2db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4fad3c27fa5482cbf2f8bfecbdf5f7f)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:23.280288 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181dac5f-e7fe-4479-a0fc-deb601ea2db6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:23.313956 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:23.331439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-181dac5f-e7fe-4479-a0fc-deb601ea2db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4fad3c27fa5482cbf2f8bfecbdf5f7f', 'request_id': 'req-181dac5f-e7fe-4479-a0fc-deb601ea2db6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:23.337144 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-181dac5f-e7fe-4479-a0fc-deb601ea2db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4fad3c27fa5482cbf2f8bfecbdf5f7f', 'request_id': 'req-181dac5f-e7fe-4479-a0fc-deb601ea2db6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:23.343774 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-181dac5f-e7fe-4479-a0fc-deb601ea2db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4fad3c27fa5482cbf2f8bfecbdf5f7f', 'request_id': 'req-181dac5f-e7fe-4479-a0fc-deb601ea2db6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:23.357925 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-181dac5f-e7fe-4479-a0fc-deb601ea2db6 admin admin] The token cache is being invalidate because project c4fad3c27fa5482cbf2f8bfecbdf5f7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:39:23.358198 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-181dac5f-e7fe-4479-a0fc-deb601ea2db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:23.358904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-181dac5f-e7fe-4479-a0fc-deb601ea2db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:23.360662 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1374/2759] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:39:23 2022] DELETE /identity/v3/projects/c4fad3c27fa5482cbf2f8bfecbdf5f7f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:23.366221 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46529d-cff5-4f0b-9587-c64754dc5cfc None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:23.366221 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46529d-cff5-4f0b-9587-c64754dc5cfc None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:23.368277 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46529d-cff5-4f0b-9587-c64754dc5cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:23.388005 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0f46529d-cff5-4f0b-9587-c64754dc5cfc None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:23.389270 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0f46529d-cff5-4f0b-9587-c64754dc5cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:23.459434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1386/2760] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:39:23.467579 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b93f1d-64eb-4beb-9c93-db8f20148cf3 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:23.467898 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b93f1d-64eb-4beb-9c93-db8f20148cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:23.468175 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b93f1d-64eb-4beb-9c93-db8f20148cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:23.496730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-87b93f1d-64eb-4beb-9c93-db8f20148cf3 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:23.497972 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-87b93f1d-64eb-4beb-9c93-db8f20148cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:23.507123 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1375/2761] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:39:23.511542 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46529d-cff5-4f0b-9587-c64754dc5cfc None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:23.522463 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46529d-cff5-4f0b-9587-c64754dc5cfc None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:23.527476 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ffd0e-8452-4d91-9956-6cf8db80c89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:23.528095 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ffd0e-8452-4d91-9956-6cf8db80c89c admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:23.528378 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ffd0e-8452-4d91-9956-6cf8db80c89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:23.528649 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ffd0e-8452-4d91-9956-6cf8db80c89c admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:23.529341 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ffd0e-8452-4d91-9956-6cf8db80c89c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:23.529643 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ffd0e-8452-4d91-9956-6cf8db80c89c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:23.531256 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ffd0e-8452-4d91-9956-6cf8db80c89c admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:23.544259 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1387/2762] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:23.549286 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b93f1d-64eb-4beb-9c93-db8f20148cf3 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:23.563258 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b93f1d-64eb-4beb-9c93-db8f20148cf3 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:23.568813 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bdf29-9ec9-4c26-a0e5-a4dc2502250e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:23.569425 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bdf29-9ec9-4c26-a0e5-a4dc2502250e admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:23.569720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bdf29-9ec9-4c26-a0e5-a4dc2502250e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:23.569977 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bdf29-9ec9-4c26-a0e5-a4dc2502250e admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:23.570630 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604bdf29-9ec9-4c26-a0e5-a4dc2502250e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:23.572527 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604bdf29-9ec9-4c26-a0e5-a4dc2502250e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:23.602996 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1376/2763] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:39:23 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:23.607240 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ffd0e-8452-4d91-9956-6cf8db80c89c admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:23.618185 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ffd0e-8452-4d91-9956-6cf8db80c89c admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:23.666740 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:23.683140 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250a52f-f692-4574-be33-e5785f0341b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:23.683763 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250a52f-f692-4574-be33-e5785f0341b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:23.684048 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250a52f-f692-4574-be33-e5785f0341b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:23.684328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250a52f-f692-4574-be33-e5785f0341b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:23.684992 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250a52f-f692-4574-be33-e5785f0341b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:23.686933 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250a52f-f692-4574-be33-e5785f0341b7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:23.711303 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1388/2764] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:39:23 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:39:23.715464 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bdf29-9ec9-4c26-a0e5-a4dc2502250e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:23.727506 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bdf29-9ec9-4c26-a0e5-a4dc2502250e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:23.732314 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ffecd-c117-46b7-8632-21876932dab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:23.732960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ffecd-c117-46b7-8632-21876932dab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:23.733247 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ffecd-c117-46b7-8632-21876932dab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:23.733525 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ffecd-c117-46b7-8632-21876932dab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:23.734188 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ffecd-c117-46b7-8632-21876932dab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:23.735877 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ffecd-c117-46b7-8632-21876932dab9 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:23.749538 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1377/2765] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:39:23.754733 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250a52f-f692-4574-be33-e5785f0341b7 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:23.768802 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250a52f-f692-4574-be33-e5785f0341b7 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:23.775253 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a4c43-ff84-455f-b093-1b3dbb4cbd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:23.775975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a4c43-ff84-455f-b093-1b3dbb4cbd37 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:23.776366 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a4c43-ff84-455f-b093-1b3dbb4cbd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:23.776651 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a4c43-ff84-455f-b093-1b3dbb4cbd37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:23.777352 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a4c43-ff84-455f-b093-1b3dbb4cbd37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:23.779656 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a4c43-ff84-455f-b093-1b3dbb4cbd37 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:23.791228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1389/2766] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:39:23.796514 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ffecd-c117-46b7-8632-21876932dab9 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:23.809023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ffecd-c117-46b7-8632-21876932dab9 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:23.814885 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f0665-cad2-485e-b8a3-a1ef840a9452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:23.815633 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f0665-cad2-485e-b8a3-a1ef840a9452 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:23.815920 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f0665-cad2-485e-b8a3-a1ef840a9452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:23.816204 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f0665-cad2-485e-b8a3-a1ef840a9452 admin admin] PATH_INFO: `/v3/projects/d698307ef6cf4c35be72ced85a4f4c99/users/6f4dc7a3c63044c2a87ccb72aff2342c/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:23.835354 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f0665-cad2-485e-b8a3-a1ef840a9452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d698307ef6cf4c35be72ced85a4f4c99, user_id=6f4dc7a3c63044c2a87ccb72aff2342c, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:23.839793 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f0665-cad2-485e-b8a3-a1ef840a9452 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:23.861287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1378/2767] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:39:23 2022] PUT /identity/v3/projects/d698307ef6cf4c35be72ced85a4f4c99/users/6f4dc7a3c63044c2a87ccb72aff2342c/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:39:23.871810 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d0a03-41ae-4be2-be28-1123889d7668 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:23.872381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d0a03-41ae-4be2-be28-1123889d7668 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:23.872381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d0a03-41ae-4be2-be28-1123889d7668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:23.905376 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-577d0a03-41ae-4be2-be28-1123889d7668 None None] MFA Rules not processed for user `6f4dc7a3c63044c2a87ccb72aff2342c`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:23.906655 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-577d0a03-41ae-4be2-be28-1123889d7668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:23.975861 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1390/2768] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:39:23.980455 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f0665-cad2-485e-b8a3-a1ef840a9452 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:24.047096 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f0665-cad2-485e-b8a3-a1ef840a9452 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:24.052654 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe7abb-a206-4881-8b52-2d7ee9d25cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:24.053368 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe7abb-a206-4881-8b52-2d7ee9d25cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:24.053656 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe7abb-a206-4881-8b52-2d7ee9d25cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:24.053934 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe7abb-a206-4881-8b52-2d7ee9d25cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:24.054576 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe7abb-a206-4881-8b52-2d7ee9d25cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:24.056491 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe7abb-a206-4881-8b52-2d7ee9d25cf5 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:24.089010 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1379/2769] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:39:23 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:24.094139 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d0a03-41ae-4be2-be28-1123889d7668 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:24.105858 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d0a03-41ae-4be2-be28-1123889d7668 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:24.167626 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a66373-5953-4671-88cc-0c0608992a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:24.168251 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a66373-5953-4671-88cc-0c0608992a6b admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:24.168537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a66373-5953-4671-88cc-0c0608992a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:24.168854 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a66373-5953-4671-88cc-0c0608992a6b admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:24.169497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a66373-5953-4671-88cc-0c0608992a6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:24.171429 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a66373-5953-4671-88cc-0c0608992a6b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:24.198355 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1391/2770] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:39:24 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:24.206040 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe7abb-a206-4881-8b52-2d7ee9d25cf5 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:24.217494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe7abb-a206-4881-8b52-2d7ee9d25cf5 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:24.223169 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef307a-7a81-49c6-a83c-cb0a60a47157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:24.223819 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef307a-7a81-49c6-a83c-cb0a60a47157 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:24.224105 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef307a-7a81-49c6-a83c-cb0a60a47157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:24.224384 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef307a-7a81-49c6-a83c-cb0a60a47157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:24.225136 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef307a-7a81-49c6-a83c-cb0a60a47157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:24.226943 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef307a-7a81-49c6-a83c-cb0a60a47157 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:24.241761 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1380/2771] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:39:24.246151 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a66373-5953-4671-88cc-0c0608992a6b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:24.257449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a66373-5953-4671-88cc-0c0608992a6b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:24.262498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2350c7c-80c3-4512-9bb6-c2eb61e43290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:24.263157 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2350c7c-80c3-4512-9bb6-c2eb61e43290 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:24.263444 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2350c7c-80c3-4512-9bb6-c2eb61e43290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:24.263726 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2350c7c-80c3-4512-9bb6-c2eb61e43290 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:24.264412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2350c7c-80c3-4512-9bb6-c2eb61e43290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:24.266215 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2350c7c-80c3-4512-9bb6-c2eb61e43290 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:24.282269 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1392/2772] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:39:24.284821 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef307a-7a81-49c6-a83c-cb0a60a47157 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:24.295984 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef307a-7a81-49c6-a83c-cb0a60a47157 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:24.302347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c61e09-7837-404d-b61a-53ca22328412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:24.303051 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c61e09-7837-404d-b61a-53ca22328412 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:24.303330 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c61e09-7837-404d-b61a-53ca22328412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:24.303631 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c61e09-7837-404d-b61a-53ca22328412 admin admin] PATH_INFO: `/v3/projects/79a8b5eec39b43a6b14ff9bf6a657f63/users/6859fec95f4a4007833570e4278b3104/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:24.322130 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c61e09-7837-404d-b61a-53ca22328412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a8b5eec39b43a6b14ff9bf6a657f63, user_id=6859fec95f4a4007833570e4278b3104, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:24.325345 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c61e09-7837-404d-b61a-53ca22328412 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:24.341909 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1381/2773] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:39:24 2022] PUT /identity/v3/projects/79a8b5eec39b43a6b14ff9bf6a657f63/users/6859fec95f4a4007833570e4278b3104/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:24.354818 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976bc5b-1e9e-4c04-b020-c099c9596c2c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:24.355236 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976bc5b-1e9e-4c04-b020-c099c9596c2c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:24.355659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976bc5b-1e9e-4c04-b020-c099c9596c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:24.398459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-8976bc5b-1e9e-4c04-b020-c099c9596c2c None None] MFA Rules not processed for user `6859fec95f4a4007833570e4278b3104`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:24.399721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-8976bc5b-1e9e-4c04-b020-c099c9596c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:24.428553 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:24.484187 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1393/2774] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:39:24.489520 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c61e09-7837-404d-b61a-53ca22328412 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:24.494019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:24.559531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c61e09-7837-404d-b61a-53ca22328412 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:24.564381 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0de47c-84bb-4f90-b5ee-8f5e1cf18c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:24.565071 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0de47c-84bb-4f90-b5ee-8f5e1cf18c81 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:24.565358 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0de47c-84bb-4f90-b5ee-8f5e1cf18c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:24.565639 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0de47c-84bb-4f90-b5ee-8f5e1cf18c81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:24.566281 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0de47c-84bb-4f90-b5ee-8f5e1cf18c81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:24.568237 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0de47c-84bb-4f90-b5ee-8f5e1cf18c81 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:24.598708 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1382/2775] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:39:24 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:24.602614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976bc5b-1e9e-4c04-b020-c099c9596c2c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:24.614683 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976bc5b-1e9e-4c04-b020-c099c9596c2c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:24.673449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbddb3-d896-4542-83d3-268056cd53b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:24.674409 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbddb3-d896-4542-83d3-268056cd53b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:24.674697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbddb3-d896-4542-83d3-268056cd53b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:24.674975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbddb3-d896-4542-83d3-268056cd53b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:24.675619 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbddb3-d896-4542-83d3-268056cd53b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:24.677600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbddb3-d896-4542-83d3-268056cd53b3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:24.700929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1394/2776] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:39:24 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:24.705671 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0de47c-84bb-4f90-b5ee-8f5e1cf18c81 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:24.719194 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0de47c-84bb-4f90-b5ee-8f5e1cf18c81 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:24.724755 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863689f3-784a-425d-8581-2c7f42e89d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:24.725383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863689f3-784a-425d-8581-2c7f42e89d73 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:24.725670 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863689f3-784a-425d-8581-2c7f42e89d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:24.725949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863689f3-784a-425d-8581-2c7f42e89d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:24.726605 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863689f3-784a-425d-8581-2c7f42e89d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:24.728228 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863689f3-784a-425d-8581-2c7f42e89d73 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:24.740622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1383/2777] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:39:24.744800 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbddb3-d896-4542-83d3-268056cd53b3 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:24.755841 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbddb3-d896-4542-83d3-268056cd53b3 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:24.760835 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798cd2d-bf66-422f-b351-7c84840de992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:24.761537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798cd2d-bf66-422f-b351-7c84840de992 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:24.761823 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798cd2d-bf66-422f-b351-7c84840de992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:24.762101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798cd2d-bf66-422f-b351-7c84840de992 admin admin] PATH_INFO: `/v3/projects/380acaf7c75b4d3c94c37fa36d093360/users/03e0702a82d14438b8247fd3871e8358/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:24.778257 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798cd2d-bf66-422f-b351-7c84840de992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=380acaf7c75b4d3c94c37fa36d093360, user_id=03e0702a82d14438b8247fd3871e8358, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:24.780975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798cd2d-bf66-422f-b351-7c84840de992 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:24.795347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1395/2778] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:39:24 2022] PUT /identity/v3/projects/380acaf7c75b4d3c94c37fa36d093360/users/03e0702a82d14438b8247fd3871e8358/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:24.799969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863689f3-784a-425d-8581-2c7f42e89d73 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:24.812268 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863689f3-784a-425d-8581-2c7f42e89d73 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:24.878384 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ce58c-6282-4fd1-baf8-3ceff20df824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:24.878996 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ce58c-6282-4fd1-baf8-3ceff20df824 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:24.879398 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ce58c-6282-4fd1-baf8-3ceff20df824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:24.879684 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ce58c-6282-4fd1-baf8-3ceff20df824 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:24.880338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ce58c-6282-4fd1-baf8-3ceff20df824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:24.881998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ce58c-6282-4fd1-baf8-3ceff20df824 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:24.893240 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1384/2779] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:39:24.897266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798cd2d-bf66-422f-b351-7c84840de992 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:24.908632 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798cd2d-bf66-422f-b351-7c84840de992 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:24.913372 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4ee1f-bb5e-46ae-a6da-2b57d0910288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:24.914046 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4ee1f-bb5e-46ae-a6da-2b57d0910288 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:24.914712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4ee1f-bb5e-46ae-a6da-2b57d0910288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:24.914712 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4ee1f-bb5e-46ae-a6da-2b57d0910288 admin admin] PATH_INFO: `/v3/projects/380acaf7c75b4d3c94c37fa36d093360/users/03e0702a82d14438b8247fd3871e8358/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:24.916560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4ee1f-bb5e-46ae-a6da-2b57d0910288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=380acaf7c75b4d3c94c37fa36d093360, user_id=03e0702a82d14438b8247fd3871e8358, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:24.919257 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4ee1f-bb5e-46ae-a6da-2b57d0910288 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:24.931152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1396/2780] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:39:24 2022] PUT /identity/v3/projects/380acaf7c75b4d3c94c37fa36d093360/users/03e0702a82d14438b8247fd3871e8358/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:24.942030 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e25721-d7ce-481d-a802-89ed7cc5afbd None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:24.942397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e25721-d7ce-481d-a802-89ed7cc5afbd None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:24.942668 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e25721-d7ce-481d-a802-89ed7cc5afbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:24.972703 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-92e25721-d7ce-481d-a802-89ed7cc5afbd None None] MFA Rules not processed for user `03e0702a82d14438b8247fd3871e8358`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:24.973946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-92e25721-d7ce-481d-a802-89ed7cc5afbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:25.042429 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:25.053490 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1385/2781] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:39:25.060868 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4ee1f-bb5e-46ae-a6da-2b57d0910288 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:25.062623 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-33c4ee1f-bb5e-46ae-a6da-2b57d0910288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:25.125724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4ee1f-bb5e-46ae-a6da-2b57d0910288 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:25.130293 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a165772-285e-454b-b84a-0d830c9c1650 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:25.130929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a165772-285e-454b-b84a-0d830c9c1650 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:25.131209 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a165772-285e-454b-b84a-0d830c9c1650 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:25.131486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a165772-285e-454b-b84a-0d830c9c1650 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:25.163341 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:25.191240 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a165772-285e-454b-b84a-0d830c9c1650 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:25.192733 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a165772-285e-454b-b84a-0d830c9c1650 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:25.202027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1397/2782] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:39:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:39:26.766260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e25721-d7ce-481d-a802-89ed7cc5afbd None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:26.767792 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-92e25721-d7ce-481d-a802-89ed7cc5afbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:26.780030 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e25721-d7ce-481d-a802-89ed7cc5afbd None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:26.784474 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bee2f3-624c-4407-bd5e-1d9f3e3d0de9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:26.785129 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bee2f3-624c-4407-bd5e-1d9f3e3d0de9 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:26.785410 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bee2f3-624c-4407-bd5e-1d9f3e3d0de9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:26.785683 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bee2f3-624c-4407-bd5e-1d9f3e3d0de9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:26.848178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bee2f3-624c-4407-bd5e-1d9f3e3d0de9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:26.849671 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bee2f3-624c-4407-bd5e-1d9f3e3d0de9 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:26.859035 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1386/2783] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:39:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:39:27.431471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a165772-285e-454b-b84a-0d830c9c1650 service cinder] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:27.437735 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a165772-285e-454b-b84a-0d830c9c1650 service cinder] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:27.441603 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc641c-baa6-4459-876a-457473f85517 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:27.442230 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc641c-baa6-4459-876a-457473f85517 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:27.442498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc641c-baa6-4459-876a-457473f85517 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:27.442776 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc641c-baa6-4459-876a-457473f85517 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:27.452859 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc641c-baa6-4459-876a-457473f85517 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:27.456343 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc641c-baa6-4459-876a-457473f85517 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:27.467022 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1398/2784] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:39:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:39:31.595102 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bee2f3-624c-4407-bd5e-1d9f3e3d0de9 service cinder] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:31.666905 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bee2f3-624c-4407-bd5e-1d9f3e3d0de9 service cinder] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:31.671848 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36df96-75c5-4703-b9f8-036af6f42b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:31.672555 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36df96-75c5-4703-b9f8-036af6f42b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:31.673576 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36df96-75c5-4703-b9f8-036af6f42b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:31.673804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36df96-75c5-4703-b9f8-036af6f42b99 admin admin] PATH_INFO: `/v3/users/6f4dc7a3c63044c2a87ccb72aff2342c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:31.675121 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36df96-75c5-4703-b9f8-036af6f42b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f4dc7a3c63044c2a87ccb72aff2342c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:31.677103 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36df96-75c5-4703-b9f8-036af6f42b99 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:31.728294 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5f36df96-75c5-4703-b9f8-036af6f42b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f4dc7a3c63044c2a87ccb72aff2342c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:31.729304 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5f36df96-75c5-4703-b9f8-036af6f42b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f4dc7a3c63044c2a87ccb72aff2342c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:31.737249 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5f36df96-75c5-4703-b9f8-036af6f42b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f4dc7a3c63044c2a87ccb72aff2342c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:31.737939 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5f36df96-75c5-4703-b9f8-036af6f42b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f4dc7a3c63044c2a87ccb72aff2342c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:31.745949 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-5f36df96-75c5-4703-b9f8-036af6f42b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f4dc7a3c63044c2a87ccb72aff2342c'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:31.766130 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1387/2785] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:39:31 2022] DELETE /identity/v3/users/6f4dc7a3c63044c2a87ccb72aff2342c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:39:31.771514 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f22fae-950a-4ca3-bc6e-288f8a44f9eb None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:31.772199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f22fae-950a-4ca3-bc6e-288f8a44f9eb None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:31.772381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f22fae-950a-4ca3-bc6e-288f8a44f9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:31.792279 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-57f22fae-950a-4ca3-bc6e-288f8a44f9eb None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:31.793569 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-57f22fae-950a-4ca3-bc6e-288f8a44f9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:31.864737 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1399/2786] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:39:31.879052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36df96-75c5-4703-b9f8-036af6f42b99 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:31.881213 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5f36df96-75c5-4703-b9f8-036af6f42b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:31.901608 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:31.980748 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36df96-75c5-4703-b9f8-036af6f42b99 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:31.984354 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70087d7b-3995-4ed6-9b33-73cedcb6caac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:31.984993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70087d7b-3995-4ed6-9b33-73cedcb6caac service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:31.985367 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70087d7b-3995-4ed6-9b33-73cedcb6caac service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:31.985607 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70087d7b-3995-4ed6-9b33-73cedcb6caac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:31.995205 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70087d7b-3995-4ed6-9b33-73cedcb6caac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:31.996652 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70087d7b-3995-4ed6-9b33-73cedcb6caac service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:32.006839 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1388/2787] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:39:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:39:32.332099 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f22fae-950a-4ca3-bc6e-288f8a44f9eb None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:32.333683 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-57f22fae-950a-4ca3-bc6e-288f8a44f9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:32.349468 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f22fae-950a-4ca3-bc6e-288f8a44f9eb None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:32.356064 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5d988-1f7b-464a-a8e7-5f5945c9cfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:32.364999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5d988-1f7b-464a-a8e7-5f5945c9cfcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:32.365343 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5d988-1f7b-464a-a8e7-5f5945c9cfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:32.365776 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5d988-1f7b-464a-a8e7-5f5945c9cfcb admin admin] PATH_INFO: `/v3/projects/d698307ef6cf4c35be72ced85a4f4c99` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:32.367179 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5d988-1f7b-464a-a8e7-5f5945c9cfcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d698307ef6cf4c35be72ced85a4f4c99)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:32.369178 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5d988-1f7b-464a-a8e7-5f5945c9cfcb admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:32.421797 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-03f5d988-1f7b-464a-a8e7-5f5945c9cfcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd698307ef6cf4c35be72ced85a4f4c99', 'request_id': 'req-03f5d988-1f7b-464a-a8e7-5f5945c9cfcb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:32.429948 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-03f5d988-1f7b-464a-a8e7-5f5945c9cfcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd698307ef6cf4c35be72ced85a4f4c99', 'request_id': 'req-03f5d988-1f7b-464a-a8e7-5f5945c9cfcb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:32.436006 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-03f5d988-1f7b-464a-a8e7-5f5945c9cfcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd698307ef6cf4c35be72ced85a4f4c99', 'request_id': 'req-03f5d988-1f7b-464a-a8e7-5f5945c9cfcb'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:32.448173 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-03f5d988-1f7b-464a-a8e7-5f5945c9cfcb admin admin] The token cache is being invalidate because project d698307ef6cf4c35be72ced85a4f4c99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:39:32.448464 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-03f5d988-1f7b-464a-a8e7-5f5945c9cfcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:32.449152 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-03f5d988-1f7b-464a-a8e7-5f5945c9cfcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:32.450661 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1400/2788] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:39:32 2022] DELETE /identity/v3/projects/d698307ef6cf4c35be72ced85a4f4c99 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:32.455970 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70087d7b-3995-4ed6-9b33-73cedcb6caac service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:32.475559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70087d7b-3995-4ed6-9b33-73cedcb6caac service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:32.559870 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e7377-470c-4487-acf8-1be43c9c1463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:32.560456 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e7377-470c-4487-acf8-1be43c9c1463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:32.560767 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e7377-470c-4487-acf8-1be43c9c1463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:32.561042 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e7377-470c-4487-acf8-1be43c9c1463 admin admin] PATH_INFO: `/v3/users/6859fec95f4a4007833570e4278b3104` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:32.562267 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e7377-470c-4487-acf8-1be43c9c1463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6859fec95f4a4007833570e4278b3104)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:32.565493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e7377-470c-4487-acf8-1be43c9c1463 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:32.622630 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ae4e7377-470c-4487-acf8-1be43c9c1463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6859fec95f4a4007833570e4278b3104'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:32.623704 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ae4e7377-470c-4487-acf8-1be43c9c1463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6859fec95f4a4007833570e4278b3104'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:32.632633 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ae4e7377-470c-4487-acf8-1be43c9c1463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6859fec95f4a4007833570e4278b3104'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:32.633443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ae4e7377-470c-4487-acf8-1be43c9c1463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6859fec95f4a4007833570e4278b3104'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:32.644408 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ae4e7377-470c-4487-acf8-1be43c9c1463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6859fec95f4a4007833570e4278b3104'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:32.666966 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1389/2789] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:39:32 2022] DELETE /identity/v3/users/6859fec95f4a4007833570e4278b3104 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:33.033591 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5d988-1f7b-464a-a8e7-5f5945c9cfcb admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:33.035559 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-03f5d988-1f7b-464a-a8e7-5f5945c9cfcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:33.057393 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5d988-1f7b-464a-a8e7-5f5945c9cfcb admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:33.124298 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:33.148858 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ed4e4-6124-4c35-b12c-f07a3b93b4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:33.149705 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ed4e4-6124-4c35-b12c-f07a3b93b4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:33.150144 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ed4e4-6124-4c35-b12c-f07a3b93b4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:33.150533 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ed4e4-6124-4c35-b12c-f07a3b93b4e3 admin admin] PATH_INFO: `/v3/projects/79a8b5eec39b43a6b14ff9bf6a657f63` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:33.151964 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ed4e4-6124-4c35-b12c-f07a3b93b4e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a8b5eec39b43a6b14ff9bf6a657f63)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:33.154273 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ed4e4-6124-4c35-b12c-f07a3b93b4e3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:33.213456 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2b9ed4e4-6124-4c35-b12c-f07a3b93b4e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a8b5eec39b43a6b14ff9bf6a657f63', 'request_id': 'req-2b9ed4e4-6124-4c35-b12c-f07a3b93b4e3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:33.224020 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2b9ed4e4-6124-4c35-b12c-f07a3b93b4e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a8b5eec39b43a6b14ff9bf6a657f63', 'request_id': 'req-2b9ed4e4-6124-4c35-b12c-f07a3b93b4e3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:33.231989 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2b9ed4e4-6124-4c35-b12c-f07a3b93b4e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a8b5eec39b43a6b14ff9bf6a657f63', 'request_id': 'req-2b9ed4e4-6124-4c35-b12c-f07a3b93b4e3'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:33.245645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2b9ed4e4-6124-4c35-b12c-f07a3b93b4e3 admin admin] The token cache is being invalidate because project 79a8b5eec39b43a6b14ff9bf6a657f63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:39:33.245998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2b9ed4e4-6124-4c35-b12c-f07a3b93b4e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:33.246813 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2b9ed4e4-6124-4c35-b12c-f07a3b93b4e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:33.248522 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1401/2790] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:39:33 2022] DELETE /identity/v3/projects/79a8b5eec39b43a6b14ff9bf6a657f63 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:39:33.253755 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e7377-470c-4487-acf8-1be43c9c1463 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:33.255307 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-ae4e7377-470c-4487-acf8-1be43c9c1463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:33.271486 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e7377-470c-4487-acf8-1be43c9c1463 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:33.287548 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:33.341545 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a93f35-3a85-4c14-a132-d5db51871c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:33.342478 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a93f35-3a85-4c14-a132-d5db51871c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:33.342761 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a93f35-3a85-4c14-a132-d5db51871c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:33.343046 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a93f35-3a85-4c14-a132-d5db51871c70 admin admin] PATH_INFO: `/v3/users/03e0702a82d14438b8247fd3871e8358` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:33.344249 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a93f35-3a85-4c14-a132-d5db51871c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03e0702a82d14438b8247fd3871e8358)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:33.347058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a93f35-3a85-4c14-a132-d5db51871c70 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:33.405520 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d4a93f35-3a85-4c14-a132-d5db51871c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03e0702a82d14438b8247fd3871e8358'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:33.406145 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d4a93f35-3a85-4c14-a132-d5db51871c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03e0702a82d14438b8247fd3871e8358'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:33.415267 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d4a93f35-3a85-4c14-a132-d5db51871c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03e0702a82d14438b8247fd3871e8358'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:33.416016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d4a93f35-3a85-4c14-a132-d5db51871c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03e0702a82d14438b8247fd3871e8358'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:33.425606 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-d4a93f35-3a85-4c14-a132-d5db51871c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03e0702a82d14438b8247fd3871e8358'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:33.451176 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1390/2791] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:39:33 2022] DELETE /identity/v3/users/03e0702a82d14438b8247fd3871e8358 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:33.808251 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ed4e4-6124-4c35-b12c-f07a3b93b4e3 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:33.810516 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2b9ed4e4-6124-4c35-b12c-f07a3b93b4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:33.830733 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ed4e4-6124-4c35-b12c-f07a3b93b4e3 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:33.912027 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1ca25-a5f8-40c4-8499-af630dc047fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:33.912609 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1ca25-a5f8-40c4-8499-af630dc047fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:33.912941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1ca25-a5f8-40c4-8499-af630dc047fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:33.913210 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1ca25-a5f8-40c4-8499-af630dc047fc admin admin] PATH_INFO: `/v3/projects/380acaf7c75b4d3c94c37fa36d093360` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:33.914559 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1ca25-a5f8-40c4-8499-af630dc047fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=380acaf7c75b4d3c94c37fa36d093360)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:33.916565 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1ca25-a5f8-40c4-8499-af630dc047fc admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:33.981127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5bf1ca25-a5f8-40c4-8499-af630dc047fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380acaf7c75b4d3c94c37fa36d093360', 'request_id': 'req-5bf1ca25-a5f8-40c4-8499-af630dc047fc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:33.993153 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5bf1ca25-a5f8-40c4-8499-af630dc047fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380acaf7c75b4d3c94c37fa36d093360', 'request_id': 'req-5bf1ca25-a5f8-40c4-8499-af630dc047fc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:34.000561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5bf1ca25-a5f8-40c4-8499-af630dc047fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380acaf7c75b4d3c94c37fa36d093360', 'request_id': 'req-5bf1ca25-a5f8-40c4-8499-af630dc047fc'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:34.013401 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5bf1ca25-a5f8-40c4-8499-af630dc047fc admin admin] The token cache is being invalidate because project 380acaf7c75b4d3c94c37fa36d093360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:39:34.013697 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5bf1ca25-a5f8-40c4-8499-af630dc047fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:34.014366 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-5bf1ca25-a5f8-40c4-8499-af630dc047fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:39:34.015903 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1402/2792] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:39:33 2022] DELETE /identity/v3/projects/380acaf7c75b4d3c94c37fa36d093360 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:39:43.447042 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:44.010136 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:14.067867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd70037-6aa2-4d29-815e-886e0660346d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:14.068558 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd70037-6aa2-4d29-815e-886e0660346d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:14.068558 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd70037-6aa2-4d29-815e-886e0660346d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:14.090345 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-9dd70037-6aa2-4d29-815e-886e0660346d None None] MFA Rules not processed for user `383a0c7b4e574409b477fa61581e63bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:14.091500 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9dd70037-6aa2-4d29-815e-886e0660346d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:14.154673 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1391/2793] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:40:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:40:24.147928 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=25 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:05.761845 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1ca25-a5f8-40c4-8499-af630dc047fc admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:05.763410 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-5bf1ca25-a5f8-40c4-8499-af630dc047fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:05.862822 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1ca25-a5f8-40c4-8499-af630dc047fc admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:05.867324 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2290132-ed74-4dbb-a286-a0c759b08c53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:05.867931 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2290132-ed74-4dbb-a286-a0c759b08c53 service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:05.868211 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2290132-ed74-4dbb-a286-a0c759b08c53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:05.868485 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2290132-ed74-4dbb-a286-a0c759b08c53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:05.870299 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e2290132-ed74-4dbb-a286-a0c759b08c53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:05.976593 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2290132-ed74-4dbb-a286-a0c759b08c53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:05.977999 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2290132-ed74-4dbb-a286-a0c759b08c53 service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:06.000671 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1403/2794] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:41:08.634244 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd70037-6aa2-4d29-815e-886e0660346d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:08.635856 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-9dd70037-6aa2-4d29-815e-886e0660346d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:08.701959 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd70037-6aa2-4d29-815e-886e0660346d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:08.706760 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee0815-7aaa-4cf5-9391-a1d77a1f36d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:08.707383 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee0815-7aaa-4cf5-9391-a1d77a1f36d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:08.707662 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee0815-7aaa-4cf5-9391-a1d77a1f36d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:08.707935 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee0815-7aaa-4cf5-9391-a1d77a1f36d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:08.709805 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a7ee0815-7aaa-4cf5-9391-a1d77a1f36d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:08.725161 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee0815-7aaa-4cf5-9391-a1d77a1f36d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:08.726617 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee0815-7aaa-4cf5-9391-a1d77a1f36d0 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:08.739897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1392/2795] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:41:13.958543 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0b6b7-c821-41a1-9f55-7e29198bfc3e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:13.959153 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0b6b7-c821-41a1-9f55-7e29198bfc3e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:13.959311 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0b6b7-c821-41a1-9f55-7e29198bfc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:13.980742 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-7dd0b6b7-c821-41a1-9f55-7e29198bfc3e None None] MFA Rules not processed for user `383a0c7b4e574409b477fa61581e63bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:13.982070 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7dd0b6b7-c821-41a1-9f55-7e29198bfc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:13.990079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1404/2796] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:41:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:18.733387 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=26 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:23.974604 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=78 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:06.425672 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee0815-7aaa-4cf5-9391-a1d77a1f36d0 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:06.427947 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a7ee0815-7aaa-4cf5-9391-a1d77a1f36d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:06.444125 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee0815-7aaa-4cf5-9391-a1d77a1f36d0 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:06.454804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1213b2a-41fb-44c8-8533-a064c3cbc0ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:06.455774 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1213b2a-41fb-44c8-8533-a064c3cbc0ab service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:06.456781 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1213b2a-41fb-44c8-8533-a064c3cbc0ab service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:06.457322 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1213b2a-41fb-44c8-8533-a064c3cbc0ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:06.459517 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a1213b2a-41fb-44c8-8533-a064c3cbc0ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:06.476044 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1213b2a-41fb-44c8-8533-a064c3cbc0ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:06.478098 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1213b2a-41fb-44c8-8533-a064c3cbc0ab service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:06.493542 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1393/2797] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:15.107765 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0b6b7-c821-41a1-9f55-7e29198bfc3e None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:15.110093 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-7dd0b6b7-c821-41a1-9f55-7e29198bfc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:15.178214 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0b6b7-c821-41a1-9f55-7e29198bfc3e None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:15.183113 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5af16-093f-46d0-b909-51dab620d13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:15.183843 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5af16-093f-46d0-b909-51dab620d13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:15.184129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5af16-093f-46d0-b909-51dab620d13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:15.184415 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5af16-093f-46d0-b909-51dab620d13a admin admin] PATH_INFO: `/v3/users/383a0c7b4e574409b477fa61581e63bf` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:15.185600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5af16-093f-46d0-b909-51dab620d13a admin admin] RBAC: Authorizing `identity:delete_user(user_id=383a0c7b4e574409b477fa61581e63bf)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:15.188189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5af16-093f-46d0-b909-51dab620d13a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:15.236893 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-61b5af16-093f-46d0-b909-51dab620d13a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '383a0c7b4e574409b477fa61581e63bf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:15.237482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-61b5af16-093f-46d0-b909-51dab620d13a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '383a0c7b4e574409b477fa61581e63bf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:15.245130 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-61b5af16-093f-46d0-b909-51dab620d13a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '383a0c7b4e574409b477fa61581e63bf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:15.245771 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-61b5af16-093f-46d0-b909-51dab620d13a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '383a0c7b4e574409b477fa61581e63bf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:15.258734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-61b5af16-093f-46d0-b909-51dab620d13a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '383a0c7b4e574409b477fa61581e63bf'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:15.272117 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1405/2798] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:42:15 2022] DELETE /identity/v3/users/383a0c7b4e574409b477fa61581e63bf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:15.453595 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1213b2a-41fb-44c8-8533-a064c3cbc0ab service nova] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:15.472808 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1213b2a-41fb-44c8-8533-a064c3cbc0ab service nova] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:15.533028 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f5c4d-1835-45f3-92cf-9633e41a1666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:15.533670 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f5c4d-1835-45f3-92cf-9633e41a1666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:15.533958 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f5c4d-1835-45f3-92cf-9633e41a1666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:15.534292 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f5c4d-1835-45f3-92cf-9633e41a1666 admin admin] PATH_INFO: `/v3/projects/39460d8652714b658648354b818f435f` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:15.535443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f5c4d-1835-45f3-92cf-9633e41a1666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39460d8652714b658648354b818f435f)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:15.537539 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f5c4d-1835-45f3-92cf-9633e41a1666 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:15.587273 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ee7f5c4d-1835-45f3-92cf-9633e41a1666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39460d8652714b658648354b818f435f', 'request_id': 'req-ee7f5c4d-1835-45f3-92cf-9633e41a1666'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:15.593844 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ee7f5c4d-1835-45f3-92cf-9633e41a1666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39460d8652714b658648354b818f435f', 'request_id': 'req-ee7f5c4d-1835-45f3-92cf-9633e41a1666'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:15.600984 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ee7f5c4d-1835-45f3-92cf-9633e41a1666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39460d8652714b658648354b818f435f', 'request_id': 'req-ee7f5c4d-1835-45f3-92cf-9633e41a1666'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:15.616389 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ee7f5c4d-1835-45f3-92cf-9633e41a1666 admin admin] The token cache is being invalidate because project 39460d8652714b658648354b818f435f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:42:15.616732 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ee7f5c4d-1835-45f3-92cf-9633e41a1666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:15.617364 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-ee7f5c4d-1835-45f3-92cf-9633e41a1666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:15.618877 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1394/2799] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:42:15 2022] DELETE /identity/v3/projects/39460d8652714b658648354b818f435f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:15.623829 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e47ebe-8cad-4894-b20e-ab0617fea036 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:15.624252 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e47ebe-8cad-4894-b20e-ab0617fea036 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:15.624615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e47ebe-8cad-4894-b20e-ab0617fea036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:15.647168 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-79e47ebe-8cad-4894-b20e-ab0617fea036 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:15.648403 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-79e47ebe-8cad-4894-b20e-ab0617fea036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:15.715114 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1406/2800] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:15.723538 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71176c5-d99b-41b3-a850-8a191c181585 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:15.723839 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71176c5-d99b-41b3-a850-8a191c181585 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:15.724126 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71176c5-d99b-41b3-a850-8a191c181585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:15.745475 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-a71176c5-d99b-41b3-a850-8a191c181585 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:15.746708 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-a71176c5-d99b-41b3-a850-8a191c181585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:15.754960 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1395/2801] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:15.759243 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e47ebe-8cad-4894-b20e-ab0617fea036 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:15.770806 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e47ebe-8cad-4894-b20e-ab0617fea036 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:15.775375 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff56cc-2758-4645-be77-5ac557d01794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:15.775978 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff56cc-2758-4645-be77-5ac557d01794 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:15.776261 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff56cc-2758-4645-be77-5ac557d01794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:15.776537 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff56cc-2758-4645-be77-5ac557d01794 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:15.777217 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff56cc-2758-4645-be77-5ac557d01794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:42:15.777522 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff56cc-2758-4645-be77-5ac557d01794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:15.779118 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff56cc-2758-4645-be77-5ac557d01794 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:15.791834 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1407/2802] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:15.796351 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71176c5-d99b-41b3-a850-8a191c181585 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:15.805818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71176c5-d99b-41b3-a850-8a191c181585 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:15.810493 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2436f-664d-45a2-9323-0d6324132a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:15.811655 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2436f-664d-45a2-9323-0d6324132a4b admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:15.811930 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2436f-664d-45a2-9323-0d6324132a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:15.812206 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2436f-664d-45a2-9323-0d6324132a4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:15.812880 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2436f-664d-45a2-9323-0d6324132a4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:15.814779 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2436f-664d-45a2-9323-0d6324132a4b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:15.853754 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1396/2803] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:42:15 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:42:15.857798 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff56cc-2758-4645-be77-5ac557d01794 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:15.868746 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff56cc-2758-4645-be77-5ac557d01794 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:15.872247 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:15.928189 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec033862-ade2-4cd8-a011-40b262759e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:15.928832 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec033862-ade2-4cd8-a011-40b262759e43 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:15.929120 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec033862-ade2-4cd8-a011-40b262759e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:15.929399 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec033862-ade2-4cd8-a011-40b262759e43 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:15.930045 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec033862-ade2-4cd8-a011-40b262759e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:15.931988 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec033862-ade2-4cd8-a011-40b262759e43 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:15.953513 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1408/2804] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:42:15 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:42:15.957738 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2436f-664d-45a2-9323-0d6324132a4b admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:15.968581 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2436f-664d-45a2-9323-0d6324132a4b admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:15.973463 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9d8af-a562-4134-8c8d-f4f557a840ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:15.974063 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9d8af-a562-4134-8c8d-f4f557a840ea admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:15.974343 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9d8af-a562-4134-8c8d-f4f557a840ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:15.974616 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9d8af-a562-4134-8c8d-f4f557a840ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:15.975380 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9d8af-a562-4134-8c8d-f4f557a840ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:15.976993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9d8af-a562-4134-8c8d-f4f557a840ea admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:15.987847 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1397/2805] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:42:15.992047 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec033862-ade2-4cd8-a011-40b262759e43 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:16.002572 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec033862-ade2-4cd8-a011-40b262759e43 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:16.007321 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6473a95-5ab3-4f27-9724-4d1b6fd9c662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:16.007932 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6473a95-5ab3-4f27-9724-4d1b6fd9c662 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:16.008214 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6473a95-5ab3-4f27-9724-4d1b6fd9c662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:16.008491 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6473a95-5ab3-4f27-9724-4d1b6fd9c662 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:16.009174 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6473a95-5ab3-4f27-9724-4d1b6fd9c662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:16.010773 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6473a95-5ab3-4f27-9724-4d1b6fd9c662 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:16.021692 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1409/2806] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:42:16.025950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9d8af-a562-4134-8c8d-f4f557a840ea admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:16.036669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9d8af-a562-4134-8c8d-f4f557a840ea admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:16.041269 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8786630-05a6-47ac-8c0e-2a7697f5431b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:16.041923 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8786630-05a6-47ac-8c0e-2a7697f5431b admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:16.042208 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8786630-05a6-47ac-8c0e-2a7697f5431b admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:16.042488 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8786630-05a6-47ac-8c0e-2a7697f5431b admin admin] PATH_INFO: `/v3/projects/85c56d3630604127ad89af0d5b33ea37/users/d474ec63554f46d9a1e132acfeb66fb2/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:16.058030 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8786630-05a6-47ac-8c0e-2a7697f5431b admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c56d3630604127ad89af0d5b33ea37, user_id=d474ec63554f46d9a1e132acfeb66fb2, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:16.060721 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8786630-05a6-47ac-8c0e-2a7697f5431b admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:16.074115 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1398/2807] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:42:16 2022] PUT /identity/v3/projects/85c56d3630604127ad89af0d5b33ea37/users/d474ec63554f46d9a1e132acfeb66fb2/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:16.085746 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a3c9a-f00e-46e9-ad70-3ab1177a1e9f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:16.086037 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a3c9a-f00e-46e9-ad70-3ab1177a1e9f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:16.086320 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a3c9a-f00e-46e9-ad70-3ab1177a1e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:16.115738 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-910a3c9a-f00e-46e9-ad70-3ab1177a1e9f None None] MFA Rules not processed for user `d474ec63554f46d9a1e132acfeb66fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:16.117005 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-910a3c9a-f00e-46e9-ad70-3ab1177a1e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:16.183580 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1410/2808] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:16.188546 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8786630-05a6-47ac-8c0e-2a7697f5431b admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:16.194348 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:16.256446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8786630-05a6-47ac-8c0e-2a7697f5431b admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:16.261137 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8e03b-db57-48c4-b0d9-94af471c4c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:16.261748 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8e03b-db57-48c4-b0d9-94af471c4c64 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:16.262031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8e03b-db57-48c4-b0d9-94af471c4c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:16.262309 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8e03b-db57-48c4-b0d9-94af471c4c64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:16.262942 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8e03b-db57-48c4-b0d9-94af471c4c64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:16.265479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8e03b-db57-48c4-b0d9-94af471c4c64 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:16.299919 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1399/2809] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:42:16 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:42:16.301350 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a3c9a-f00e-46e9-ad70-3ab1177a1e9f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:16.312573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a3c9a-f00e-46e9-ad70-3ab1177a1e9f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:16.372403 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edd2c1-5575-484b-9f8d-215303d35c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:16.373117 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edd2c1-5575-484b-9f8d-215303d35c0d admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:16.373407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edd2c1-5575-484b-9f8d-215303d35c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:16.373816 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edd2c1-5575-484b-9f8d-215303d35c0d admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:16.374718 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edd2c1-5575-484b-9f8d-215303d35c0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:16.376652 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edd2c1-5575-484b-9f8d-215303d35c0d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:16.398131 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1411/2810] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:42:16 2022] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:42:16.402253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8e03b-db57-48c4-b0d9-94af471c4c64 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:16.413341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8e03b-db57-48c4-b0d9-94af471c4c64 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:16.418022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7d591-3cf4-4ac2-a65c-4ddeb4761614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:16.418626 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7d591-3cf4-4ac2-a65c-4ddeb4761614 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:16.418909 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7d591-3cf4-4ac2-a65c-4ddeb4761614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:16.419186 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7d591-3cf4-4ac2-a65c-4ddeb4761614 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:16.419835 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7d591-3cf4-4ac2-a65c-4ddeb4761614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:16.421484 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7d591-3cf4-4ac2-a65c-4ddeb4761614 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:16.431966 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1400/2811] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:42:16.436231 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edd2c1-5575-484b-9f8d-215303d35c0d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:16.442585 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:16.446744 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edd2c1-5575-484b-9f8d-215303d35c0d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:16.453130 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eef3c3-48c9-4632-93b9-1c8981b326f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:16.453801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eef3c3-48c9-4632-93b9-1c8981b326f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:16.454271 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eef3c3-48c9-4632-93b9-1c8981b326f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:16.454659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eef3c3-48c9-4632-93b9-1c8981b326f1 admin admin] PATH_INFO: `/v3/projects/c297bc9a54df4a6ba81171116101d18a/users/ff905f032514421987e1ccd2eb6faf5d/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:16.471087 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eef3c3-48c9-4632-93b9-1c8981b326f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c297bc9a54df4a6ba81171116101d18a, user_id=ff905f032514421987e1ccd2eb6faf5d, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:16.473843 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eef3c3-48c9-4632-93b9-1c8981b326f1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:16.487884 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1412/2812] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:42:16 2022] PUT /identity/v3/projects/c297bc9a54df4a6ba81171116101d18a/users/ff905f032514421987e1ccd2eb6faf5d/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:16.491784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7d591-3cf4-4ac2-a65c-4ddeb4761614 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:16.503632 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7d591-3cf4-4ac2-a65c-4ddeb4761614 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:16.564870 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273987d-306a-45a9-948e-22638178c7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:16.565403 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273987d-306a-45a9-948e-22638178c7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:16.565688 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273987d-306a-45a9-948e-22638178c7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:16.565965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273987d-306a-45a9-948e-22638178c7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:16.566610 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273987d-306a-45a9-948e-22638178c7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:16.568206 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273987d-306a-45a9-948e-22638178c7a0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:16.578816 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1401/2813] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:42:16.583065 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eef3c3-48c9-4632-93b9-1c8981b326f1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:16.593826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eef3c3-48c9-4632-93b9-1c8981b326f1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:16.598721 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f65a6e-e6ab-4e0f-8333-bed80aa8b8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:16.599374 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f65a6e-e6ab-4e0f-8333-bed80aa8b8e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:16.599664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f65a6e-e6ab-4e0f-8333-bed80aa8b8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:16.599945 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f65a6e-e6ab-4e0f-8333-bed80aa8b8e4 admin admin] PATH_INFO: `/v3/projects/c297bc9a54df4a6ba81171116101d18a/users/ff905f032514421987e1ccd2eb6faf5d/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:16.601929 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f65a6e-e6ab-4e0f-8333-bed80aa8b8e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c297bc9a54df4a6ba81171116101d18a, user_id=ff905f032514421987e1ccd2eb6faf5d, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:16.604648 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f65a6e-e6ab-4e0f-8333-bed80aa8b8e4 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:16.616604 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1413/2814] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:42:16 2022] PUT /identity/v3/projects/c297bc9a54df4a6ba81171116101d18a/users/ff905f032514421987e1ccd2eb6faf5d/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:16.627042 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e6869-1e6f-4911-abc2-6863ef8372ec None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:16.627513 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e6869-1e6f-4911-abc2-6863ef8372ec None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:16.627665 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e6869-1e6f-4911-abc2-6863ef8372ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:16.658371 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-5b3e6869-1e6f-4911-abc2-6863ef8372ec None None] MFA Rules not processed for user `ff905f032514421987e1ccd2eb6faf5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:16.659625 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-5b3e6869-1e6f-4911-abc2-6863ef8372ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:16.728945 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:16.734368 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1402/2815] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:16 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:16.744615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f65a6e-e6ab-4e0f-8333-bed80aa8b8e4 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:16.746461 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c7f65a6e-e6ab-4e0f-8333-bed80aa8b8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:16.809321 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f65a6e-e6ab-4e0f-8333-bed80aa8b8e4 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:16.813315 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d602b35-316f-411d-a675-393dc19cebba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:16.813926 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d602b35-316f-411d-a675-393dc19cebba service cinder] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:16.814211 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d602b35-316f-411d-a675-393dc19cebba service cinder] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:16.814489 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d602b35-316f-411d-a675-393dc19cebba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:16.823917 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d602b35-316f-411d-a675-393dc19cebba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:16.825407 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d602b35-316f-411d-a675-393dc19cebba service cinder] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:16.835903 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1414/2816] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:16 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:16.976037 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e6869-1e6f-4911-abc2-6863ef8372ec None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:17.041246 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e6869-1e6f-4911-abc2-6863ef8372ec None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:17.045552 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194391af-780e-486b-8dcb-ee732e5193a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:17.046222 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194391af-780e-486b-8dcb-ee732e5193a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:17.046507 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194391af-780e-486b-8dcb-ee732e5193a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:17.046782 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194391af-780e-486b-8dcb-ee732e5193a0 admin admin] PATH_INFO: `/v3/users/d474ec63554f46d9a1e132acfeb66fb2` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:17.047919 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194391af-780e-486b-8dcb-ee732e5193a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d474ec63554f46d9a1e132acfeb66fb2)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:17.049876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194391af-780e-486b-8dcb-ee732e5193a0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:17.100482 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-194391af-780e-486b-8dcb-ee732e5193a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd474ec63554f46d9a1e132acfeb66fb2'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:17.101098 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-194391af-780e-486b-8dcb-ee732e5193a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd474ec63554f46d9a1e132acfeb66fb2'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:17.108756 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-194391af-780e-486b-8dcb-ee732e5193a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd474ec63554f46d9a1e132acfeb66fb2'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:17.109465 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-194391af-780e-486b-8dcb-ee732e5193a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd474ec63554f46d9a1e132acfeb66fb2'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:17.119117 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-194391af-780e-486b-8dcb-ee732e5193a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd474ec63554f46d9a1e132acfeb66fb2'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:17.138784 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1403/2817] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:42:16 2022] DELETE /identity/v3/users/d474ec63554f46d9a1e132acfeb66fb2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:17.144434 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f129d3a-8df7-421e-be96-ee41acba082e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:17.144961 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f129d3a-8df7-421e-be96-ee41acba082e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:17.145212 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f129d3a-8df7-421e-be96-ee41acba082e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:17.166724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0f129d3a-8df7-421e-be96-ee41acba082e None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:17.167942 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0f129d3a-8df7-421e-be96-ee41acba082e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:17.230150 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1415/2818] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:17.239886 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194391af-780e-486b-8dcb-ee732e5193a0 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:17.241341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-194391af-780e-486b-8dcb-ee732e5193a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:17.314815 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194391af-780e-486b-8dcb-ee732e5193a0 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:17.318705 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea96d5-5121-446c-bf19-bdabbb221986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:17.319350 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea96d5-5121-446c-bf19-bdabbb221986 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:17.319636 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea96d5-5121-446c-bf19-bdabbb221986 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:17.319916 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea96d5-5121-446c-bf19-bdabbb221986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:17.331091 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea96d5-5121-446c-bf19-bdabbb221986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:17.332593 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea96d5-5121-446c-bf19-bdabbb221986 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:17.343824 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1404/2819] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:17.633296 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f129d3a-8df7-421e-be96-ee41acba082e None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:17.634842 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0f129d3a-8df7-421e-be96-ee41acba082e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:17.648946 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f129d3a-8df7-421e-be96-ee41acba082e None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:17.654408 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a1b0f-d352-4b5e-874d-f89650b6ae95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:17.655129 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a1b0f-d352-4b5e-874d-f89650b6ae95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:17.655410 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a1b0f-d352-4b5e-874d-f89650b6ae95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:17.655714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a1b0f-d352-4b5e-874d-f89650b6ae95 admin admin] PATH_INFO: `/v3/projects/85c56d3630604127ad89af0d5b33ea37` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:17.656928 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a1b0f-d352-4b5e-874d-f89650b6ae95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85c56d3630604127ad89af0d5b33ea37)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:17.658827 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a1b0f-d352-4b5e-874d-f89650b6ae95 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:17.708350 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-748a1b0f-d352-4b5e-874d-f89650b6ae95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85c56d3630604127ad89af0d5b33ea37', 'request_id': 'req-748a1b0f-d352-4b5e-874d-f89650b6ae95'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:17.717222 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-748a1b0f-d352-4b5e-874d-f89650b6ae95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85c56d3630604127ad89af0d5b33ea37', 'request_id': 'req-748a1b0f-d352-4b5e-874d-f89650b6ae95'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:17.724106 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-748a1b0f-d352-4b5e-874d-f89650b6ae95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85c56d3630604127ad89af0d5b33ea37', 'request_id': 'req-748a1b0f-d352-4b5e-874d-f89650b6ae95'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:17.725224 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:17.738168 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-748a1b0f-d352-4b5e-874d-f89650b6ae95 admin admin] The token cache is being invalidate because project 85c56d3630604127ad89af0d5b33ea37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:42:17.738459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-748a1b0f-d352-4b5e-874d-f89650b6ae95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:17.739108 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-748a1b0f-d352-4b5e-874d-f89650b6ae95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:17.740600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1416/2820] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:42:17 2022] DELETE /identity/v3/projects/85c56d3630604127ad89af0d5b33ea37 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:17.744586 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea96d5-5121-446c-bf19-bdabbb221986 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:17.754883 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea96d5-5121-446c-bf19-bdabbb221986 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:17.773773 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:17.818666 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be091d05-a7bd-4b97-85e3-62b6638f76f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:17.819311 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be091d05-a7bd-4b97-85e3-62b6638f76f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:17.819592 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be091d05-a7bd-4b97-85e3-62b6638f76f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:17.819867 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be091d05-a7bd-4b97-85e3-62b6638f76f7 admin admin] PATH_INFO: `/v3/users/ff905f032514421987e1ccd2eb6faf5d` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:17.821341 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be091d05-a7bd-4b97-85e3-62b6638f76f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff905f032514421987e1ccd2eb6faf5d)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:17.823812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be091d05-a7bd-4b97-85e3-62b6638f76f7 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:17.872887 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-be091d05-a7bd-4b97-85e3-62b6638f76f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff905f032514421987e1ccd2eb6faf5d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:17.873460 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-be091d05-a7bd-4b97-85e3-62b6638f76f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff905f032514421987e1ccd2eb6faf5d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:17.880720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-be091d05-a7bd-4b97-85e3-62b6638f76f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff905f032514421987e1ccd2eb6faf5d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:17.881443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-be091d05-a7bd-4b97-85e3-62b6638f76f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff905f032514421987e1ccd2eb6faf5d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:17.890107 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-be091d05-a7bd-4b97-85e3-62b6638f76f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff905f032514421987e1ccd2eb6faf5d'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:17.908565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1405/2821] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:42:17 2022] DELETE /identity/v3/users/ff905f032514421987e1ccd2eb6faf5d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:18.183988 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a1b0f-d352-4b5e-874d-f89650b6ae95 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:18.185444 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-748a1b0f-d352-4b5e-874d-f89650b6ae95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:18.199769 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a1b0f-d352-4b5e-874d-f89650b6ae95 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:18.258348 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038cda1-ccba-4a3d-98bb-ed29ebbed99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:18.258989 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038cda1-ccba-4a3d-98bb-ed29ebbed99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:18.259270 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038cda1-ccba-4a3d-98bb-ed29ebbed99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:18.259543 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038cda1-ccba-4a3d-98bb-ed29ebbed99f admin admin] PATH_INFO: `/v3/projects/c297bc9a54df4a6ba81171116101d18a` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:18.260659 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038cda1-ccba-4a3d-98bb-ed29ebbed99f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c297bc9a54df4a6ba81171116101d18a)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:18.262625 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038cda1-ccba-4a3d-98bb-ed29ebbed99f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:18.312150 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2038cda1-ccba-4a3d-98bb-ed29ebbed99f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c297bc9a54df4a6ba81171116101d18a', 'request_id': 'req-2038cda1-ccba-4a3d-98bb-ed29ebbed99f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:18.320033 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2038cda1-ccba-4a3d-98bb-ed29ebbed99f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c297bc9a54df4a6ba81171116101d18a', 'request_id': 'req-2038cda1-ccba-4a3d-98bb-ed29ebbed99f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:18.327688 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2038cda1-ccba-4a3d-98bb-ed29ebbed99f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c297bc9a54df4a6ba81171116101d18a', 'request_id': 'req-2038cda1-ccba-4a3d-98bb-ed29ebbed99f'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:18.338995 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2038cda1-ccba-4a3d-98bb-ed29ebbed99f admin admin] The token cache is being invalidate because project c297bc9a54df4a6ba81171116101d18a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81517) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:42:18.339289 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2038cda1-ccba-4a3d-98bb-ed29ebbed99f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:18.339954 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-2038cda1-ccba-4a3d-98bb-ed29ebbed99f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:18.341478 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1417/2822] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:42:18 2022] DELETE /identity/v3/projects/c297bc9a54df4a6ba81171116101d18a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:18.347321 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7865e-3dd3-471e-ba3d-6070d8227660 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:18.347622 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7865e-3dd3-471e-ba3d-6070d8227660 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:18.348124 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7865e-3dd3-471e-ba3d-6070d8227660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:18.368323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-93b7865e-3dd3-471e-ba3d-6070d8227660 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:18.369584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-93b7865e-3dd3-471e-ba3d-6070d8227660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:18.431973 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1406/2823] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:18.441530 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929772f-b22b-4304-b115-064c7768dd2c None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:18.441847 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929772f-b22b-4304-b115-064c7768dd2c None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:18.442127 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929772f-b22b-4304-b115-064c7768dd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:18.461587 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-e929772f-b22b-4304-b115-064c7768dd2c None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:18.462843 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-e929772f-b22b-4304-b115-064c7768dd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:18.471307 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1418/2824] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:18.475535 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7865e-3dd3-471e-ba3d-6070d8227660 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:18.485989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7865e-3dd3-471e-ba3d-6070d8227660 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:18.490629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd6f7d-41ec-4fd3-b570-973b6346caa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:18.491245 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd6f7d-41ec-4fd3-b570-973b6346caa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:18.491527 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd6f7d-41ec-4fd3-b570-973b6346caa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:18.491800 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd6f7d-41ec-4fd3-b570-973b6346caa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:18.492443 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd6f7d-41ec-4fd3-b570-973b6346caa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81516) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:42:18.492775 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd6f7d-41ec-4fd3-b570-973b6346caa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:18.494360 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd6f7d-41ec-4fd3-b570-973b6346caa8 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:18.506921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1407/2825] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:18.511385 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929772f-b22b-4304-b115-064c7768dd2c None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:18.524270 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929772f-b22b-4304-b115-064c7768dd2c None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:18.529002 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee33694-a1bb-47e4-adea-8d537beb1b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:18.529616 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee33694-a1bb-47e4-adea-8d537beb1b6d admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:18.529971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee33694-a1bb-47e4-adea-8d537beb1b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:18.530303 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee33694-a1bb-47e4-adea-8d537beb1b6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:18.531078 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee33694-a1bb-47e4-adea-8d537beb1b6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:18.533723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee33694-a1bb-47e4-adea-8d537beb1b6d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:18.563854 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1419/2826] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:42:18 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:42:18.567999 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd6f7d-41ec-4fd3-b570-973b6346caa8 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:18.578807 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd6f7d-41ec-4fd3-b570-973b6346caa8 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:18.605489 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:18.636950 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79187a-c7a1-4589-9d56-75f249e3a944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:18.637559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79187a-c7a1-4589-9d56-75f249e3a944 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:18.637843 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79187a-c7a1-4589-9d56-75f249e3a944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:18.638120 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79187a-c7a1-4589-9d56-75f249e3a944 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:18.638753 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79187a-c7a1-4589-9d56-75f249e3a944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:18.641287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79187a-c7a1-4589-9d56-75f249e3a944 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:18.664570 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1408/2827] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:42:18 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:42:18.672328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee33694-a1bb-47e4-adea-8d537beb1b6d admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:18.683733 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee33694-a1bb-47e4-adea-8d537beb1b6d admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:18.689122 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0eb09-468e-4a81-aa99-d0d960d7e7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:18.689736 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0eb09-468e-4a81-aa99-d0d960d7e7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:18.690019 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0eb09-468e-4a81-aa99-d0d960d7e7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:18.690294 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0eb09-468e-4a81-aa99-d0d960d7e7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:18.690937 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0eb09-468e-4a81-aa99-d0d960d7e7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:18.692548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0eb09-468e-4a81-aa99-d0d960d7e7b7 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:18.703328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1420/2828] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:42:18.707406 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79187a-c7a1-4589-9d56-75f249e3a944 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:18.717629 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79187a-c7a1-4589-9d56-75f249e3a944 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:18.722838 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3858c-3817-42ba-a779-0bf1164e4985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:18.723426 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3858c-3817-42ba-a779-0bf1164e4985 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:18.723712 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3858c-3817-42ba-a779-0bf1164e4985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:18.723989 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3858c-3817-42ba-a779-0bf1164e4985 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:18.724638 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3858c-3817-42ba-a779-0bf1164e4985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:18.726266 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3858c-3817-42ba-a779-0bf1164e4985 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:18.738053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1409/2829] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:42:18.742145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0eb09-468e-4a81-aa99-d0d960d7e7b7 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:18.752960 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0eb09-468e-4a81-aa99-d0d960d7e7b7 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:18.757604 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93de1b8-9608-4008-9bb2-5f02f9974d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:18.758266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93de1b8-9608-4008-9bb2-5f02f9974d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:18.758551 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93de1b8-9608-4008-9bb2-5f02f9974d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:18.758838 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93de1b8-9608-4008-9bb2-5f02f9974d60 admin admin] PATH_INFO: `/v3/projects/d73f8443e9894e32afea5664e3bcb909/users/fbb791c43b0143f0b918c22f061a3487/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:18.773704 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93de1b8-9608-4008-9bb2-5f02f9974d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73f8443e9894e32afea5664e3bcb909, user_id=fbb791c43b0143f0b918c22f061a3487, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:18.776368 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93de1b8-9608-4008-9bb2-5f02f9974d60 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:18.789739 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1421/2830] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:42:18 2022] PUT /identity/v3/projects/d73f8443e9894e32afea5664e3bcb909/users/fbb791c43b0143f0b918c22f061a3487/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:18.800647 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd351197-5072-4772-be9a-5fac4e62042d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:18.801175 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd351197-5072-4772-be9a-5fac4e62042d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:18.801425 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd351197-5072-4772-be9a-5fac4e62042d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:18.833009 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-bd351197-5072-4772-be9a-5fac4e62042d None None] MFA Rules not processed for user `fbb791c43b0143f0b918c22f061a3487`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:18.833726 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-bd351197-5072-4772-be9a-5fac4e62042d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:18.902093 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1410/2831] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:18.906801 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93de1b8-9608-4008-9bb2-5f02f9974d60 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:18.928760 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:18.976018 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93de1b8-9608-4008-9bb2-5f02f9974d60 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:18.980811 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662da92-f27d-4b43-9e92-e76703838ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:18.981427 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662da92-f27d-4b43-9e92-e76703838ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:18.981714 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662da92-f27d-4b43-9e92-e76703838ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:18.982322 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662da92-f27d-4b43-9e92-e76703838ed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:18.982620 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662da92-f27d-4b43-9e92-e76703838ed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:18.984539 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662da92-f27d-4b43-9e92-e76703838ed2 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:19.013347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1422/2832] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:42:18 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:42:19.018243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd351197-5072-4772-be9a-5fac4e62042d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:19.029065 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd351197-5072-4772-be9a-5fac4e62042d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:19.087196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceda784-3139-4c00-8bf1-aca8f4840c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:19.087846 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceda784-3139-4c00-8bf1-aca8f4840c21 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:19.088134 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceda784-3139-4c00-8bf1-aca8f4840c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:19.088417 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceda784-3139-4c00-8bf1-aca8f4840c21 admin admin] PATH_INFO: `/v3/users` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:19.089218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceda784-3139-4c00-8bf1-aca8f4840c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:19.091169 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceda784-3139-4c00-8bf1-aca8f4840c21 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:19.112380 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1411/2833] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:42:19 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:42:19.116312 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662da92-f27d-4b43-9e92-e76703838ed2 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:19.127974 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662da92-f27d-4b43-9e92-e76703838ed2 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:19.132624 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4799bc8-2da9-4d46-82bb-dc5113abd17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:19.133267 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4799bc8-2da9-4d46-82bb-dc5113abd17b admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:19.133546 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4799bc8-2da9-4d46-82bb-dc5113abd17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:19.133822 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4799bc8-2da9-4d46-82bb-dc5113abd17b admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:19.134486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4799bc8-2da9-4d46-82bb-dc5113abd17b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:19.136079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4799bc8-2da9-4d46-82bb-dc5113abd17b admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:19.147816 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1423/2834] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:42:19.152327 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceda784-3139-4c00-8bf1-aca8f4840c21 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:19.162645 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceda784-3139-4c00-8bf1-aca8f4840c21 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:19.167318 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cfc4d-652e-4bb1-a87a-5f9a8efa0a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:19.167980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cfc4d-652e-4bb1-a87a-5f9a8efa0a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:19.168265 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cfc4d-652e-4bb1-a87a-5f9a8efa0a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:19.168545 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cfc4d-652e-4bb1-a87a-5f9a8efa0a1f admin admin] PATH_INFO: `/v3/projects/e256ad5c6e254d85a6254e54e9794831/users/408f76ea047c4ed98b3e219805b87eea/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:19.189681 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cfc4d-652e-4bb1-a87a-5f9a8efa0a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e256ad5c6e254d85a6254e54e9794831, user_id=408f76ea047c4ed98b3e219805b87eea, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:19.192354 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cfc4d-652e-4bb1-a87a-5f9a8efa0a1f admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:19.206479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1412/2835] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:42:19 2022] PUT /identity/v3/projects/e256ad5c6e254d85a6254e54e9794831/users/408f76ea047c4ed98b3e219805b87eea/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:19.210381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4799bc8-2da9-4d46-82bb-dc5113abd17b admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:19.220838 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4799bc8-2da9-4d46-82bb-dc5113abd17b admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:19.277881 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b52bbc-f7ab-483f-ba8c-4499a14ea24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:19.278497 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b52bbc-f7ab-483f-ba8c-4499a14ea24a admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:19.278782 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b52bbc-f7ab-483f-ba8c-4499a14ea24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:19.279067 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b52bbc-f7ab-483f-ba8c-4499a14ea24a admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:19.279755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b52bbc-f7ab-483f-ba8c-4499a14ea24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:19.281432 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b52bbc-f7ab-483f-ba8c-4499a14ea24a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:19.292349 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1424/2836] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:42:19.297719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cfc4d-652e-4bb1-a87a-5f9a8efa0a1f admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:19.303409 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:19.312352 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cfc4d-652e-4bb1-a87a-5f9a8efa0a1f admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:19.317261 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b6d2d-bf7e-434c-bff7-4fe48ebc30fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:19.317935 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b6d2d-bf7e-434c-bff7-4fe48ebc30fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:19.318218 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b6d2d-bf7e-434c-bff7-4fe48ebc30fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:19.318497 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b6d2d-bf7e-434c-bff7-4fe48ebc30fd admin admin] PATH_INFO: `/v3/projects/e256ad5c6e254d85a6254e54e9794831/users/408f76ea047c4ed98b3e219805b87eea/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:19.320423 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b6d2d-bf7e-434c-bff7-4fe48ebc30fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e256ad5c6e254d85a6254e54e9794831, user_id=408f76ea047c4ed98b3e219805b87eea, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:19.323111 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b6d2d-bf7e-434c-bff7-4fe48ebc30fd admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:19.334511 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1413/2837] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:42:19 2022] PUT /identity/v3/projects/e256ad5c6e254d85a6254e54e9794831/users/408f76ea047c4ed98b3e219805b87eea/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:42:19.345401 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6109fc9-dc49-4f09-8421-44977385a65b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:19.345664 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6109fc9-dc49-4f09-8421-44977385a65b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:19.345944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6109fc9-dc49-4f09-8421-44977385a65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:19.376328 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-d6109fc9-dc49-4f09-8421-44977385a65b None None] MFA Rules not processed for user `408f76ea047c4ed98b3e219805b87eea`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:19.377570 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-d6109fc9-dc49-4f09-8421-44977385a65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:19.445512 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1425/2838] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:42:19.456994 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b6d2d-bf7e-434c-bff7-4fe48ebc30fd admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:19.458808 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-851b6d2d-bf7e-434c-bff7-4fe48ebc30fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:19.521434 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b6d2d-bf7e-434c-bff7-4fe48ebc30fd admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:19.525120 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638207e-feab-47ae-a2d8-5149f5a1e05b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:19.525732 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638207e-feab-47ae-a2d8-5149f5a1e05b service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:19.526020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638207e-feab-47ae-a2d8-5149f5a1e05b service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:19.526300 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638207e-feab-47ae-a2d8-5149f5a1e05b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:19.536663 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638207e-feab-47ae-a2d8-5149f5a1e05b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:19.538164 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638207e-feab-47ae-a2d8-5149f5a1e05b service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:19.548330 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1414/2839] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:19.942855 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6109fc9-dc49-4f09-8421-44977385a65b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:19.961975 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:20.011843 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6109fc9-dc49-4f09-8421-44977385a65b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:20.017200 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f3fe6-98dc-464a-97a9-e5f42f53fa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:20.017877 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f3fe6-98dc-464a-97a9-e5f42f53fa11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:20.018161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f3fe6-98dc-464a-97a9-e5f42f53fa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:20.018449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f3fe6-98dc-464a-97a9-e5f42f53fa11 admin admin] PATH_INFO: `/v3/users/fbb791c43b0143f0b918c22f061a3487` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:20.019716 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f3fe6-98dc-464a-97a9-e5f42f53fa11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbb791c43b0143f0b918c22f061a3487)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:20.021908 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f3fe6-98dc-464a-97a9-e5f42f53fa11 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:20.074008 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-889f3fe6-98dc-464a-97a9-e5f42f53fa11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbb791c43b0143f0b918c22f061a3487'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:20.074665 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-889f3fe6-98dc-464a-97a9-e5f42f53fa11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbb791c43b0143f0b918c22f061a3487'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:20.083711 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-889f3fe6-98dc-464a-97a9-e5f42f53fa11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbb791c43b0143f0b918c22f061a3487'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:20.084336 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-889f3fe6-98dc-464a-97a9-e5f42f53fa11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbb791c43b0143f0b918c22f061a3487'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:20.097555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-889f3fe6-98dc-464a-97a9-e5f42f53fa11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbb791c43b0143f0b918c22f061a3487'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:20.110205 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1426/2840] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:42:19 2022] DELETE /identity/v3/users/fbb791c43b0143f0b918c22f061a3487 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:20.114829 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330a677-92ca-43d8-a84c-e2e3a90c4bc2 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:20.115300 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330a677-92ca-43d8-a84c-e2e3a90c4bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:20.115398 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330a677-92ca-43d8-a84c-e2e3a90c4bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:20.134335 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-2330a677-92ca-43d8-a84c-e2e3a90c4bc2 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:20.135563 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2330a677-92ca-43d8-a84c-e2e3a90c4bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:20.205896 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1415/2841] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:20.215613 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f3fe6-98dc-464a-97a9-e5f42f53fa11 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:20.217007 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-889f3fe6-98dc-464a-97a9-e5f42f53fa11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:20.275976 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f3fe6-98dc-464a-97a9-e5f42f53fa11 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:20.279656 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48d1be-d187-4b02-84fc-1b73fb509a8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:20.280881 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48d1be-d187-4b02-84fc-1b73fb509a8d service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:20.281169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48d1be-d187-4b02-84fc-1b73fb509a8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:20.281444 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48d1be-d187-4b02-84fc-1b73fb509a8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:20.290717 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48d1be-d187-4b02-84fc-1b73fb509a8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:20.292155 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48d1be-d187-4b02-84fc-1b73fb509a8d service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:20.301656 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1427/2842] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:20.574595 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330a677-92ca-43d8-a84c-e2e3a90c4bc2 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:20.576043 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2330a677-92ca-43d8-a84c-e2e3a90c4bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:20.589129 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330a677-92ca-43d8-a84c-e2e3a90c4bc2 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:20.593958 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb946f-ae4d-495a-8ae7-930fd0281fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:20.594980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb946f-ae4d-495a-8ae7-930fd0281fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:20.595355 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb946f-ae4d-495a-8ae7-930fd0281fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:20.595722 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb946f-ae4d-495a-8ae7-930fd0281fcb admin admin] PATH_INFO: `/v3/projects/d73f8443e9894e32afea5664e3bcb909` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:20.596986 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb946f-ae4d-495a-8ae7-930fd0281fcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d73f8443e9894e32afea5664e3bcb909)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:20.599005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb946f-ae4d-495a-8ae7-930fd0281fcb admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:20.646818 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-15bb946f-ae4d-495a-8ae7-930fd0281fcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd73f8443e9894e32afea5664e3bcb909', 'request_id': 'req-15bb946f-ae4d-495a-8ae7-930fd0281fcb'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:20.652373 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-15bb946f-ae4d-495a-8ae7-930fd0281fcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd73f8443e9894e32afea5664e3bcb909', 'request_id': 'req-15bb946f-ae4d-495a-8ae7-930fd0281fcb'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:20.659198 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-15bb946f-ae4d-495a-8ae7-930fd0281fcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd73f8443e9894e32afea5664e3bcb909', 'request_id': 'req-15bb946f-ae4d-495a-8ae7-930fd0281fcb'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:20.671637 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-15bb946f-ae4d-495a-8ae7-930fd0281fcb admin admin] The token cache is being invalidate because project d73f8443e9894e32afea5664e3bcb909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:42:20.671932 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-15bb946f-ae4d-495a-8ae7-930fd0281fcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:20.672568 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-15bb946f-ae4d-495a-8ae7-930fd0281fcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:20.674080 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1416/2843] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:42:20 2022] DELETE /identity/v3/projects/d73f8443e9894e32afea5664e3bcb909 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:20.678200 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48d1be-d187-4b02-84fc-1b73fb509a8d service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:20.688416 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48d1be-d187-4b02-84fc-1b73fb509a8d service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:20.723131 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:20.748484 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963c509-70c1-4bba-8ff1-f179e12a8fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:20.749639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963c509-70c1-4bba-8ff1-f179e12a8fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:20.749923 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963c509-70c1-4bba-8ff1-f179e12a8fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:20.750203 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963c509-70c1-4bba-8ff1-f179e12a8fd3 admin admin] PATH_INFO: `/v3/users/408f76ea047c4ed98b3e219805b87eea` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:20.751373 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963c509-70c1-4bba-8ff1-f179e12a8fd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=408f76ea047c4ed98b3e219805b87eea)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:20.753374 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963c509-70c1-4bba-8ff1-f179e12a8fd3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:20.800423 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6963c509-70c1-4bba-8ff1-f179e12a8fd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '408f76ea047c4ed98b3e219805b87eea'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:20.801088 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6963c509-70c1-4bba-8ff1-f179e12a8fd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '408f76ea047c4ed98b3e219805b87eea'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:20.809425 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6963c509-70c1-4bba-8ff1-f179e12a8fd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '408f76ea047c4ed98b3e219805b87eea'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:20.810106 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6963c509-70c1-4bba-8ff1-f179e12a8fd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '408f76ea047c4ed98b3e219805b87eea'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:20.828852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-6963c509-70c1-4bba-8ff1-f179e12a8fd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '408f76ea047c4ed98b3e219805b87eea'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:20.842195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1428/2844] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:42:20 2022] DELETE /identity/v3/users/408f76ea047c4ed98b3e219805b87eea => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:21.124439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb946f-ae4d-495a-8ae7-930fd0281fcb admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:21.126031 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-15bb946f-ae4d-495a-8ae7-930fd0281fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:21.140887 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb946f-ae4d-495a-8ae7-930fd0281fcb admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:21.155196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:21.205129 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ec907-e992-4e6e-b6cb-1267a04c18ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:21.205805 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ec907-e992-4e6e-b6cb-1267a04c18ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:21.206088 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ec907-e992-4e6e-b6cb-1267a04c18ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:21.206368 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ec907-e992-4e6e-b6cb-1267a04c18ec admin admin] PATH_INFO: `/v3/projects/e256ad5c6e254d85a6254e54e9794831` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:21.207527 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ec907-e992-4e6e-b6cb-1267a04c18ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=e256ad5c6e254d85a6254e54e9794831)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:21.209479 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ec907-e992-4e6e-b6cb-1267a04c18ec admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:21.256718 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-cf7ec907-e992-4e6e-b6cb-1267a04c18ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e256ad5c6e254d85a6254e54e9794831', 'request_id': 'req-cf7ec907-e992-4e6e-b6cb-1267a04c18ec'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:21.262195 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-cf7ec907-e992-4e6e-b6cb-1267a04c18ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e256ad5c6e254d85a6254e54e9794831', 'request_id': 'req-cf7ec907-e992-4e6e-b6cb-1267a04c18ec'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:21.269108 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-cf7ec907-e992-4e6e-b6cb-1267a04c18ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e256ad5c6e254d85a6254e54e9794831', 'request_id': 'req-cf7ec907-e992-4e6e-b6cb-1267a04c18ec'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:21.281883 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-cf7ec907-e992-4e6e-b6cb-1267a04c18ec admin admin] The token cache is being invalidate because project e256ad5c6e254d85a6254e54e9794831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:42:21.282178 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-cf7ec907-e992-4e6e-b6cb-1267a04c18ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:21.282804 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-cf7ec907-e992-4e6e-b6cb-1267a04c18ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:21.284284 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1417/2845] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:42:21 2022] DELETE /identity/v3/projects/e256ad5c6e254d85a6254e54e9794831 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:21.290008 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb966f9-6aee-4148-90c3-69ec1f948c73 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:21.290486 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb966f9-6aee-4148-90c3-69ec1f948c73 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:21.290608 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb966f9-6aee-4148-90c3-69ec1f948c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:21.310304 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-2eb966f9-6aee-4148-90c3-69ec1f948c73 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:21.312018 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-2eb966f9-6aee-4148-90c3-69ec1f948c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:21.374468 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1429/2846] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:21.438678 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5be56-c546-45b1-bd7c-dc19d76868fa None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:21.438965 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5be56-c546-45b1-bd7c-dc19d76868fa None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:21.439240 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5be56-c546-45b1-bd7c-dc19d76868fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:21.459166 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-2ff5be56-c546-45b1-bd7c-dc19d76868fa None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:21.460374 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-2ff5be56-c546-45b1-bd7c-dc19d76868fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:21.469199 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1418/2847] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:42:21.473686 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb966f9-6aee-4148-90c3-69ec1f948c73 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:21.484297 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb966f9-6aee-4148-90c3-69ec1f948c73 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:21.491165 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914b3c0-4673-4488-b03c-96d99174e007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:21.491779 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914b3c0-4673-4488-b03c-96d99174e007 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:21.492066 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914b3c0-4673-4488-b03c-96d99174e007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:21.492337 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914b3c0-4673-4488-b03c-96d99174e007 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:21.493025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914b3c0-4673-4488-b03c-96d99174e007 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:42:21.493327 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914b3c0-4673-4488-b03c-96d99174e007 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:21.494949 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914b3c0-4673-4488-b03c-96d99174e007 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:21.507755 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1430/2848] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:21.512039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5be56-c546-45b1-bd7c-dc19d76868fa None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:21.522433 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5be56-c546-45b1-bd7c-dc19d76868fa None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:21.527149 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff87c1e-2d37-4b68-a167-2b7c7b9ede07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:21.527771 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff87c1e-2d37-4b68-a167-2b7c7b9ede07 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:21.528038 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff87c1e-2d37-4b68-a167-2b7c7b9ede07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:21.528319 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff87c1e-2d37-4b68-a167-2b7c7b9ede07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:21.528993 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff87c1e-2d37-4b68-a167-2b7c7b9ede07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:21.531481 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff87c1e-2d37-4b68-a167-2b7c7b9ede07 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:21.559230 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1419/2849] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:42:21 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:42:21.563965 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914b3c0-4673-4488-b03c-96d99174e007 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:21.573941 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914b3c0-4673-4488-b03c-96d99174e007 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:21.616059 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:21.632448 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2dcea9-3af7-4902-b736-181e3eaab69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:21.633086 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dcea9-3af7-4902-b736-181e3eaab69f admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:21.633368 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dcea9-3af7-4902-b736-181e3eaab69f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:21.633645 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dcea9-3af7-4902-b736-181e3eaab69f admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:21.635112 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2dcea9-3af7-4902-b736-181e3eaab69f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:21.637075 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2dcea9-3af7-4902-b736-181e3eaab69f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:21.663216 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1431/2850] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:42:21 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:42:21.664773 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff87c1e-2d37-4b68-a167-2b7c7b9ede07 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:21.675438 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff87c1e-2d37-4b68-a167-2b7c7b9ede07 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:21.680055 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc07f00-c252-4621-8734-c7e3fd3fd79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:21.680662 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc07f00-c252-4621-8734-c7e3fd3fd79c admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:21.681121 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc07f00-c252-4621-8734-c7e3fd3fd79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:21.681398 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc07f00-c252-4621-8734-c7e3fd3fd79c admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:21.682046 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc07f00-c252-4621-8734-c7e3fd3fd79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:21.683648 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc07f00-c252-4621-8734-c7e3fd3fd79c admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:21.694013 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1420/2851] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:42:21.698133 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2dcea9-3af7-4902-b736-181e3eaab69f admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:21.708869 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2dcea9-3af7-4902-b736-181e3eaab69f admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:21.713507 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d587e1f-5952-4e1b-b004-b8aca521a64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:21.714111 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d587e1f-5952-4e1b-b004-b8aca521a64d admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:21.714396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d587e1f-5952-4e1b-b004-b8aca521a64d admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:21.714674 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d587e1f-5952-4e1b-b004-b8aca521a64d admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:21.715332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d587e1f-5952-4e1b-b004-b8aca521a64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:21.717080 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d587e1f-5952-4e1b-b004-b8aca521a64d admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:21.728808 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1432/2852] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:42:21.733140 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc07f00-c252-4621-8734-c7e3fd3fd79c admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:21.743297 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc07f00-c252-4621-8734-c7e3fd3fd79c admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:21.747879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c614e-798d-4cfb-a996-4f474447c33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:21.748574 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c614e-798d-4cfb-a996-4f474447c33e admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:21.749053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c614e-798d-4cfb-a996-4f474447c33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:21.749446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c614e-798d-4cfb-a996-4f474447c33e admin admin] PATH_INFO: `/v3/projects/1835857462c944509fbd46a43ecd1278/users/baf26e397ba04a628bf0619cf31ea6da/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:21.764714 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c614e-798d-4cfb-a996-4f474447c33e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1835857462c944509fbd46a43ecd1278, user_id=baf26e397ba04a628bf0619cf31ea6da, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:21.767496 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c614e-798d-4cfb-a996-4f474447c33e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:21.781404 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1421/2853] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:42:21 2022] PUT /identity/v3/projects/1835857462c944509fbd46a43ecd1278/users/baf26e397ba04a628bf0619cf31ea6da/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:21.791276 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604b221-a3ef-4968-8e4c-c56d291d9d44 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:21.791565 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604b221-a3ef-4968-8e4c-c56d291d9d44 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:21.791870 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604b221-a3ef-4968-8e4c-c56d291d9d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:21.821179 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0604b221-a3ef-4968-8e4c-c56d291d9d44 None None] MFA Rules not processed for user `baf26e397ba04a628bf0619cf31ea6da`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:21.822412 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0604b221-a3ef-4968-8e4c-c56d291d9d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:21.890698 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1433/2854] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:21.901929 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c614e-798d-4cfb-a996-4f474447c33e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:21.903792 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-eb7c614e-798d-4cfb-a996-4f474447c33e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:21.952508 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:21.966529 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c614e-798d-4cfb-a996-4f474447c33e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:21.971314 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5624c24-7681-4ed2-95be-d71f6404f60e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:21.971928 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5624c24-7681-4ed2-95be-d71f6404f60e service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:21.972214 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5624c24-7681-4ed2-95be-d71f6404f60e service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:21.972496 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5624c24-7681-4ed2-95be-d71f6404f60e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:21.981296 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5624c24-7681-4ed2-95be-d71f6404f60e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:21.982740 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5624c24-7681-4ed2-95be-d71f6404f60e service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:21.992531 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1422/2855] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:24.552957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604b221-a3ef-4968-8e4c-c56d291d9d44 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:24.621907 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604b221-a3ef-4968-8e4c-c56d291d9d44 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:24.627159 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df9a7e-fd43-4fde-9ccd-ddce7c020900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:24.627792 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df9a7e-fd43-4fde-9ccd-ddce7c020900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:24.628099 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df9a7e-fd43-4fde-9ccd-ddce7c020900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:24.628450 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df9a7e-fd43-4fde-9ccd-ddce7c020900 admin admin] PATH_INFO: `/v3/users/baf26e397ba04a628bf0619cf31ea6da` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:24.629549 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df9a7e-fd43-4fde-9ccd-ddce7c020900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf26e397ba04a628bf0619cf31ea6da)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:24.631471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df9a7e-fd43-4fde-9ccd-ddce7c020900 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:24.679639 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b8df9a7e-fd43-4fde-9ccd-ddce7c020900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf26e397ba04a628bf0619cf31ea6da'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:24.680329 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b8df9a7e-fd43-4fde-9ccd-ddce7c020900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf26e397ba04a628bf0619cf31ea6da'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:24.688363 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b8df9a7e-fd43-4fde-9ccd-ddce7c020900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf26e397ba04a628bf0619cf31ea6da'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:24.689228 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b8df9a7e-fd43-4fde-9ccd-ddce7c020900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf26e397ba04a628bf0619cf31ea6da'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:24.690501 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:24.703306 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-b8df9a7e-fd43-4fde-9ccd-ddce7c020900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf26e397ba04a628bf0619cf31ea6da'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:24.715596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1434/2856] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:42:24 2022] DELETE /identity/v3/users/baf26e397ba04a628bf0619cf31ea6da => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:24.720367 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4227a-749c-41d2-803c-1cdedae8c577 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:24.720962 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4227a-749c-41d2-803c-1cdedae8c577 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:24.720962 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4227a-749c-41d2-803c-1cdedae8c577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:24.739835 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-7fe4227a-749c-41d2-803c-1cdedae8c577 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:24.741064 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7fe4227a-749c-41d2-803c-1cdedae8c577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:24.801625 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1423/2857] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:24.811467 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df9a7e-fd43-4fde-9ccd-ddce7c020900 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:24.813017 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-b8df9a7e-fd43-4fde-9ccd-ddce7c020900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:24.872389 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df9a7e-fd43-4fde-9ccd-ddce7c020900 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:24.876419 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579caf3-accd-4c4f-9c23-f7c3a64b5a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:24.877054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579caf3-accd-4c4f-9c23-f7c3a64b5a32 service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:24.877336 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579caf3-accd-4c4f-9c23-f7c3a64b5a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:24.877606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579caf3-accd-4c4f-9c23-f7c3a64b5a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:24.886498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579caf3-accd-4c4f-9c23-f7c3a64b5a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:24.887916 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579caf3-accd-4c4f-9c23-f7c3a64b5a32 service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:24.897321 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1435/2858] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:25.177138 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4227a-749c-41d2-803c-1cdedae8c577 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:25.178799 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-7fe4227a-749c-41d2-803c-1cdedae8c577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:25.200448 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4227a-749c-41d2-803c-1cdedae8c577 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:25.207049 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78fdfa-14d4-4f57-b257-42bf61a68336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:25.207707 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78fdfa-14d4-4f57-b257-42bf61a68336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:25.207984 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78fdfa-14d4-4f57-b257-42bf61a68336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:25.208255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78fdfa-14d4-4f57-b257-42bf61a68336 admin admin] PATH_INFO: `/v3/projects/1835857462c944509fbd46a43ecd1278` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:25.209435 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78fdfa-14d4-4f57-b257-42bf61a68336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1835857462c944509fbd46a43ecd1278)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:25.211411 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78fdfa-14d4-4f57-b257-42bf61a68336 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:25.263791 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bc78fdfa-14d4-4f57-b257-42bf61a68336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1835857462c944509fbd46a43ecd1278', 'request_id': 'req-bc78fdfa-14d4-4f57-b257-42bf61a68336'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:25.271271 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bc78fdfa-14d4-4f57-b257-42bf61a68336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1835857462c944509fbd46a43ecd1278', 'request_id': 'req-bc78fdfa-14d4-4f57-b257-42bf61a68336'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:25.278318 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bc78fdfa-14d4-4f57-b257-42bf61a68336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1835857462c944509fbd46a43ecd1278', 'request_id': 'req-bc78fdfa-14d4-4f57-b257-42bf61a68336'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:25.292990 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bc78fdfa-14d4-4f57-b257-42bf61a68336 admin admin] The token cache is being invalidate because project 1835857462c944509fbd46a43ecd1278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:42:25.293323 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bc78fdfa-14d4-4f57-b257-42bf61a68336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:25.293946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-bc78fdfa-14d4-4f57-b257-42bf61a68336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:25.295478 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1424/2859] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:42:25 2022] DELETE /identity/v3/projects/1835857462c944509fbd46a43ecd1278 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:25.300530 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af05a8d-f843-446a-8a0a-32af888e5625 None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:25.300857 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af05a8d-f843-446a-8a0a-32af888e5625 None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:25.301138 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af05a8d-f843-446a-8a0a-32af888e5625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:25.322193 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-0af05a8d-f843-446a-8a0a-32af888e5625 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:25.323452 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0af05a8d-f843-446a-8a0a-32af888e5625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:25.390012 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1436/2860] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:25.397798 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4e708-911d-474b-8f8b-cc5ee359159c None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:25.398080 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4e708-911d-474b-8f8b-cc5ee359159c None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:25.398390 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4e708-911d-474b-8f8b-cc5ee359159c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:25.418840 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-87f4e708-911d-474b-8f8b-cc5ee359159c None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:25.420054 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-87f4e708-911d-474b-8f8b-cc5ee359159c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:25.428944 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1425/2861] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:25.433302 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af05a8d-f843-446a-8a0a-32af888e5625 None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:25.443464 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af05a8d-f843-446a-8a0a-32af888e5625 None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:25.449298 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecaab0-05b9-4785-9942-a870fd7b4ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:25.449902 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecaab0-05b9-4785-9942-a870fd7b4ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:25.450185 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecaab0-05b9-4785-9942-a870fd7b4ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:25.450466 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecaab0-05b9-4785-9942-a870fd7b4ef5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:25.451130 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecaab0-05b9-4785-9942-a870fd7b4ef5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:42:25.451441 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecaab0-05b9-4785-9942-a870fd7b4ef5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:25.453705 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecaab0-05b9-4785-9942-a870fd7b4ef5 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:25.471384 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1437/2862] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:25.476332 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4e708-911d-474b-8f8b-cc5ee359159c None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:25.486812 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4e708-911d-474b-8f8b-cc5ee359159c None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:25.491637 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd8515-f485-494c-b80c-53629dbb91fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:25.492258 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd8515-f485-494c-b80c-53629dbb91fd admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:25.492544 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd8515-f485-494c-b80c-53629dbb91fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:25.492864 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd8515-f485-494c-b80c-53629dbb91fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:25.493503 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd8515-f485-494c-b80c-53629dbb91fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:25.495419 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd8515-f485-494c-b80c-53629dbb91fd admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:25.526433 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1426/2863] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:42:25 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:42:25.531160 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecaab0-05b9-4785-9942-a870fd7b4ef5 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:25.541892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecaab0-05b9-4785-9942-a870fd7b4ef5 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:25.603169 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fc1a8-0546-4dca-a6a8-9b143b73c513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:25.603786 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fc1a8-0546-4dca-a6a8-9b143b73c513 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:25.604065 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fc1a8-0546-4dca-a6a8-9b143b73c513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:25.604336 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fc1a8-0546-4dca-a6a8-9b143b73c513 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:25.605012 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4fc1a8-0546-4dca-a6a8-9b143b73c513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:25.606927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4fc1a8-0546-4dca-a6a8-9b143b73c513 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:25.616600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:25.633292 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1438/2864] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:42:25 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:42:25.634489 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd8515-f485-494c-b80c-53629dbb91fd admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:25.645166 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd8515-f485-494c-b80c-53629dbb91fd admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:25.649719 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842f5df-f9f3-43fc-b213-397dd46d0784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:25.650311 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842f5df-f9f3-43fc-b213-397dd46d0784 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:25.650589 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842f5df-f9f3-43fc-b213-397dd46d0784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:25.650861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842f5df-f9f3-43fc-b213-397dd46d0784 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:25.651499 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842f5df-f9f3-43fc-b213-397dd46d0784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:25.653200 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842f5df-f9f3-43fc-b213-397dd46d0784 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:25.664252 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1427/2865] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:42:25.668332 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fc1a8-0546-4dca-a6a8-9b143b73c513 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:25.678917 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fc1a8-0546-4dca-a6a8-9b143b73c513 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:25.683702 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eeec81-ca08-4e7f-839b-8327981cc68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:25.684325 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeec81-ca08-4e7f-839b-8327981cc68f admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:25.684606 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeec81-ca08-4e7f-839b-8327981cc68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:25.684918 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eeec81-ca08-4e7f-839b-8327981cc68f admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:25.685561 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eeec81-ca08-4e7f-839b-8327981cc68f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:25.687440 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eeec81-ca08-4e7f-839b-8327981cc68f admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:25.698266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1439/2866] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:42:25.702861 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842f5df-f9f3-43fc-b213-397dd46d0784 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:25.712869 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842f5df-f9f3-43fc-b213-397dd46d0784 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:25.718016 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6d755-4d7f-44a3-977e-8dc8d0157291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:25.718969 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6d755-4d7f-44a3-977e-8dc8d0157291 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:25.719252 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6d755-4d7f-44a3-977e-8dc8d0157291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:25.719767 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6d755-4d7f-44a3-977e-8dc8d0157291 admin admin] PATH_INFO: `/v3/projects/89d8155f9be1451392f944cd2df0d277/users/66a93538ed3b4a2897ecc47ef5e859c4/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:25.735476 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6d755-4d7f-44a3-977e-8dc8d0157291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d8155f9be1451392f944cd2df0d277, user_id=66a93538ed3b4a2897ecc47ef5e859c4, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:25.738161 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6d755-4d7f-44a3-977e-8dc8d0157291 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:25.751955 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1428/2867] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:42:25 2022] PUT /identity/v3/projects/89d8155f9be1451392f944cd2df0d277/users/66a93538ed3b4a2897ecc47ef5e859c4/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:25.763878 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d60d0c-0bc4-47d1-a0d0-e0f206b6a07b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:25.764967 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d60d0c-0bc4-47d1-a0d0-e0f206b6a07b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:25.765259 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d60d0c-0bc4-47d1-a0d0-e0f206b6a07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:25.793070 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-00d60d0c-0bc4-47d1-a0d0-e0f206b6a07b None None] MFA Rules not processed for user `66a93538ed3b4a2897ecc47ef5e859c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:25.794343 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-00d60d0c-0bc4-47d1-a0d0-e0f206b6a07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:25.863362 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1440/2868] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:25.875461 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6d755-4d7f-44a3-977e-8dc8d0157291 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:25.877260 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-eab6d755-4d7f-44a3-977e-8dc8d0157291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:25.883897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:25.939963 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6d755-4d7f-44a3-977e-8dc8d0157291 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:25.943668 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d6597-acfd-4636-b247-3d862c490646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b182bf0bbbcf4a808626443c6c2a7a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:25.944282 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d6597-acfd-4636-b247-3d862c490646 service cinder] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:25.944567 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d6597-acfd-4636-b247-3d862c490646 service cinder] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:25.944890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d6597-acfd-4636-b247-3d862c490646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:25.953757 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d6597-acfd-4636-b247-3d862c490646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:25.955196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d6597-acfd-4636-b247-3d862c490646 service cinder] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:25.964208 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1429/2869] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:42:25.989751 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d60d0c-0bc4-47d1-a0d0-e0f206b6a07b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:26.051942 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d60d0c-0bc4-47d1-a0d0-e0f206b6a07b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:26.056560 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52280dc4-9d0a-4550-8743-bad77aaf244a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:26.057216 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52280dc4-9d0a-4550-8743-bad77aaf244a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:26.057504 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52280dc4-9d0a-4550-8743-bad77aaf244a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:26.057780 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52280dc4-9d0a-4550-8743-bad77aaf244a admin admin] PATH_INFO: `/v3/users/66a93538ed3b4a2897ecc47ef5e859c4` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:26.058924 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52280dc4-9d0a-4550-8743-bad77aaf244a admin admin] RBAC: Authorizing `identity:delete_user(user_id=66a93538ed3b4a2897ecc47ef5e859c4)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:26.060898 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52280dc4-9d0a-4550-8743-bad77aaf244a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:26.107404 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-52280dc4-9d0a-4550-8743-bad77aaf244a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66a93538ed3b4a2897ecc47ef5e859c4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:26.108678 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-52280dc4-9d0a-4550-8743-bad77aaf244a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66a93538ed3b4a2897ecc47ef5e859c4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:26.116740 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-52280dc4-9d0a-4550-8743-bad77aaf244a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66a93538ed3b4a2897ecc47ef5e859c4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:26.117323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-52280dc4-9d0a-4550-8743-bad77aaf244a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66a93538ed3b4a2897ecc47ef5e859c4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:26.129724 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-52280dc4-9d0a-4550-8743-bad77aaf244a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66a93538ed3b4a2897ecc47ef5e859c4'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:26.130928 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:26.143979 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1441/2870] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:42:25 2022] DELETE /identity/v3/users/66a93538ed3b4a2897ecc47ef5e859c4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:26.148439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b29630-947f-4e1e-a057-1e3495213e70 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:26.148759 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b29630-947f-4e1e-a057-1e3495213e70 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:26.149046 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b29630-947f-4e1e-a057-1e3495213e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:26.168159 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-03b29630-947f-4e1e-a057-1e3495213e70 None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:26.169415 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-03b29630-947f-4e1e-a057-1e3495213e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:26.231675 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1430/2871] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:26.241554 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52280dc4-9d0a-4550-8743-bad77aaf244a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:26.242957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-52280dc4-9d0a-4550-8743-bad77aaf244a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:26.303182 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52280dc4-9d0a-4550-8743-bad77aaf244a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:26.306913 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c95a4-cfe9-47f3-bcde-a20aa345d51a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:26.307531 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c95a4-cfe9-47f3-bcde-a20aa345d51a service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:26.307812 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c95a4-cfe9-47f3-bcde-a20aa345d51a service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:26.308088 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c95a4-cfe9-47f3-bcde-a20aa345d51a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:26.318132 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c95a4-cfe9-47f3-bcde-a20aa345d51a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:26.319603 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c95a4-cfe9-47f3-bcde-a20aa345d51a service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:26.330143 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1442/2872] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:26.607998 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b29630-947f-4e1e-a057-1e3495213e70 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:26.609615 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-03b29630-947f-4e1e-a057-1e3495213e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:26.621799 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b29630-947f-4e1e-a057-1e3495213e70 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:26.627811 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a07c19-b8d9-4b28-b097-2f68513f91e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:26.628729 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a07c19-b8d9-4b28-b097-2f68513f91e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:26.629049 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a07c19-b8d9-4b28-b097-2f68513f91e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:26.629376 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a07c19-b8d9-4b28-b097-2f68513f91e0 admin admin] PATH_INFO: `/v3/projects/89d8155f9be1451392f944cd2df0d277` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:26.631006 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a07c19-b8d9-4b28-b097-2f68513f91e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d8155f9be1451392f944cd2df0d277)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:26.634306 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a07c19-b8d9-4b28-b097-2f68513f91e0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:26.685581 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-37a07c19-b8d9-4b28-b097-2f68513f91e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d8155f9be1451392f944cd2df0d277', 'request_id': 'req-37a07c19-b8d9-4b28-b097-2f68513f91e0'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:26.691616 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-37a07c19-b8d9-4b28-b097-2f68513f91e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d8155f9be1451392f944cd2df0d277', 'request_id': 'req-37a07c19-b8d9-4b28-b097-2f68513f91e0'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:26.697938 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-37a07c19-b8d9-4b28-b097-2f68513f91e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d8155f9be1451392f944cd2df0d277', 'request_id': 'req-37a07c19-b8d9-4b28-b097-2f68513f91e0'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:26.711125 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-37a07c19-b8d9-4b28-b097-2f68513f91e0 admin admin] The token cache is being invalidate because project 89d8155f9be1451392f944cd2df0d277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:42:26.711423 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-37a07c19-b8d9-4b28-b097-2f68513f91e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:26.712086 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-37a07c19-b8d9-4b28-b097-2f68513f91e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:42:26.713657 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1431/2873] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:42:26 2022] DELETE /identity/v3/projects/89d8155f9be1451392f944cd2df0d277 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:26.718752 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496b2b3-76fd-4895-a245-987ac6efcf5b None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:26.719255 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496b2b3-76fd-4895-a245-987ac6efcf5b None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:26.719366 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496b2b3-76fd-4895-a245-987ac6efcf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:26.739599 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-6496b2b3-76fd-4895-a245-987ac6efcf5b None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:26.740848 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6496b2b3-76fd-4895-a245-987ac6efcf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:26.800760 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1443/2874] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:26.808720 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00994699-425e-4847-abe6-efd6c85adb4d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:26.809332 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00994699-425e-4847-abe6-efd6c85adb4d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:26.809452 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00994699-425e-4847-abe6-efd6c85adb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:26.830153 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-00994699-425e-4847-abe6-efd6c85adb4d None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:26.831540 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-00994699-425e-4847-abe6-efd6c85adb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:26.839755 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1432/2875] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:26.844060 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496b2b3-76fd-4895-a245-987ac6efcf5b None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:26.854196 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496b2b3-76fd-4895-a245-987ac6efcf5b None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:26.859303 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace64e2-d6be-4ea4-9f17-6f79d428c3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:26.859912 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace64e2-d6be-4ea4-9f17-6f79d428c3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:26.860193 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace64e2-d6be-4ea4-9f17-6f79d428c3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:26.860492 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace64e2-d6be-4ea4-9f17-6f79d428c3c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:26.861187 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace64e2-d6be-4ea4-9f17-6f79d428c3c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81517) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:42:26.861498 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace64e2-d6be-4ea4-9f17-6f79d428c3c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:26.863097 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace64e2-d6be-4ea4-9f17-6f79d428c3c1 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:26.875625 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1444/2876] 10.222.0.96 () {58 vars in 1153 bytes} [Wed Aug 24 04:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:26.879956 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00994699-425e-4847-abe6-efd6c85adb4d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:26.890333 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00994699-425e-4847-abe6-efd6c85adb4d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:26.895168 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e0878-4f81-4703-9b4e-fdb079b84401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:26.895781 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e0878-4f81-4703-9b4e-fdb079b84401 admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:26.896065 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e0878-4f81-4703-9b4e-fdb079b84401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:26.896343 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e0878-4f81-4703-9b4e-fdb079b84401 admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:26.897039 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e0878-4f81-4703-9b4e-fdb079b84401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:26.898946 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e0878-4f81-4703-9b4e-fdb079b84401 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:26.928197 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1433/2877] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:42:26 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:42:26.932416 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace64e2-d6be-4ea4-9f17-6f79d428c3c1 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:26.942713 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace64e2-d6be-4ea4-9f17-6f79d428c3c1 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:27.000266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c322924-af17-4ad2-ae91-40de0fc26690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:27.000898 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c322924-af17-4ad2-ae91-40de0fc26690 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:27.001180 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c322924-af17-4ad2-ae91-40de0fc26690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:27.001464 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c322924-af17-4ad2-ae91-40de0fc26690 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:27.002101 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c322924-af17-4ad2-ae91-40de0fc26690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:27.004020 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c322924-af17-4ad2-ae91-40de0fc26690 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:27.025675 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1445/2878] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:42:26 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:42:27.030430 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e0878-4f81-4703-9b4e-fdb079b84401 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:27.036045 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:27.042691 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e0878-4f81-4703-9b4e-fdb079b84401 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:27.048446 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1297cc0-8fae-4b79-8d91-60feed43db46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:27.049106 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1297cc0-8fae-4b79-8d91-60feed43db46 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:27.049387 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1297cc0-8fae-4b79-8d91-60feed43db46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:27.049662 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1297cc0-8fae-4b79-8d91-60feed43db46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:27.050344 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1297cc0-8fae-4b79-8d91-60feed43db46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:27.051936 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1297cc0-8fae-4b79-8d91-60feed43db46 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:27.062777 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1434/2879] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:42:27.067177 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c322924-af17-4ad2-ae91-40de0fc26690 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:27.077843 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c322924-af17-4ad2-ae91-40de0fc26690 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:27.082649 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697fbad-f49a-4132-80b6-39a703ea87c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:27.083259 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697fbad-f49a-4132-80b6-39a703ea87c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:27.083546 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697fbad-f49a-4132-80b6-39a703ea87c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:27.083825 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697fbad-f49a-4132-80b6-39a703ea87c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:27.084475 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697fbad-f49a-4132-80b6-39a703ea87c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:27.086131 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697fbad-f49a-4132-80b6-39a703ea87c3 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:27.088362 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:27.098471 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1446/2880] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:42:27.102557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1297cc0-8fae-4b79-8d91-60feed43db46 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:27.113215 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1297cc0-8fae-4b79-8d91-60feed43db46 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:27.117890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a5e3c-e60e-46a6-a283-01f13490e379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:27.118550 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a5e3c-e60e-46a6-a283-01f13490e379 admin admin] REQUEST_METHOD: `PUT` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:27.118837 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a5e3c-e60e-46a6-a283-01f13490e379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:27.119119 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a5e3c-e60e-46a6-a283-01f13490e379 admin admin] PATH_INFO: `/v3/projects/9a44b51d585e4ed6ba2a39efd5073841/users/fc4d22cf624f40a9b677b9a73a10e455/roles/dbb1f67486534e8dbbc250bfe0978e6c` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:27.135041 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a5e3c-e60e-46a6-a283-01f13490e379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a44b51d585e4ed6ba2a39efd5073841, user_id=fc4d22cf624f40a9b677b9a73a10e455, role_id=dbb1f67486534e8dbbc250bfe0978e6c)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:27.137826 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a5e3c-e60e-46a6-a283-01f13490e379 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:27.152487 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1435/2881] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:42:27 2022] PUT /identity/v3/projects/9a44b51d585e4ed6ba2a39efd5073841/users/fc4d22cf624f40a9b677b9a73a10e455/roles/dbb1f67486534e8dbbc250bfe0978e6c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:27.158060 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012e4fd-f398-4a5a-8f7f-68b513980c3e None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:27.158353 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012e4fd-f398-4a5a-8f7f-68b513980c3e None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:27.158638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012e4fd-f398-4a5a-8f7f-68b513980c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:27.178614 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-9012e4fd-f398-4a5a-8f7f-68b513980c3e None None] MFA Rules not processed for user `8e583097bf7c4097a82fd7d436d1c78d`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:27.179852 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9012e4fd-f398-4a5a-8f7f-68b513980c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:27.241312 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1447/2882] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:27.252180 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a5e3c-e60e-46a6-a283-01f13490e379 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:27.254110 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-482a5e3c-e60e-46a6-a283-01f13490e379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:27.313669 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a5e3c-e60e-46a6-a283-01f13490e379 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:27.317277 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f698550-5aa9-4087-bc11-dbf3e511bc13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:27.317888 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f698550-5aa9-4087-bc11-dbf3e511bc13 service neutron] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:27.318166 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f698550-5aa9-4087-bc11-dbf3e511bc13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:27.318439 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f698550-5aa9-4087-bc11-dbf3e511bc13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:27.328519 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f698550-5aa9-4087-bc11-dbf3e511bc13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:27.329992 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f698550-5aa9-4087-bc11-dbf3e511bc13 service neutron] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:27.339534 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1436/2883] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:31.302988 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11243300-8b59-4e8f-9883-3e229a2bc77d None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:31.303573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11243300-8b59-4e8f-9883-3e229a2bc77d None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:31.303573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11243300-8b59-4e8f-9883-3e229a2bc77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:31.335903 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-11243300-8b59-4e8f-9883-3e229a2bc77d None None] MFA Rules not processed for user `fc4d22cf624f40a9b677b9a73a10e455`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:31.337343 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-11243300-8b59-4e8f-9883-3e229a2bc77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:31.420892 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1448/2884] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:31.426192 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f698550-5aa9-4087-bc11-dbf3e511bc13 service neutron] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:31.437019 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f698550-5aa9-4087-bc11-dbf3e511bc13 service neutron] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:31.442155 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61592266-2397-44d2-bb97-bf8b2137706e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:31.442779 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61592266-2397-44d2-bb97-bf8b2137706e admin admin] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:31.443061 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61592266-2397-44d2-bb97-bf8b2137706e admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:31.443338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61592266-2397-44d2-bb97-bf8b2137706e admin admin] PATH_INFO: `/v3/projects` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:31.444023 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61592266-2397-44d2-bb97-bf8b2137706e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:31.446095 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61592266-2397-44d2-bb97-bf8b2137706e admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:31.481255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1437/2885] 10.222.0.96 () {60 vars in 1153 bytes} [Wed Aug 24 04:42:31 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:42:31.485734 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11243300-8b59-4e8f-9883-3e229a2bc77d None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:31.497950 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11243300-8b59-4e8f-9883-3e229a2bc77d None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:31.572973 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8bd5b-e701-4ce3-a49d-5931868c3c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:31.573611 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8bd5b-e701-4ce3-a49d-5931868c3c04 admin admin] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:31.573899 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8bd5b-e701-4ce3-a49d-5931868c3c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:31.574181 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8bd5b-e701-4ce3-a49d-5931868c3c04 admin admin] PATH_INFO: `/v3/users` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:31.574826 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8bd5b-e701-4ce3-a49d-5931868c3c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:31.578215 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8bd5b-e701-4ce3-a49d-5931868c3c04 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:31.610085 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1449/2886] 10.222.0.96 () {60 vars in 1144 bytes} [Wed Aug 24 04:42:31 2022] POST /identity/v3/users => generated 298 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:42:31.611395 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61592266-2397-44d2-bb97-bf8b2137706e admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:31.633904 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61592266-2397-44d2-bb97-bf8b2137706e admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:31.647049 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d0013-ef47-4dc2-882c-e56cf2f881c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:31.647878 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d0013-ef47-4dc2-882c-e56cf2f881c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:31.648162 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d0013-ef47-4dc2-882c-e56cf2f881c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:31.648464 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d0013-ef47-4dc2-882c-e56cf2f881c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:31.649201 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d0013-ef47-4dc2-882c-e56cf2f881c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:31.650869 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d0013-ef47-4dc2-882c-e56cf2f881c7 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:31.664437 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1438/2887] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:42:31.668555 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8bd5b-e701-4ce3-a49d-5931868c3c04 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:31.681233 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8bd5b-e701-4ce3-a49d-5931868c3c04 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:31.688649 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8831a52-ff89-41e7-94d6-6e351cbc5792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:31.690125 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8831a52-ff89-41e7-94d6-6e351cbc5792 admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:31.690786 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8831a52-ff89-41e7-94d6-6e351cbc5792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:31.691509 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8831a52-ff89-41e7-94d6-6e351cbc5792 admin admin] PATH_INFO: `/v3/projects/85e8fe5a43d24afaa56739e42cbcd048/users/2553bd7d7c8347af8506376f6af3b4ab/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:31.715582 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8831a52-ff89-41e7-94d6-6e351cbc5792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85e8fe5a43d24afaa56739e42cbcd048, user_id=2553bd7d7c8347af8506376f6af3b4ab, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:31.719372 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8831a52-ff89-41e7-94d6-6e351cbc5792 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:31.722691 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:31.737692 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1450/2888] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:42:31 2022] PUT /identity/v3/projects/85e8fe5a43d24afaa56739e42cbcd048/users/2553bd7d7c8347af8506376f6af3b4ab/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:31.741755 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d0013-ef47-4dc2-882c-e56cf2f881c7 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:31.754354 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d0013-ef47-4dc2-882c-e56cf2f881c7 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:31.815059 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2181a7-d1ba-430c-899a-ad08db7f03b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:31.815676 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2181a7-d1ba-430c-899a-ad08db7f03b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:31.815963 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2181a7-d1ba-430c-899a-ad08db7f03b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:31.816246 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2181a7-d1ba-430c-899a-ad08db7f03b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:31.816934 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2181a7-d1ba-430c-899a-ad08db7f03b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:31.818542 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2181a7-d1ba-430c-899a-ad08db7f03b1 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:31.832879 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1439/2889] 10.222.0.96 () {58 vars in 1122 bytes} [Wed Aug 24 04:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:42:31.834145 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8831a52-ff89-41e7-94d6-6e351cbc5792 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:31.845725 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8831a52-ff89-41e7-94d6-6e351cbc5792 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:31.850634 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13e28a-846e-45e3-938f-28bb21e79f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:31.851341 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13e28a-846e-45e3-938f-28bb21e79f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:31.851622 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13e28a-846e-45e3-938f-28bb21e79f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:31.851899 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13e28a-846e-45e3-938f-28bb21e79f0a admin admin] PATH_INFO: `/v3/projects/85e8fe5a43d24afaa56739e42cbcd048/users/2553bd7d7c8347af8506376f6af3b4ab/roles/059d2bf5bb8e42939f5f826bfdad6a21` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:31.854491 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13e28a-846e-45e3-938f-28bb21e79f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=85e8fe5a43d24afaa56739e42cbcd048, user_id=2553bd7d7c8347af8506376f6af3b4ab, role_id=059d2bf5bb8e42939f5f826bfdad6a21)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:31.857186 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13e28a-846e-45e3-938f-28bb21e79f0a admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:31.871054 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1451/2890] 10.222.0.96 () {60 vars in 1483 bytes} [Wed Aug 24 04:42:31 2022] PUT /identity/v3/projects/85e8fe5a43d24afaa56739e42cbcd048/users/2553bd7d7c8347af8506376f6af3b4ab/roles/059d2bf5bb8e42939f5f826bfdad6a21 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:36.723030 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871abc81-bf71-48ba-9d8e-983c95d48fee None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:36.723569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871abc81-bf71-48ba-9d8e-983c95d48fee None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:36.723569 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871abc81-bf71-48ba-9d8e-983c95d48fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:36.767706 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-871abc81-bf71-48ba-9d8e-983c95d48fee None None] MFA Rules not processed for user `2553bd7d7c8347af8506376f6af3b4ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:36.769006 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-871abc81-bf71-48ba-9d8e-983c95d48fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:36.793560 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:36.854825 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1440/2891] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:36.868025 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13e28a-846e-45e3-938f-28bb21e79f0a admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:36.869944 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-9a13e28a-846e-45e3-938f-28bb21e79f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:36.959672 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13e28a-846e-45e3-938f-28bb21e79f0a admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:36.963468 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2de589-4d1b-48ea-bfb4-a79e4f217e7f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6106a46199b74f649cd29a0d02610049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:36.964100 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2de589-4d1b-48ea-bfb4-a79e4f217e7f service glance] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:36.964382 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2de589-4d1b-48ea-bfb4-a79e4f217e7f service glance] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:36.964759 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2de589-4d1b-48ea-bfb4-a79e4f217e7f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:37.026520 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2de589-4d1b-48ea-bfb4-a79e4f217e7f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:37.027986 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2de589-4d1b-48ea-bfb4-a79e4f217e7f service glance] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:37.038927 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1452/2892] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:37.164321 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7dec7-c0db-4d79-b188-3cecd6cc89f0 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:37.164441 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7dec7-c0db-4d79-b188-3cecd6cc89f0 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:37.164729 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7dec7-c0db-4d79-b188-3cecd6cc89f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:37.235022 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-d0d7dec7-c0db-4d79-b188-3cecd6cc89f0 None None] MFA Rules not processed for user `e9ffc48d1f6d49f49d00d1c2e762b987`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:37.236243 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-d0d7dec7-c0db-4d79-b188-3cecd6cc89f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:37.301559 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1441/2893] 10.222.0.96 () {58 vars in 1009 bytes} [Wed Aug 24 04:42:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:37.350156 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2de589-4d1b-48ea-bfb4-a79e4f217e7f service glance] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:37.351622 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ed2de589-4d1b-48ea-bfb4-a79e4f217e7f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:37.441494 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:37.452115 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2de589-4d1b-48ea-bfb4-a79e4f217e7f service glance] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:37.457487 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbd05c-82bc-4cfc-a4e2-63d102a767db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953d2dbd5e7d435f9148fd043b4ce7a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:37.458103 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbd05c-82bc-4cfc-a4e2-63d102a767db service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:37.458383 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbd05c-82bc-4cfc-a4e2-63d102a767db service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:37.458656 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbd05c-82bc-4cfc-a4e2-63d102a767db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:37.467096 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbd05c-82bc-4cfc-a4e2-63d102a767db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:37.469113 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbd05c-82bc-4cfc-a4e2-63d102a767db service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:37.477548 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1453/2894] 10.222.0.96 () {60 vars in 1384 bytes} [Wed Aug 24 04:42:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:42:46.428221 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88433f98-f0cb-42af-8c61-d9eabc56540d None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:46.428775 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88433f98-f0cb-42af-8c61-d9eabc56540d None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:46.429377 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88433f98-f0cb-42af-8c61-d9eabc56540d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:46.453897 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-88433f98-f0cb-42af-8c61-d9eabc56540d None None] MFA Rules not processed for user `fc4d22cf624f40a9b677b9a73a10e455`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:46.455148 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-88433f98-f0cb-42af-8c61-d9eabc56540d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:46.462841 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1442/2895] 10.222.0.96 () {58 vars in 958 bytes} [Wed Aug 24 04:42:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:46.759446 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbd05c-82bc-4cfc-a4e2-63d102a767db service swift] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:46.761158 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6efbd05c-82bc-4cfc-a4e2-63d102a767db service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:46.834187 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbd05c-82bc-4cfc-a4e2-63d102a767db service swift] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:46.838338 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bb8c8-0dd7-4bf4-90b4-7fa40325451b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:46.838979 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bb8c8-0dd7-4bf4-90b4-7fa40325451b service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:46.839261 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bb8c8-0dd7-4bf4-90b4-7fa40325451b service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:46.839543 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bb8c8-0dd7-4bf4-90b4-7fa40325451b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:46.841462 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-0c8bb8c8-0dd7-4bf4-90b4-7fa40325451b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:46.853411 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bb8c8-0dd7-4bf4-90b4-7fa40325451b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:46.855199 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bb8c8-0dd7-4bf4-90b4-7fa40325451b service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:46.865079 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1454/2896] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:48.262287 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88433f98-f0cb-42af-8c61-d9eabc56540d None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:48.264557 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-88433f98-f0cb-42af-8c61-d9eabc56540d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:48.335906 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88433f98-f0cb-42af-8c61-d9eabc56540d None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:48.341052 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7e3e7-7f07-4451-a78d-011c12a1fe28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f7fe9af30947dbae1f2334b18f630d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:48.341682 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7e3e7-7f07-4451-a78d-011c12a1fe28 service placement] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:48.342611 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7e3e7-7f07-4451-a78d-011c12a1fe28 service placement] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:48.342961 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7e3e7-7f07-4451-a78d-011c12a1fe28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:48.345147 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-c4e7e3e7-7f07-4451-a78d-011c12a1fe28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:48.358603 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7e3e7-7f07-4451-a78d-011c12a1fe28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:48.360255 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7e3e7-7f07-4451-a78d-011c12a1fe28 service placement] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:48.372375 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1443/2897] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:52.577600 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26046306-78b9-4a26-9be5-aee1cffffc5f None None] REQUEST_METHOD: `POST` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:52.578142 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26046306-78b9-4a26-9be5-aee1cffffc5f None None] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:52.578142 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26046306-78b9-4a26-9be5-aee1cffffc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:52.599261 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.auth.core [None req-26046306-78b9-4a26-9be5-aee1cffffc5f None None] MFA Rules not processed for user `e9ffc48d1f6d49f49d00d1c2e762b987`. Rule list: `[]` (Enabled: `True`). {{(pid=81517) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:52.600507 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-26046306-78b9-4a26-9be5-aee1cffffc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:52.609204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1455/2898] 10.222.0.96 () {58 vars in 1009 bytes} [Wed Aug 24 04:42:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:52.621223 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7e3e7-7f07-4451-a78d-011c12a1fe28 service placement] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:52.629171 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=100 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:52.634063 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7e3e7-7f07-4451-a78d-011c12a1fe28 service placement] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:52.639486 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc629f6b-d768-40b0-ab58-6cb962efd128 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953d2dbd5e7d435f9148fd043b4ce7a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:52.640094 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc629f6b-d768-40b0-ab58-6cb962efd128 service swift] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:52.640378 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc629f6b-d768-40b0-ab58-6cb962efd128 service swift] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:52.640653 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc629f6b-d768-40b0-ab58-6cb962efd128 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:52.649413 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc629f6b-d768-40b0-ab58-6cb962efd128 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:52.651005 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc629f6b-d768-40b0-ab58-6cb962efd128 service swift] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:52.660395 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1444/2899] 10.222.0.96 () {60 vars in 1384 bytes} [Wed Aug 24 04:42:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:43:01.224918 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26046306-78b9-4a26-9be5-aee1cffffc5f None None] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:01.235204 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26046306-78b9-4a26-9be5-aee1cffffc5f None None] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:01.238784 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4fe7a-d902-4308-8a12-98f1c644f6fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:01.239396 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4fe7a-d902-4308-8a12-98f1c644f6fa service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:01.239681 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4fe7a-d902-4308-8a12-98f1c644f6fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:01.239954 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4fe7a-d902-4308-8a12-98f1c644f6fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:01.241731 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-6ec4fe7a-d902-4308-8a12-98f1c644f6fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:01.252546 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4fe7a-d902-4308-8a12-98f1c644f6fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:01.254044 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4fe7a-d902-4308-8a12-98f1c644f6fa service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:01.265074 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1456/2900] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:02.656916 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=4 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:07.268584 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc629f6b-d768-40b0-ab58-6cb962efd128 service swift] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:07.270141 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cc629f6b-d768-40b0-ab58-6cb962efd128 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:07.353769 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc629f6b-d768-40b0-ab58-6cb962efd128 service swift] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:07.360241 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab017e-69fc-449f-a8d9-1c0f67dd4fc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:07.360910 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab017e-69fc-449f-a8d9-1c0f67dd4fc5 service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:07.361196 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab017e-69fc-449f-a8d9-1c0f67dd4fc5 service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:07.361497 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab017e-69fc-449f-a8d9-1c0f67dd4fc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:07.363328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-4fab017e-69fc-449f-a8d9-1c0f67dd4fc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:07.378730 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab017e-69fc-449f-a8d9-1c0f67dd4fc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:07.380363 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab017e-69fc-449f-a8d9-1c0f67dd4fc5 service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:07.393338 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1445/2901] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:11.262022 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=42 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:14.424276 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4fe7a-d902-4308-8a12-98f1c644f6fa service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:14.433347 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4fe7a-d902-4308-8a12-98f1c644f6fa service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:14.437231 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6be21-6f74-4440-9211-7712495c70dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50358dbf699a41188dae93496161709d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:14.437835 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6be21-6f74-4440-9211-7712495c70dc service neutron] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:14.438113 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6be21-6f74-4440-9211-7712495c70dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:14.438384 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6be21-6f74-4440-9211-7712495c70dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:14.448596 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6be21-6f74-4440-9211-7712495c70dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:14.450061 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6be21-6f74-4440-9211-7712495c70dc service neutron] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:14.460957 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1457/2902] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:17.387075 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=34 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:17.881565 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab017e-69fc-449f-a8d9-1c0f67dd4fc5 service nova] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:17.901797 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab017e-69fc-449f-a8d9-1c0f67dd4fc5 service nova] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:17.912109 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c154ec-487a-49a3-bf45-18769ee4e87e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3539784b4e91472eb20addc6707dc30d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:17.912929 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c154ec-487a-49a3-bf45-18769ee4e87e service nova] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:17.913328 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c154ec-487a-49a3-bf45-18769ee4e87e service nova] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:17.913837 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c154ec-487a-49a3-bf45-18769ee4e87e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:17.915889 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-f3c154ec-487a-49a3-bf45-18769ee4e87e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:17.933195 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c154ec-487a-49a3-bf45-18769ee4e87e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:17.935092 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c154ec-487a-49a3-bf45-18769ee4e87e service nova] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:17.953779 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1446/2903] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:24.456567 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=6 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:27.946814 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=6 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:21.004445 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6be21-6f74-4440-9211-7712495c70dc service neutron] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:21.006077 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-79e6be21-6f74-4440-9211-7712495c70dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:21.025069 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6be21-6f74-4440-9211-7712495c70dc service neutron] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:21.030998 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f760e1a-bb23-422e-84db-394da1188596 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f7fe9af30947dbae1f2334b18f630d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:21.031615 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f760e1a-bb23-422e-84db-394da1188596 service placement] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:21.031895 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f760e1a-bb23-422e-84db-394da1188596 service placement] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:21.032168 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f760e1a-bb23-422e-84db-394da1188596 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:21.033967 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-3f760e1a-bb23-422e-84db-394da1188596 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:21.047749 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f760e1a-bb23-422e-84db-394da1188596 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:21.049733 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f760e1a-bb23-422e-84db-394da1188596 service placement] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:21.061670 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1458/2904] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:44:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:44:31.056395 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=6 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:50.607058 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc47ed-46ae-4af7-b6ad-c0b6003c60f4 None None] REQUEST_METHOD: `POST` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:50.607799 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc47ed-46ae-4af7-b6ad-c0b6003c60f4 None None] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:50.607799 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc47ed-46ae-4af7-b6ad-c0b6003c60f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:50.627939 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.auth.core [None req-cadc47ed-46ae-4af7-b6ad-c0b6003c60f4 None None] MFA Rules not processed for user `e9ffc48d1f6d49f49d00d1c2e762b987`. Rule list: `[]` (Enabled: `True`). {{(pid=81516) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:50.629211 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-cadc47ed-46ae-4af7-b6ad-c0b6003c60f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:50.642519 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1447/2905] 10.222.0.96 () {58 vars in 967 bytes} [Wed Aug 24 04:44:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:44:50.685890 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f760e1a-bb23-422e-84db-394da1188596 service placement] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:50.700282 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f760e1a-bb23-422e-84db-394da1188596 service placement] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:50.706238 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d70d71-3862-4df8-acf1-670132169f9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '953d2dbd5e7d435f9148fd043b4ce7a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:50.706991 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d70d71-3862-4df8-acf1-670132169f9d service swift] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:50.707296 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d70d71-3862-4df8-acf1-670132169f9d service swift] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:50.707604 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d70d71-3862-4df8-acf1-670132169f9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:50.718638 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d70d71-3862-4df8-acf1-670132169f9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:50.720482 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d70d71-3862-4df8-acf1-670132169f9d service swift] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:50.729413 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1459/2906] 10.222.0.96 () {60 vars in 1384 bytes} [Wed Aug 24 04:44:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:44:54.390890 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc47ed-46ae-4af7-b6ad-c0b6003c60f4 None None] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:54.408980 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc47ed-46ae-4af7-b6ad-c0b6003c60f4 None None] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:54.421991 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ef6fe-099d-48f2-b0c2-682f7af16f47 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f7fe9af30947dbae1f2334b18f630d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:54.423079 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ef6fe-099d-48f2-b0c2-682f7af16f47 service placement] REQUEST_METHOD: `GET` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:54.423580 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ef6fe-099d-48f2-b0c2-682f7af16f47 service placement] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:54.423967 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ef6fe-099d-48f2-b0c2-682f7af16f47 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:54.426020 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-443ef6fe-099d-48f2-b0c2-682f7af16f47 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:54.440122 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ef6fe-099d-48f2-b0c2-682f7af16f47 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:54.441679 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ef6fe-099d-48f2-b0c2-682f7af16f47 service placement] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:54.454253 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1448/2907] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:44:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:44:57.570266 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d70d71-3862-4df8-acf1-670132169f9d service swift] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:57.645195 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d70d71-3862-4df8-acf1-670132169f9d service swift] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:57.650381 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29ad32-93a8-4c7c-b2e4-6d6082652f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:57.651032 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29ad32-93a8-4c7c-b2e4-6d6082652f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:57.651323 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29ad32-93a8-4c7c-b2e4-6d6082652f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:57.651603 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29ad32-93a8-4c7c-b2e4-6d6082652f94 admin admin] PATH_INFO: `/v3/users/fc4d22cf624f40a9b677b9a73a10e455` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:57.653393 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29ad32-93a8-4c7c-b2e4-6d6082652f94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc4d22cf624f40a9b677b9a73a10e455)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:57.655584 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29ad32-93a8-4c7c-b2e4-6d6082652f94 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:57.709094 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ed29ad32-93a8-4c7c-b2e4-6d6082652f94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc4d22cf624f40a9b677b9a73a10e455'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:44:57.709772 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ed29ad32-93a8-4c7c-b2e4-6d6082652f94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc4d22cf624f40a9b677b9a73a10e455'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:44:57.723855 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ed29ad32-93a8-4c7c-b2e4-6d6082652f94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc4d22cf624f40a9b677b9a73a10e455'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:44:57.723855 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ed29ad32-93a8-4c7c-b2e4-6d6082652f94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc4d22cf624f40a9b677b9a73a10e455'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:44:57.737008 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-ed29ad32-93a8-4c7c-b2e4-6d6082652f94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc4d22cf624f40a9b677b9a73a10e455'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:44:57.752613 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1460/2908] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:44:57 2022] DELETE /identity/v3/users/fc4d22cf624f40a9b677b9a73a10e455 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:44:57.947371 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ef6fe-099d-48f2-b0c2-682f7af16f47 service placement] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:57.961572 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ef6fe-099d-48f2-b0c2-682f7af16f47 service placement] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:58.024876 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409a6ed-cb7e-4a4f-9582-efff87eaa4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:58.025516 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409a6ed-cb7e-4a4f-9582-efff87eaa4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:58.025797 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409a6ed-cb7e-4a4f-9582-efff87eaa4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:58.026100 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409a6ed-cb7e-4a4f-9582-efff87eaa4e6 admin admin] PATH_INFO: `/v3/projects/9a44b51d585e4ed6ba2a39efd5073841` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:58.027244 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409a6ed-cb7e-4a4f-9582-efff87eaa4e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a44b51d585e4ed6ba2a39efd5073841)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:58.029715 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409a6ed-cb7e-4a4f-9582-efff87eaa4e6 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:58.078379 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1409a6ed-cb7e-4a4f-9582-efff87eaa4e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a44b51d585e4ed6ba2a39efd5073841', 'request_id': 'req-1409a6ed-cb7e-4a4f-9582-efff87eaa4e6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:44:58.084101 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1409a6ed-cb7e-4a4f-9582-efff87eaa4e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a44b51d585e4ed6ba2a39efd5073841', 'request_id': 'req-1409a6ed-cb7e-4a4f-9582-efff87eaa4e6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:44:58.091053 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1409a6ed-cb7e-4a4f-9582-efff87eaa4e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a44b51d585e4ed6ba2a39efd5073841', 'request_id': 'req-1409a6ed-cb7e-4a4f-9582-efff87eaa4e6'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:44:58.105096 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1409a6ed-cb7e-4a4f-9582-efff87eaa4e6 admin admin] The token cache is being invalidate because project 9a44b51d585e4ed6ba2a39efd5073841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:44:58.105384 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1409a6ed-cb7e-4a4f-9582-efff87eaa4e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:44:58.106604 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-1409a6ed-cb7e-4a4f-9582-efff87eaa4e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:44:58.108126 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1449/2909] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:44:57 2022] DELETE /identity/v3/projects/9a44b51d585e4ed6ba2a39efd5073841 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:44:58.112210 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29ad32-93a8-4c7c-b2e4-6d6082652f94 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:58.113666 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-ed29ad32-93a8-4c7c-b2e4-6d6082652f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:58.129449 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29ad32-93a8-4c7c-b2e4-6d6082652f94 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:58.197343 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34573113-b049-4269-a2f9-90d9b9d404b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:58.197981 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34573113-b049-4269-a2f9-90d9b9d404b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:58.198261 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34573113-b049-4269-a2f9-90d9b9d404b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:58.198533 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34573113-b049-4269-a2f9-90d9b9d404b5 admin admin] PATH_INFO: `/v3/users/2553bd7d7c8347af8506376f6af3b4ab` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:58.200300 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34573113-b049-4269-a2f9-90d9b9d404b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2553bd7d7c8347af8506376f6af3b4ab)` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:58.202269 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34573113-b049-4269-a2f9-90d9b9d404b5 admin admin] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:58.208436 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:58.256312 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-34573113-b049-4269-a2f9-90d9b9d404b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2553bd7d7c8347af8506376f6af3b4ab'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:44:58.257161 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-34573113-b049-4269-a2f9-90d9b9d404b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2553bd7d7c8347af8506376f6af3b4ab'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:44:58.266096 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-34573113-b049-4269-a2f9-90d9b9d404b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2553bd7d7c8347af8506376f6af3b4ab'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:44:58.266767 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-34573113-b049-4269-a2f9-90d9b9d404b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2553bd7d7c8347af8506376f6af3b4ab'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:44:58.279819 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.notifications [None req-34573113-b049-4269-a2f9-90d9b9d404b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2553bd7d7c8347af8506376f6af3b4ab'} {{(pid=81517) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:44:58.293110 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1461/2910] 10.222.0.96 () {58 vars in 1224 bytes} [Wed Aug 24 04:44:58 2022] DELETE /identity/v3/users/2553bd7d7c8347af8506376f6af3b4ab => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:44:58.497803 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409a6ed-cb7e-4a4f-9582-efff87eaa4e6 admin admin] Authenticating user token {{(pid=81516) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:58.499307 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.fernet_utils [None req-1409a6ed-cb7e-4a4f-9582-efff87eaa4e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81516) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:58.517921 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409a6ed-cb7e-4a4f-9582-efff87eaa4e6 admin admin] Validating token access rules against request {{(pid=81516) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:58.587421 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe7c3d-b640-4023-a0e1-d8c93f5d58a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e583097bf7c4097a82fd7d436d1c78d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc9d6801b4c048408ddddff5c9f8e743', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81516) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:58.588065 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe7c3d-b640-4023-a0e1-d8c93f5d58a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:58.588347 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe7c3d-b640-4023-a0e1-d8c93f5d58a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:58.588640 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe7c3d-b640-4023-a0e1-d8c93f5d58a0 admin admin] PATH_INFO: `/v3/projects/85e8fe5a43d24afaa56739e42cbcd048` {{(pid=81516) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:58.589779 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe7c3d-b640-4023-a0e1-d8c93f5d58a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85e8fe5a43d24afaa56739e42cbcd048)` {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:58.592494 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe7c3d-b640-4023-a0e1-d8c93f5d58a0 admin admin] RBAC: Authorization granted {{(pid=81516) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:58.604397 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:58.652297 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7afe7c3d-b640-4023-a0e1-d8c93f5d58a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85e8fe5a43d24afaa56739e42cbcd048', 'request_id': 'req-7afe7c3d-b640-4023-a0e1-d8c93f5d58a0'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:44:58.658311 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7afe7c3d-b640-4023-a0e1-d8c93f5d58a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85e8fe5a43d24afaa56739e42cbcd048', 'request_id': 'req-7afe7c3d-b640-4023-a0e1-d8c93f5d58a0'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:44:58.664571 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7afe7c3d-b640-4023-a0e1-d8c93f5d58a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85e8fe5a43d24afaa56739e42cbcd048', 'request_id': 'req-7afe7c3d-b640-4023-a0e1-d8c93f5d58a0'} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:44:58.677777 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7afe7c3d-b640-4023-a0e1-d8c93f5d58a0 admin admin] The token cache is being invalidate because project 85e8fe5a43d24afaa56739e42cbcd048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81516) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:44:58.678068 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7afe7c3d-b640-4023-a0e1-d8c93f5d58a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:44:58.678701 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG keystone.notifications [None req-7afe7c3d-b640-4023-a0e1-d8c93f5d58a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81516) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:44:58.680194 dv-cinder-854263-1-smb devstack@keystone.service[81516]: [pid: 81516|app: 0|req: 1450/2911] 10.222.0.96 () {58 vars in 1233 bytes} [Wed Aug 24 04:44:58 2022] DELETE /identity/v3/projects/85e8fe5a43d24afaa56739e42cbcd048 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:45:08.289573 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:08.674695 dv-cinder-854263-1-smb devstack@keystone.service[81516]: DEBUG dbcounter [-] [81516] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81516) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:25.935760 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34573113-b049-4269-a2f9-90d9b9d404b5 admin admin] Authenticating user token {{(pid=81517) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:25.937221 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-34573113-b049-4269-a2f9-90d9b9d404b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:26.080971 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34573113-b049-4269-a2f9-90d9b9d404b5 admin admin] Validating token access rules against request {{(pid=81517) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:26.142551 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d0b61-d4f6-49c9-b0c8-0b20ec200aa0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1f7fe9af30947dbae1f2334b18f630d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd76b6cd68a7f4613a8e921781495f256', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81517) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:26.143170 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d0b61-d4f6-49c9-b0c8-0b20ec200aa0 service placement] REQUEST_METHOD: `GET` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:26.143459 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d0b61-d4f6-49c9-b0c8-0b20ec200aa0 service placement] SCRIPT_NAME: `/identity` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:26.143741 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d0b61-d4f6-49c9-b0c8-0b20ec200aa0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81517) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:26.145540 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.fernet_utils [None req-c07d0b61-d4f6-49c9-b0c8-0b20ec200aa0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81517) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:26.158113 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d0b61-d4f6-49c9-b0c8-0b20ec200aa0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:26.159723 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d0b61-d4f6-49c9-b0c8-0b20ec200aa0 service placement] RBAC: Authorization granted {{(pid=81517) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:26.170168 dv-cinder-854263-1-smb devstack@keystone.service[81517]: [pid: 81517|app: 0|req: 1462/2912] 10.222.0.96 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:36.165838 dv-cinder-854263-1-smb devstack@keystone.service[81517]: DEBUG dbcounter [-] [81517] Writing DB stats keystone:SELECT=89 {{(pid=81517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}